transformers

Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention

Awesome Transformers (self-attention) in Computer Vision

CINO: Pre-trained Language Models for Chinese Minority (少数民族语言预训练模型)

[WACV 2024] Beyond Self-Attention: Deformable Large Kernel Attention for Medical Image Segmentation

🤗 Korean Comments ELECTRA: 한국어 댓글로 학습한 ELECTRA 모델

Source code for GNN-LSPE (Graph Neural Networks with Learnable Structural and Positional Representations), ICLR 2022

AI-powered padel analytics

DeepConsensus uses gap-aware sequence transformers to correct errors in Pacific Biosciences (PacBio) Circular Consensus Sequencing (CCS) data.

Official source for spanish Language Models and resources made @ BSC-TEMU within the "Plan de las Tecnologías del Lenguaje" (Plan-TL).

[ECCV2024 Oral] Official implementation of the paper "Relation DETR: Exploring Explicit Position Relation Prior for Object Detection"

[CVPR 2022] Official Pytorch code for OW-DETR: Open-world Detection Transformer

MinT: Minimal Transformer Library and Tutorials

Meta's "No Language Left Behind" models served as web app and REST API

PyTorch implementation of Transformer model used in "Deep Transformer Models for Time Series Forecasting: The Influenza Prevalence Case"

A Simplified PyTorch Implementation of Vision Transformer (ViT)

Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.

PyTorch implementation of Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancy

Causal discovery algorithms and tools for implementing new ones

Implementation of PF-Track

Code for instruction-tuning Stable Diffusion.