transformers

[EMNLP 2024] ESC: Efficient Speech Coding with Cross-Scale Residual Vector Quantized Transformers

Accelerated NLP pipelines for fast inference on CPU. Built with Transformers and ONNX runtime.

Language AI Engineering Lab, a place where you can deeply understand and build modern Language AI systems, from fundamentals to production.

Camoscio: An Italian instruction-tuned language model based on LLaMA

Implementation of Memformer, a Memory-augmented Transformer, in Pytorch

Accelerated NLP pipelines for fast inference on CPU and GPU. Built with Transformers, Optimum and ONNX Runtime.

An unofficial implementation of ViTPose [Y. Xu et al., 2022]

Repository of the paper "Accelerating Transformer Inference for Translation via Parallel Decoding"

An implementation of Tiny Recursive Models (TRM)

Deploy stable diffusion model with onnx/tenorrt + tritonserver

Pretraining transformer based Thai language models

BabyGPT: Build Your Own GPT Large Language Model from Scratch Pre-Training Generative Transformer Models: Building GPT from Scratch with a Step-by-Step Guide to Generative AI in PyTorch and Python

[TMLR 2025 → ICML 2026] RouteFinder: Towards Foundation Models for Vehicle Routing Problems

Implementation of Mimic-Video, Video-Action Models for SOTA Generalizable Robot Control Beyond VLAs

Deploy transformers serverless on AWS Lambda

Contains code for the paper "Vision Transformers are Robust Learners" (AAAI 2022).

Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch

Few-shot Named Entity Recognition

Robust and fast topic models with sentence-transformers.

Codebase and CLI for PLAPT: A state-of-the-art protein-ligand binding affinity model for drug discovery