attention-is-all-you-need

A PyTorch implementation of the Transformer model in "Attention is All You Need".

Multilingual Automatic Speech Recognition with word-level timestamps and confidence

Learn LLM internals step by step - from tokenization to attention to inference optimization.

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning", an all-new multi modal AI that uses just a decoder to generate both text and images

Implementation of "PaLM-E: An Embodied Multimodal Language Model"

Pytorch implementation of the models RT-1-X and RT-2-X from the paper: "Open X-Embodiment: Robotic Learning Datasets and RT-X Models"

Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling

PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"

Transformer architecture explained step by step - the full architecture, every attention variant, positional embeddings, and every layer inside a Transformer.

Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper

Build your own Face App with Stable Diffusion 2.1

BabyGPT: Build Your Own GPT Large Language Model from Scratch Pre-Training Generative Transformer Models: Building GPT from Scratch with a Step-by-Step Guide to Generative AI in PyTorch and Python

My implementation of Kosmos2.5 from the paper: "KOSMOS-2.5: A Multimodal Literate Model"

Transformer based Bangla Speech Recognition | Encoder Decoder Architecture

Implementation of the transformer from the paper: "Real-World Humanoid Locomotion with Reinforcement Learning"

Recent Advances on Efficient Vision Transformers

AthenaOS is a next generation AI-native operating system managed by Swarms of AI Agents

The open source implementation of the cross attention mechanism from the paper: "JOINTLY TRAINING LARGE AUTOREGRESSIVE MULTIMODAL MODELS"