transformer

First open-source implementation of Google TurboQuant (ICLR 2026) -- near-optimal KV cache compression for LLM inference. 5x compression with near-zero quality loss.

whisper-cpp-serve Real-time speech recognition and c+ of OpenAI's Whisper model in C/C++

Trained T5 and T5-large model for creating keywords from text

A Crash Course in Hugging Face

Reimplementation of a BERT based model (Shi et al, 2019), currently the state-of-the-art for English SRL. This model implements also predicate disambiguation.

Code and data form the paper BERT Got a Date: Introducing Transformers to Temporal Tagging

Fine-tuning 6-Billion GPT-J (& other models) with LoRA and 8-bit compression

A brand logo detection system by DETR

<만들면서 배우는 생성 AI 2판>의 코드 저장소

Electra pre-trained model using Vietnamese corpus

Distributed 56M-parameter LLM inference across 3 ESP32-S3 boards via ESP-NOW , Split-PLE + KV cache, fully offline.

Zero administration inference with AWS Lambda for 🤗

A numpy implementation of the Transformer model in "Attention is All You Need"

[ACL 2024 Findings] Code implementation of Paper "Rethinking Negative Instances for Generative Named Entity Recognition"

An unofficial pytorch implementation of 'Efficient Infinite Context Transformers with Infini-attention'

several types of attention modules written in PyTorch for learning purposes

Generative AI with Large Language Models on Coursera offered by Deeplearning.AI and AWS.

Train Llama 3 models from scratch. Any scale, any personality. By Arianna Method.

A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and Tensorflow.

Pre-training Language Models for Japanese