transformers

CPU inference for the DeepSeek family of large language models in C++

0️⃣1️⃣🤗 BitNet-Transformers: Huggingface Transformers Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch with Llama(2) Architecture

Explorations into training LLMs to use clinical calculators from patient history, using open sourced models. Will start with Wells' Criteria

Edge Inference in Browser with Transformer NLP model

⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).

A holistic way of understanding how Llama and its components run in practice, with code and detailed documentation.

Multilingual TTS model with voice cloning and duration control, based on T5Gemma encoder-decoder LLM

LLMVoX: Autoregressive Streaming Text-to-Speech Model for Any LLM

PyTorch code for ETSformer: Exponential Smoothing Transformers for Time-series Forecasting

An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal acceleration.

Explorations into some recent techniques surrounding speculative decoding

Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorch

Production-Ready LLM Agent SDK for Every Developer

Text2Text Language Modeling Toolkit

Reliable, minimal and scalable library for pretraining foundation and world models

This package features data-science related tasks for developing new recognizers for Presidio. It is used for the evaluation of the entire system, as well as for evaluating specific PII recognizers or PII detection models.

A Simple, Lightweight, and Extensible Serving Framework for X-AnyLabeling

PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" (https://arxiv.org/abs/2404.07143)

Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI