transformer

<밑바닥부터 만들면서 공부하는 LLM>(길벗, 2025)의 코드 저장소

Official Code for 'RSTNet: Captioning with Adaptive Attention on Visual and Non-Visual Words' (CVPR 2021)

A pytorch based end2end speech recognition system.

Fine-tuning toolkit for Chatterbox TTS & Chatterbox TURBO models. Supports 23 languages with smart vocabulary extension. Features offline preprocessing, automatic VAD trimming, and voice cloning capabilities. Train custom TTS models with your own dataset in LJSpeech and file-based format.

Lyrics generation with GPT2-based Transformer

PyTorch implementation and pre-trained models for ASP - Autoregressive Structured Prediction with Language Models, EMNLP 22. https://arxiv.org/pdf/2210.14698.pdf

A Web Crawler based on LLMs implemented with Ray and Huggingface. The embeddings are saved into a vector database for fast clustering and retrieval. Use it for your RAG.

SciFive: a text-text transformer model for biomedical literature

Efficient Attention for Long Sequence Processing

[ICLR 2025] 🏄 OVTR: End-to-End Open-Vocabulary Multiple Object Tracking with Transformer

mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections. (EMNLP 2022)

Nano vLLM with vLLM v1's request scheduling strategy and chunked prefill

llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deployment, such as UI, RESTful API, auto-scaling, computing resource management, monitoring, and more.

GPT-2 transformer for controllable, multitrack symbolic music generation

Implementation of Perceiver, General Perception with Iterative Attention

Enterprise-grade LLM automated deployment tool that makes AI servers truly "plug-and-play".

CLIP: Connecting Text and Image (Learning Transferable Visual Models From Natural Language Supervision)

Official implementation of the paper "IteraTeR: Understanding Iterative Revision from Human-Written Text" (ACL 2022)

Tensorflow, Pytorch, Huggingface Transformer, Fastai, etc. tutorial Colab Notebooks.

A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.