fine-tuning

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

Explore a comprehensive collection of resources, tutorials, papers, tools, and best practices for fine-tuning Large Language Models (LLMs). Perfect for ML practitioners and researchers!

LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA

A library for easily merging multiple LLM experts, and efficiently train the merged LLM.

One-click Portable Windows installation of 'AI-Toolkit by Ostris'

VibeVoiceFusion is a full-stack, multi-speaker voice generation web system featuring LoRA fine-tuning, batch generation, and VRAM optimization. Based on Microsoft's VibeVoice (AR + diffusion architecture)

⚠️ Legacy repository for Geti v2.x. For Geti v3.0+, visit https://github.com/open-edge-platform/geti

LLM Tuning with PEFT (SFT+RM+PPO+DPO with LoRA)

Finetune llama2-70b and codellama on MacBook Air without quantization

PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models(NeurIPS 2024 Spotlight)

Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)

simpleT5 is built on top of PyTorch-lightning⚡️ and Transformers🤗 that lets you quickly train your T5 models.

Odyssey: Empowering Minecraft Agents with Open-World Skills

BentoDiffusion: A collection of diffusion models served with BentoML

Embedding Studio is a framework which allows you transform your Vector Database into a feature-rich Search Engine.

Production-ready data processing made easy and shareable

[NeurIPS 2025] Flow x RL. "ReinFlow: Fine-tuning Flow Policy with Online Reinforcement Learning". Support VLAs e.g., Pi0, Pi0.5, GR00TN1.5. Fully open-sourced.

AutoAudit—— the LLM for Cyber Security 网络安全大语言模型

🛰️ 基于真实医疗对话数据在ChatGLM上进行LoRA、P-Tuning V2、Freeze、RLHF等微调，我们的眼光不止于医疗问答

Qwen3 Fine-tuning: Medical R1 Style Chat