llm-training

Instruct-tune Open LLaMA / RedPajama / StableLM models on consumer hardware using QLoRA

A data-centric AI package for ML/AI. Get the best high-quality data for the best results. Discord: https://discord.gg/t6ADqBKrdZ

CompanionLLM - A framework to finetune LLMs to be your own sentient conversational companion

npm like package ecosystem for Prompts 🤖

A Streamlit app for generating high-quality Q&A training datasets from text and PDFs, leveraging Gemini, Claude, and OpenAI for LLM fine-tuning.

the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly

一款强大的大模型微调数据集生成和管理工具。

A distributed training framework for large language models powered by Lightning.

CyberBrain_Model is an advanced AI project designed for fine-tuning the model `DeepSeek-R1-Distill-Qwen-14B` specifically for cyber security tasks.

Interview prep for LLM post-training, ML, system design, and coding — organized by career path.

A lightweight post-training framework for LLMs and VLMs. 51 algorithms, 38 verified models. Scales with DeepSpeed, vLLM, and Ray.

A comprehensive GUI wrapper application for Apple's Foundation Models Adapter Training Toolkit, providing an intuitive interface for training LoRA adapters for Apple's on-device foundation models.

Multi-node distributed LLM training framework

LLM finetuning for Sudoku solving

Source-code level analysis of LLM RL training infra: async RL, weight sync, FP8, MoE routing | LLM RL 训练基础设施源码级分析

Madlab is an advanced AI development studio designed to streamline the process of dataset management, model training, and evaluation. It combines a robust Node.js/Express backend with a powerful Python-based training engine and a modern React frontend.

Code the ICML 2024 paper: "Variance-reduced Zeroth-Order Methods for Fine-Tuning Language Models"

A Classification Approach: Making LLM Knowledge-Aware