instruction-tuning

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

The official GitHub page for the survey paper "A Survey of Large Language Models".

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

Instruction Tuning with GPT-4

Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

总结Prompt&LLM论文，开源数据&模型，AIGC应用

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts to initiate any meaningful PR on this repo and integrate as many LLM related technologies as possible. 我们打造了方便研究人员上手和使用大模型等微调平台，我们欢迎开源爱好者发起任何有意义的pr！

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family

[ECCV2024] Video Foundation Models & Data for Multimodal Understanding

Synthetic data curation for post-training and structured data extraction

DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤

Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey

MindSpore online courses: Step into LLM

[CVPR 2025 Highlight] Official code for "Olympus: A Universal Task Router for Computer Vision Tasks"

CIKM2023 Best Demo Paper Award. HugNLP is a unified and comprehensive NLP library based on HuggingFace Transformer. Please hugging for NLP now!😊

A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision, llama-3.2-vision, qwen-vl, qwen2-vl, phi3-v etc.