instruction-tuning

This repository contains the code to train flan t5 with alpaca instructions and low rank adaptation.

[NeurIPS-2024] The offical Implementation of "Instruction-Guided Visual Masking"

[NeurIPS 2025] The official repository of "Inst-IT: Boosting Multimodal Instance Understanding via Explicit Visual Prompt Instruction Tuning"

Custom model training using modern architectures. 4-bit QLoRA fine-tuning pipeline for LLaMA 3 8B with production-grade optimization. Memory-efficient training on consumer GPUs. Published adapter on HuggingFace. From training pipeline to deployed model.

[TACL, EMNLP 2025 Oral] Code, datasets, and checkpoints for the paper "CRAFT Your Dataset: Task-Specific Synthetic Dataset Generation Through Corpus Retrieval and Augmentation"

Implementation of Bitune: Bidirectional Instruction-Tuning

An LLM training library for instruction-tuning.

A distributed training framework for large language models powered by Lightning.

Implementation of build an LLM from scratch by Sebastian Raschka.

Implementation of TSDS: Data Selection for Task-Specific Model Finetuning. An optimal-transport framework for selecting domain-specific and task-specific training data to improve LLM finetuning and instruction tuning.

[WACV 2026] Face-LLaVA: Facial Expression and Attribute Understanding through Instruction Tuning

⚡ LLaMA-2 model experiment

Llama 3.2 fine-tuned on a medical dataset for improved healthcare-specific understanding and tasks.