bitsandbytes

Official repository of my book "A Hands-On Guide to Fine-Tuning LLMs with PyTorch and Hugging Face"

Estimate whether a Hugging Face model fits and fine-tunes on your local GPU.

🦖 X—LLM: Cutting Edge & Easy LLM Finetuning

Nodes to run Hunyuan Image 3 locally with BF16 and NF4 quantized options in Comfyui

Instruction Fine-Tuning of Meta Llama 3.2-3B Instruct on Kannada Conversations. Tailoring the model to follow specific instructions in Kannada, enhancing its ability to generate relevant, context-aware responses based on conversational inputs. Using the Kannada Instruct dataset for fine-tuning! Happy Finetuning 🎋

A "standard library" of Triton kernels.

Running small but capable language models entirely offline