llm

Billus 大模型技能库：面向 LLM、VL、多模态与图像生成模型的训练、调参、剪枝、量化与工程化技能库

Multimodal Document Processing RAG with LangChain

BobVLM – A 1.5B multimodal model built from scratch and pre-trained on a single P100 GPU capable of image descriptions and moderate question answering. 🤗🎉

Curated, research-grade catalog of public AI models with substantial support for the Kazakh language.

nvtop for vLLM — an interactive terminal dashboard for vLLM serving performance (concurrency, throughput, cache & KV memory, latency, spec-decode, GPU)

A slim, local-LLM-first AI coding assistant. TUI, Web UI, and desktop app. Runs air-gapped with Ollama, vLLM, or any OpenAI-compatible endpoint.

在nano-vllm基础上支持moe模型以及Speculative Decoding技术

Tiny, stateless Go router that dispatches OpenAI-compatible requests to single-model vLLM and sglang backends with zero external dependencies

Qwen3.6 vLLM Toolkit — Launcher + Templates, Optimized for 2×24 GB. vLLM launcher with an optimized hybrid chat template drawing from the best community fixes for Qwen 3.6 27B.

Simple repo to finetune an LLM hosted on Hugging Face by creating a LORA

CLI for exporting Claude Code/Codex sessions to Hugging Face with privacy redaction, MCP memory, and share-ready dataset workflows.

Open-source framework for turning expert knowledge into PII-free synthetic conversational data and production-ready LoRA adapters.

Complete setup guide for a 2-node NVIDIA DGX Spark cluster — distributed training, CUDA inference with EXO, NCCL tuning for Grace Blackwell, NVMe-TCP shared storage, and 200 Gb/s direct fabric networking.

Taller: Modelos de lenguaje a tu medida. 2º Workshop Argentino de NLP, Córdoba 2023

This repository contains a system for generating question-answer pairs for FINE-TUNING LLMs from the data you have.

Low Tensor Rank adaptation of large language models

The official fork of THoR Chain-of-Thought framework, enhanced and adapted for Emotion Cause Analysis (ECAC-2024)

Kikiola is a high-performance vector database written in Go.

Kubernetes-native control plane for scale-to-zero serving of long-tail LLMs

An interactive CLI tool that leverages Ollama, ChatGPT, Gemini, Claude, Mistral and other AI.