Star 总榜

Source-code level analysis of LLM RL training infra: async RL, weight sync, FP8, MoE routing | LLM RL 训练基础设施源码级分析

AI-Inference-Managed-by-AI: Go binary for managing AI inference on edge devices

Hikari's curated English measured notes on local LLM systems (serving, specdec, training, steering).

Turn any NVIDIA GPU into a local AI platform. Inference + fine-tuning in your browser. One command to start, automatic clustering.

TokenPowerBench: Benchmarking the power consumption of LLM inference across engines and deployment configurations

💰 Exocomp Agentic Environment for Go

Automated Triton w8a8 block FP8 kernel tuning tool for vLLM. Auto-detects model architecture, supports Qwen3-Coder-30B-A3B-Instruct-FP8/DeepSeek-V3/custom models, multi-GPU parallel tuning, and generates optimized kernel configs for quantization.

A curated collection of Claude Code agent skills that accelerate the entire vLLM development lifecycle.

本项目是一个完整的RAG系统教程，涵盖了从基础概念到高级技术的全面内容。通过Jupyter Notebook的形式，逐步讲解如何构建和优化一个高效的检索增强生成系统。本项目使用的所有模型都是本地化部署的，在3090上可以运行。

A complete roadmap to become an AI/LLM Engineer in 2026. Free & paid courses, 5 portfolio projects, interview prep, and resources. For software engineers with Python & ML basics who want to break into AI. Covers Transformers, RAG, fine-tuning, agents, LangChain, MLOps, and deployment.

⚡️ The "1-Minute RAG Audit" — Generate QA datasets & evaluate RAG systems in Colab, Jupyter, or CLI. Privacy-first, async, visual reports.

In this course navigates through the LLMOps pipeline, enabling you to preprocess training data for supervised fine-tuning and deploy custom Large Language Models (LLMs).

A simplified fine tune and deploy code based on bert for text matching.

Fine-tune a local LLM on your own app's data in 15 minutes. Runs entirely on-device, zero cloud after training. Apple Silicon + CUDA.

🏠 OpenStreetMap, AI import tool for buildings in Poland

Measuring generalization properties of graph neural networks

LLM finetuning for Sudoku solving

HypeLoRA: Hypernetwork-Generated LoRA Adapters for Calibrated Language Model Fine-Tuning

Idea plugin. This tool can help programmers quickly process https message from brower.

学习idea插件开发。欢迎交流想法、反馈BUG 1.代码补全 2.快捷跳转 3.翻译 4.一键添加api注解 5.代码统计 6.代码检查 7.生成代码 8.常用工具