Star 总榜

inference cookbook / inference 框架原理解析

Open-source, self-hosted LLM chat application, featuring local-first data storage and real-time streaming responses.

面向 A 股投研，针对分析时效差、逻辑不全及数据难量化痛点，自主构建以 Qwen2.5-72B-AWQ 为核心的全链路自动化投研系统。利用 LangGraph 编排多智能体协作流，融合 LoRA 垂直微调、MCP 工具链与 CoT+ReAct 架构，实现从行情舆情实时采集、产业链知识图谱多维推演到 Reflexion 反思审核的投研全闭环，每日 9:00 定时产出机构级专业研报推送飞书，显著提升投研决策自动化水平。

A curated collection of NLP and LLM resources. Covers essential papers and blogs on Transformers, Reinforcement Learning (RLHF, DPO, GRPO), Mechanistic Interpretability, Scaling Laws, and MLSys.

Agent skill that prepares a Linux server with NVIDIA GPUs for LLM workloads - driver and CUDA, Docker with NVIDIA Container Toolkit, staged verification gates, compose presets for vLLM, Infinity, OpenWebUI and Ollama

VS Code extension to connect to local LLM inference servers (Ollama, llama.cpp, LocalAI) via OpenAI API compatible endpoints.

Perl Framework for AI - Langertha - the viking of AI

Automated comic cataloging tool that identifies issues directly from cover images using a vision-language model, then cross-references results with the Grand Comics Database and the ComicVine API to generate structured, high-confidence collection data with minimal manual entry.

Phlox is a self-hostable chat platform with an agentic harness, document RAG, code execution, MCP integration and LLM gateway — running over any model provider: AWS Bedrock or any OpenAI-compatible endpoint (OpenAI, Ollama, OpenRouter, vLLM, LiteLLM, LM Studio, local models).

📞 Локальный AI-секретарь, тех. поддержка и менеджер по продажам с клонированием голоса XTTS v2, real-time распознаванием речи (Vosk/Whisper) и offline LLM (vLLM + Qwen/Llama и тп). Полноценная админ-панель (Vue 3), Telegram-бот, виджет для сайта, fine-tuning pipeline. Self-hosted, приватность данных, СМС и телефонные звонки .

Advanced LLM fine-tuning techniques: SFT (LoRA, QLoRA, DoRA, P-/Prefix-Tuning), GRPO, DPO, ORPO, KTO & PPO; composable correctness/format rewards + LLM-as-a-Judge evals (DeepEval, Evidently AI) across math, multi-hop, medical & general QA on Llama 3, Mistral, Phi-4, Gemma & Qwen3. Built on TRL, PEFT & Unsloth.

An intelligent web crawling and content extraction tool that transforms web content into structured JSON data suitable for fine-tuning Large Language Models (LLMs).

A style-aware deep learning model for adaptive cell instance segmentation by contrastive fine-tuning.

BERT for extractive summarization using HuggingFace

A curated collection of open-source Large Language Model (LLM) projects that are production-ready and can be used for solving real-world problems. This repository focuses on high-performance, scalable LLM solutions across various industries and applications.

Deep learning models(CNN, LSTM, BERT) for image and text classification task with Tensorflow and Keras

Fine-tuning OpenAI API GPT-3.5 Turbo model Uploader

Different post-training techniques for LLMs, including: SFT, DPO and Online RL

End-to-end QLoRA-based fine-tuning of Llama-2 for a medical-diagnosis/doctor chat-bot on AWS

Recent papers and projects in multitask learning and their applications