rlhf

Rank images using TrueSkill by comparing them against each other in the browser. 🖼📊

A travel agent based on Qwen2.5, fine-tuned by SFT + DPO/PPO/GRPO using traveling question-answer dataset, a mindmap can be output using the response. A RAG system is build upon the tuned qwen2, using Prompt-Template + Tool-Use + Chroma embedding database + LangChain

A High-Efficiency System of Large Language Model Based Search Agents

code for paper Query-Dependent Prompt Evaluation and Optimization with Offline Inverse Reinforcement Learning

[ICML 2024] Code for the paper "Confronting Reward Overoptimization for Diffusion Models: A Perspective of Inductive and Primacy Biases"

一份来自2026年的AI精神病理学诊断报告 / A Pathological Diagnosis of AI Civilization

ReNeg: Learning Negative Embedding with Reward Guidance

PipelineLLM 是一个系统性的大语言模型（LLM）后训练学习项目，涵盖从监督微调（SFT）到偏好优化（DPO）、强化学习（RLHF/PPO/GRPO）再到持续学习（Continual Learning)的完整技术栈。

Synthetic data for fine tuning LLM

Awesome-HCI （Ubiquitous, LLM, MLLM, Agent, RAG, Embodied-AI, RLHF)

Interview prep for LLM post-training, ML, system design, and coding — organized by career path.

A fine-tuning SDK — any open model, any harness, any method. 12 training methods behind one argument; pure-stdlib core.

A lightweight post-training framework for LLMs and VLMs. 51 algorithms, 38 verified models. Scales with DeepSpeed, vLLM, and Ray.

Build sovereign RAG systems with MAS‑RAG, Dual‑RAG, GraphRAG, Spatial‑RAG, multimodal pipelines, and vector search directly inside Oracle AI Database 26ai and Exadata.

Running Large Language Model easily.

A curated full-stack LLM engineering playbook — from AI infrastructure and model lifecycle to agents, MCP, memory, and evaluation.

Embark on the "Reinforcement Learning from Human Feedback" course and align Large Language Models (LLMs) with human values.

An MCP server for dataset generation, fine-tuning, RL, and evaluation of LLMs — directly from your coding agent.

Companion code for the Manning book 'LLM Customization and Fine-Tuning.' Adapt open-weights LLMs end to end: prompting and RAG, LoRA/QLoRA, full SFT, distillation, and DPO/RLHF alignment.

A curated collection of NLP and LLM resources. Covers essential papers and blogs on Transformers, Reinforcement Learning (RLHF, DPO, GRPO), Mechanistic Interpretability, Scaling Laws, and MLSys.