large-language-models

Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀

LuaN1aoAgent is a fully autonomous AI penetration testing agent driven by graph-based cognitive reasoning.

[TMLR 2024] Efficient Large Language Models: A Survey

The official implementation of Self-Play Fine-Tuning (SPIN)

LangChain & Prompt Engineering tutorials on Large Language Models (LLMs) such as ChatGPT with custom data. Jupyter notebooks on loading and indexing data, creating prompt templates, CSV agents, and using retrieval QA chains to query the custom data. Projects for using a private LLM (Llama 2) for chat with PDF files, tweets sentiment analysis.

Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"

A generalized information-seeking agent system with Large Language Models (LLMs).

LLM KV cache compression made easy

A practical lab for building, testing, and evaluating apps with Apple's Foundation Models framework.

Create, Evaluate, and Connect AI Skills

[ICLR 2026] LightMem: Lightweight and Efficient Memory-Augmented Generation

[NeurIPS 2024] An official implementation of "ShareGPT4Video: Improving Video Understanding and Generation with Better Captions"

🩺 首个会看胸部X光片的中文多模态医学大模型 | The first Chinese Medical Multimodal Model that Chest Radiographs Summarization.

Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

Awesome-llm-role-playing-with-persona: a curated list of resources for large language models for role-playing with assigned personas

[ICLR'24 spotlight] Chinese and English Multimodal Large Model Series (Chat and Paint) | 基于CPM基础模型的中英双语多模态大模型系列

[ECCV 2024 Best Paper Candidate & TPAMI 2025] PointLLM: Empowering Large Language Models to Understand Point Clouds

Build and run AI agents using Docker Compose. A collection of ready-to-use examples for orchestrating open-source LLMs, tools, and agent runtimes.

[ACL 2023] Reasoning with Language Model Prompting: A Survey

Ship RAG based LLM web apps in seconds.