llm

Fast, flexible LLM inference

A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.

🔥 Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser sandbox that lets you automate the web without worrying about infrastructure.

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

AI enabled pair programmer for Claude, GPT, O Series, Grok, Deepseek, Gemini and 300+ models

File Parser optimised for LLM Ingestion with no loss 🧠 Parse PDFs, Docx, PPTx in a format that is ideal for LLMs.

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

An AI-powered next-generation open source real-time observability system.

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

Adding guardrails to large language models.

Tools for merging pretrained large language models.

Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).

Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.

The most powerful AI agent and AI chat software on Android/Operit是一款Android上能力最为强大、发展最久的AI Agent

每个人都能看懂的大模型知识分享，LLMs春/秋招大模型面试前必看，让你和面试官侃侃而谈

LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

GLM-5: From Vibe Coding to Agentic Engineering

TalkToFigma: MCP integration between AI Agent (Cursor, Claude Code, Codex) and Figma, allowing Agentic AI to communicate with Figma for reading designs and modifying them programmatically.

Build an agent harness and control it end-to-end. Open-source SDK for production AI agents in Python & TypeScript - any model, any cloud.