llm

An LLM agnostic desktop and mobile client.

Supercharge AI Agents, Safely

The CLI-native orchestrator for AI agent workflows. Run Claude Code, Codex, Gemini CLI & Kimi Code from declarative YAML. Because the terminal is where real work happens.

Deep Research workflow on Dify: cascaded multi-source search → outline → cited long-form report. Credited in Awesome-Dify-Workflow.

Use LLMs to robustly extract web data

AI-writing humanizer for KO/EN/ZH/JA

Persist and reuse KV Cache to speedup your LLM.

Open-source memory runtime for AI agents — reproducible, provenance-tagged context bundles instead of query-time retrieval. Apache-2.0, self-hosted on Postgres + pgvector, Python + TypeScript SDKs.

CPU inference for the DeepSeek family of large language models in C++

Intelligent LLM-powered git commit message generator that understands your code! Supports multiple languages!

Drop-in prompt compression for production LLM apps. Cut your token bill 40-60% without changing your code. Python SDK, LLMLingua-2, MIT.

Starter App to Build Your Own App to Query Doc Collections with Large Language Models (LLMs) using LlamaIndex, Langchain, OpenAI and more (MIT Licensed)

On-device LLM Inference Powered by X-Bit Quantization

0️⃣1️⃣🤗 BitNet-Transformers: Huggingface Transformers Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch with Llama(2) Architecture

🌱 EcoLogits tracks the energy consumption and environmental footprint of using generative AI models through APIs.

Set of 📝 with 🔗 to help those building Voice AI agents 🎙️🤖

[EMNLP 2024: Demo Oral] RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation

VeritasGraph — open-source Knowledge Graph & GraphRAG framework on GitHub. Build multi-hop reasoning, ontology-aware retrieval, and verifiable attribution over your own data. Nodes, edges, RDF, linked-data — runs locally or in the cloud.

Multilingual TTS model with voice cloning and duration control, based on T5Gemma encoder-decoder LLM

📎🟢 Like Clippy but for the CLI. A blazing fast AI helper for your command line