llamacpp

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.

Unified framework for building enterprise RAG pipelines with small, specialized models

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

Production ready toolkit to run AI locally

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Private & local AI personal knowledge management app for high entropy people.

Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!

State of the Art Natural Language Processing

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

The most no-nonsense, locally or API-hosted AI code completion plugin for Visual Studio Code - like GitHub Copilot but 100% free.

AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.

LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

Bonsai Demo

Instant, controllable, local pre-trained AI models in Rust

Text-To-Speech, RAG, and LLMs. All local!