llamacpp

Local first semantic code search and chat | Leverage custom copilots with fine-tuning datasets from code in Alpaca, Conversational, Completion and Instruction format

Cross-platform on-device AI toolkit

Creates an index of images, queries a local LLM and adds tags to the image metadata

ML software (llama.cpp, ComfyUI, vLLM) builds for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60

☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

IRIS is an android app for interfacing with GGUF / llama.cpp models locally.

High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.

Home Assistant LLM integration for local OpenAI-compatible services (llamacpp, vllm, etc)

llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2

🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫

Tiny toolkit for air-gapped LLMs on consumer-grade hardware

Private on-device AI chat for Android — runs any GGUF model locally via llama.cpp with ARM-optimised SIMD. Zero network permissions, encrypted settings, biometric lock, tamper detection. + GPU Acceleration

An Automated AI-Powered Prompt Optimization Framework

A minimal interface for AI Companion that runs entirely in your browser.

A collection of Generative AI examples on iOS.

Run any Large Language Model behind a unified API

Booster - open accelerator for LLM models. Better inference and debugging for AI hackers

WhatsApp auto responder with LLM integration. It support OpenAI API and also local LLMs

Your gateway to both Ollama & Apple MlX models

Zero-overhead, terminal-native local-LLM runtime manager. Launches, supervises, and routes local models behind one OpenAI-compatible endpoint.