local-inference

Distribute and run LLMs with a single file.

High-speed Large Language Model Serving for Local Deployment

InferrLM - On-device AI for iOS & Android

An open-source, model-agnostic agent harness for local LLMs. Define agents in YAML (tools, memory, deny-first permissions) and run them against any OpenAI-compatible endpoint: vLLM, Ollama, LM Studio, or llama.cpp.

Local inference server for Apple Silicon — hot-swaps MLX models (LLM, vision, embeddings, TTS, STT) via OpenAI API

Honeycomb Lab — hex map + OpenAI gateway control plane for a home AI fleet