mlx-lm

Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.

Build an Autonomous Web3 AI Trading Agent (BASE + Uniswap V4 example)

Local inference server for Apple Silicon — hot-swaps MLX models (LLM, vision, embeddings, TTS, STT) via OpenAI API

Local AI for Apple Silicon. Chat with open LLMs (Qwen, Gemma, DeepSeek, Mistral, Llama…) fully offline on your Mac via Apple MLX — private by design, zero telemetry.