apple-silicon

100% local video dubbing on your desktop — dub videos in your own voice. Private AI dubbing with no cloud, no uploads, no time-stretching.

Local LLM chat app for Apple Silicon Macs.

Local AI workstation — discover, run, chat, benchmark, and generate images from open-weight models. DFlash/DDTree speculative decoding, TurboQuant & TriAttention cache compression strategies, MLX + llama.cpp + vLLM + MTPLX backends.

One Mac process. Many models. Real speed. Multi-model LLM serving with prefix reuse, MTP acceleration, and OpenAI APIs — built for Apple Silicon, measured against mlx-lm and llama.cpp.

Local, real-time system-audio captioner + translator for macOS — Whisper + a local LLM + a glass overlay. Fully offline.

The free, open-source meeting-notes app for your Mac — offline transcription and AI notes, free in the cloud or 100% on-device.

macOS app for real-time audio transcription powered by MLX on Apple Silicon

Local CLI for Google's TranslateGemma translation models with multi-platform support (MLX for Apple Silicon, PyTorch for CUDA/CPU).

Local AI load balancer for Ollama and MLX fleets. Auto-discovery, smart routing, OpenAI-compatible API, zero config. Perfect for Mac Minis & Studios.

macOS computer-use agent in the notch. Long-press, talk, Claude drives the mouse.

A high-performance Model Context Protocol (MCP) server providing local speech-to-text transcription using whisper.cpp, optimized for Apple Silicon.

Local inference server for Apple Silicon — hot-swaps MLX models (LLM, vision, embeddings, TTS, STT) via OpenAI API

CPU-first, eager-execution tensor/autograd runtime and LLM inference engine written in pure Zig

MLX Local Serving (MLS) - Unified ASR, TTS, and Translation on Apple Silicon

Push-to-talk voice dictation for macOS. 100% local, free, open source. Apple Silicon MLX. No cloud, no subscription.

Fine-tune a local LLM on your own app's data in 15 minutes. Runs entirely on-device, zero cloud after training. Apple Silicon + CUDA.

Local AI for Apple Silicon. Chat with open LLMs (Qwen, Gemma, DeepSeek, Mistral, Llama…) fully offline on your Mac via Apple MLX — private by design, zero telemetry.

Local AI model manager

Run NVIDIA's tri-modal Nemotron Omni (text+vision+audio) entirely on Apple Silicon — pure MLX runtime, parity-verified against NVIDIA's reference

Local AI server with persistent memory, RAG, and multi-backend inference (MLX / llama.cpp / Ollama). Runs entirely on your machine — zero data sent to external services.