mlx

Introduction to MLX for Swift developers

Local-first CLI for benchmarking LLMs on real hardware — quality, speed, reliability, and a real multi-turn agent loop.

macOS voice productivity app — built-in dictation, AI rewrite, and translation. Powered by local Whisper + LLM.

Private, on-device AI desktop app — GGUF (llama.cpp) & MLX, with Qwen3.8's native reasoning-effort ladder wired in as a real control. Local coding agent, RAG knowledge base, Deep Research, vision and voice. 100% offline, no account, no telemetry. Windows & macOS.

the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly

Fully local voice interface for Claude Code on Apple Silicon. Parakeet STT + Kokoro TTS + SmartTurn EOU + dual VAD.

😼 OpenFelix — Voice-first AI agent for macOS. Runs local LLMs on Apple Silicon via MLX. Supports all OpenClaw skills. Claude, GPT, or fully offline.

A local LLM workhorse that keeps a memory of your workday. On-device meeting notes, dictation, autocomplete, and recall for macOS. GPLv3.

Swift 6 agent SDK: type-safe tools, streaming, cloud + on-device inference via MLX on Apple Silicon

Your LLM playground on Apple devices. Run open-source AI models locally on your Mac with a native SwiftUI interface.

Offline-first voice dictation, transcription, cleanup, and text-to-speech for macOS, iOS, and Android.

Local LLM chat app for Apple Silicon Macs.

Local AI workstation — discover, run, chat, benchmark, and generate images from open-weight models. DFlash/DDTree speculative decoding, TurboQuant & TriAttention cache compression strategies, MLX + llama.cpp + vLLM + MTPLX backends.

A CLI in Rust to generate synthetic data for MLX friendly training

大模型推理框架加速，让 LLM 飞起来

One Mac process. Many models. Real speed. Multi-model LLM serving with prefix reuse, MTP acceleration, and OpenAI APIs — built for Apple Silicon, measured against mlx-lm and llama.cpp.

Run the LLM Swarm Router on machines to distribute Local Ai to the Swarm - More Machines - MORE SPEED

Local, real-time system-audio captioner + translator for macOS — Whisper + a local LLM + a glass overlay. Fully offline.

The free, open-source meeting-notes app for your Mac — offline transcription and AI notes, free in the cloud or 100% on-device.

macOS app for real-time audio transcription powered by MLX on Apple Silicon