on-device-ai

A practical lab for exploring Apple's Core AI framework, model assets, specialization, and on-device inference.

On-device speech-to-text for macOS. Hold a hotkey → Whisper transcribes locally via CoreML → text auto-pastes into the focused app. 99 languages, free, open-source.

Custom implementation of Apple Intelligence features

Embedded on-device vector database for AI agent memory and local RAG — disk-based HNSW in an LSM-tree, C++/Python, optimized for low memory footprint

Swift 6 agent SDK: type-safe tools, streaming, cloud + on-device inference via MLX on Apple Silicon

Your LLM playground on Apple devices. Run open-source AI models locally on your Mac with a native SwiftUI interface.

100% local video dubbing on your desktop — dub videos in your own voice. Private AI dubbing with no cloud, no uploads, no time-stretching.

One Mac process. Many models. Real speed. Multi-model LLM serving with prefix reuse, MTP acceleration, and OpenAI APIs — built for Apple Silicon, measured against mlx-lm and llama.cpp.

Local, real-time system-audio captioner + translator for macOS — Whisper + a local LLM + a glass overlay. Fully offline.

Android 16 fork. AI as a platform primitive. Twelve capabilities, one shared runtime, every app. OEM-pluggable. Apache 2.0.

Open-source iOS voice dictation keyboard — fully offline, private, no subscription required for core features.

Run Qwen3.5 on your iPhone. No cloud. No API keys. No subscriptions. 100% on-device.

Private, on-device AI meeting notetaker that runs entirely in your browser — live transcription, speaker ID, and note extraction with no audio leaving your machine (WebGPU + WASM).

Private, on-device voice assistant - STT, LLM, and TTS running fully locally. Powered by the Tether QVAC SDK. Mobile (Android via Expo + React Native) and desktop (Windows / macOS / Linux via Electron) from a shared hexagonal core.

Introducing Muse Glimmer: open-weight 30B agentic multimodal model that runs on your device (Meta). Interactive local agent lab + guide. Apache 2.0 · on-device AI · function calling

Run IBM Granite 4.0 locally on Raspberry Pi 5 with Ollama.This is a privacy-first AI. Your data never leaves your device because it runs 100% locally. There are no cloud uploads and no third-party tracking.

Run NVIDIA's tri-modal Nemotron Omni (text+vision+audio) entirely on Apple Silicon — pure MLX runtime, parity-verified against NVIDIA's reference