raspoli/mlx-serve

Local inference server for Apple Silicon — hot-swaps MLX models (LLM, vision, embeddings, TTS, STT) via OpenAI API

⭐ 18 ⑂ 2 Python MIT · 2026-06-23推送

apple-silicon embeddings fastapi inference-server llm local-llm machine-learning macos mlx model-serving openai-api openai-compatible python speech-to-text text-to-speech vision-language-model local-inference mlx-lm unified-memory

18

Watchers

0

贡献者

0

Commits

0

Releases

0

Open Issues

2026-06-23

最近推送

原文中文

暂无 README