defai-digital

defai-digital/ax-engine

One Mac process. Many models. Real speed. Multi-model LLM serving with prefix reuse, MTP acceleration, and OpenAI APIs — built for Apple Silicon, measured against mlx-lm and llama.cpp.

⭐ 24 ⑂ 2 Rust Apache-2.0 · 2 天前推送
24
Watchers
0
贡献者
0
Commits
0
Releases
0
Open Issues
2 天前
最近推送
原文 中文
暂无 README