jundot/omlx
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
⭐ 20.3k
⑂ 1.7k
Python
Apache-2.0
· 1 天前推送
20.3k
Watchers
0
贡献者
0
Commits
0
Releases
1.1k
Open Issues
1 天前
最近推送
原文
中文
暂无 README