quantumnic

quantumnic/ssd-llm

Run 70B+ LLMs on Apple Silicon by using SSD as extended memory — intelligent layer streaming and caching for Mac

⭐ 37 ⑂ 3 Rust MIT · 23 天前推送
apple-silicongpuinferencellamallmmacbookmetalollamassdmmap
37
Watchers
0
贡献者
0
Commits
0
Releases
0
Open Issues
23 天前
最近推送
原文 中文
暂无 README