Babyhamsta/KIV
KV cache middleware for 1M context on 12GB VRAM. Uses K vectors as a retrieval index to fetch V on-demand from system RAM. No model modification, no retraining. Drop-in HuggingFace cache replacement.
⭐ 11
⑂ 2
Python
Apache-2.0
· 2026-04-23推送
11
Watchers
0
贡献者
0
Commits
0
Releases
0
Open Issues
2026-04-23
最近推送
原文
中文
暂无 README