Babyhamsta

Babyhamsta/KIV

KV cache middleware for 1M context on 12GB VRAM. Uses K vectors as a retrieval index to fetch V on-demand from system RAM. No model modification, no retraining. Drop-in HuggingFace cache replacement.

⭐ 11 ⑂ 2 Python Apache-2.0 · 2026-04-23推送
11
Watchers
0
贡献者
0
Commits
0
Releases
0
Open Issues
2026-04-23
最近推送
原文 中文
暂无 README