mirkolenz

mirkolenz/llmhop

Tiny, stateless Go router that dispatches OpenAI-compatible requests to single-model vLLM and sglang backends with zero external dependencies

⭐ 11 ⑂ 0 Nix MIT · 4 小时前推送
https://mirkolenz.github.io/llmhop/
dockergohostinghttpinferencellmmultiplexernixnixosopenaiproxyroutersglangvllmflakes
11
Watchers
0
贡献者
0
Commits
0
Releases
4
Open Issues
4 小时前
最近推送
原文 中文
暂无 README