vllm-project/semantic-router

A programmable Mixture-of-Models router for heterogeneous LLM inference

⭐ 5.2k ⑂ 824 Go Apache-2.0 · 7 小时前推送

https://vllm-sr.ai

ai-gateway bert-classification fine-tuning golang huggingface-candle huggingface-transformers kubernetes llm llmrouter mixture-of-models pii-detection prompt-engineering prompt-guard rust semantic-router vllm

5.2k

Watchers

0

贡献者

0

Commits

0

Releases

350

Open Issues

7 小时前

最近推送

原文中文

暂无 README