noctaya/noctaya

Kubernetes-native control plane for scale-to-zero serving of long-tail LLMs

⭐ 11 ⑂ 5 Go Apache-2.0 · 3 天前推送

https://noctaya.io

ascend autoscaling cloud-native inference keda kubernetes llm llm-inference llm-serving model-serving nvidia operator vllm scale-to-zero volcano

11

Watchers

0

贡献者

0

Commits

0

Releases

5

Open Issues

3 天前

最近推送

原文中文

暂无 README