ome-projects

ome-projects/ome

Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

⭐ 494 ⑂ 92 Go Apache-2.0 · 15 小时前推送
494
Watchers
0
贡献者
0
Commits
0
Releases
123
Open Issues
15 小时前
最近推送
原文 中文
暂无 README