VectorInstitute/vector-inference

Efficient LLM inference on Slurm clusters.

⭐ 106 ⑂ 14 Python Apache-2.0 · 5 天前推送

https://vectorinstitute.github.io/vector-inference/

inference llm multimodal sglang speech-to-text vllm vlm text-embedding audio-transcription llm-infernece llm-infrastructure reward-model

106

Watchers

0

贡献者

0

Commits

0

Releases

7

Open Issues

5 天前

最近推送

原文中文

暂无 README