vllm-inference

1 个项目 · ⭐ 153

IBM/vLLM-Hook

Repo for vLLM Hook, an vLLM plug-in for programming internal states of models deployed on vLLM

Jupyter Notebook ⭐ 153 ⑂ 25 Apache-2.0 · 3 天前推送

ai ai-governance

3 天前