IBM/vLLM-Hook

Repo for vLLM Hook, an vLLM plug-in for programming internal states of models deployed on vLLM

⭐ 153 ⑂ 25 Jupyter Notebook Apache-2.0 · 3 天前推送

https://arxiv.org/abs/2603.06588

ai ai-governance ai-safety ai-security inference-engine vllm model-inference ai-inference trustworthy-ai vllm-inference vllm-plugins vllm-serve

153

Watchers

0

贡献者

0

Commits

0

Releases

2

Open Issues

3 天前

最近推送

原文中文

暂无 README