latenceainew/vllm-factory

Production inference for encoder models - ColBERT, GLiNER, ColPali, embeddings etc. - as vLLM plugins for online and in-process deployment

⭐ 77 ⑂ 8 Python Apache-2.0 · 2026-07-06推送

ai-infrastructure colbert colpali embeddings encoder inference multimodal-rag rag retrieval serving vllm ner gliner vllm-plugins ml-infra-deployments triton-kernels

77

Watchers

0

贡献者

0

Commits

0

Releases

2

Open Issues

2026-07-06

最近推送

原文中文

暂无 README