aivrar

aivrar/vllm-windows-build

Native Windows vLLM 0.27.1 wheels: Python 3.13, PyTorch 2.13 + CUDA 13.0, SM 7.5-12.0 for RTX 20/30/40/50, OpenAI-compatible serving, FlashAttention/Rust, 10 KV formats, Multi-TurboQuant, and experimental CPU/RAM/NVMe prompt-KV offload - no WSL or Docker.

⭐ 41 ⑂ 5 Python MIT · 1 天前推送
41
Watchers
0
贡献者
0
Commits
0
Releases
2
Open Issues
1 天前
最近推送
原文 中文
暂无 README