SergiioB

SergiioB/intel-arc-pro-b70-inference-cookbook

Open recipes, engine patches, and benchmark harnesses for LLM inference on Intel Arc Pro B60/B70 (Battlemage, Xe2). MoE 35B at 160 t/s decode / 7.5K t/s prefill single-stream, 27B at 50~ t/s decode / 1.7K t/s prefill single stream. vLLM XPU MTP unlocked. Muse Glimmer recipe added!!

⭐ 65 ⑂ 3 Python MIT · 1 天前推送
65
Watchers
0
贡献者
0
Commits
0
Releases
0
Open Issues
1 天前
最近推送
原文 中文
暂无 README