0xBakeer

0xBakeer/Qwen3.8-27B-FP8-on-a-single-DGX-Spark

Serving Qwen3.8-27B-FP8 on a single DGX Spark (GB10): 7.88 to 58.5 tok/s single-stream from decode strategy alone, weights untouched. Speculative decoding and prefix caching benchmarked, plus DFlash 2 — the only Qwen3.8-27B build that can serve it under vLLM.

⭐ 43 ⑂ 5 Python MIT · 4 天前推送
43
Watchers
0
贡献者
0
Commits
0
Releases
0
Open Issues
4 天前
最近推送
原文 中文
暂无 README