0xBakeer

0xBakeer/Qwen3.8-27B-4-bit-on-a-single-DGX-Spark

Serving 4-bit Qwen3.8-27B on a single DGX Spark (GB10): 75 tok/s single-stream, 246 tok/s aggregate at 8-way concurrency. NVFP4 vs MixedInt4-AutoRound vs the FP8 baseline, measured on one harness — including why the quantization advantage collapses to +0.2% by c16.

⭐ 42 ⑂ 3 Python MIT · 4 天前推送
42
Watchers
0
贡献者
0
Commits
0
Releases
1
Open Issues
4 天前
最近推送
原文 中文
暂无 README