KevinLee1110/dynamic-batching
The official repo for the paper "Optimizing LLM Inference Throughput via Memory-aware and SLA-constrained Dynamic Batching"
⭐ 17
⑂ 2
Apache-2.0
· 2025-03-17推送
17
Watchers
0
贡献者
0
Commits
0
Releases
0
Open Issues
2025-03-17
最近推送
原文
中文
暂无 README