EfficientMoE/MoE-Infinity

PyTorch library for cost-effective, fast and easy serving of MoE models.

⭐ 346 ⑂ 34 Python Apache-2.0 · 1 天前推送

huggingface inference-engine large-language-models llm-inference mixture-of-experts pytorch

346

Watchers

0

贡献者

0

Commits

0

Releases

16

Open Issues

1 天前

最近推送

原文中文

暂无 README