OpenSparseLLMs/LLaMA-MoE-v2

🚀 LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training

⭐ 93 ⑂ 13 Python Apache-2.0 · 2024-12-03推送

https://arxiv.org/abs/2411.15708

attention fine-tuning instruction-tuning llama llama3 mixture-of-experts moe sft sparsity

93

Watchers

0

贡献者

0

Commits

0

Releases

3

Open Issues

2024-12-03

最近推送

原文中文

暂无 README