softmax1/Flash-Attention-Softmax-N

CUDA and Triton implementations of Flash Attention with SoftmaxN.

⭐ 75 ⑂ 5 Python GPL-3.0 · 2024-05-27推送

artificial-intelligence attention-mechanism deep-learning pytorch transformers

75

Watchers

0

贡献者

0

Commits

0

Releases

2

Open Issues

2024-05-27

最近推送

原文中文

暂无 README