knotgrass/attention

several types of attention modules written in PyTorch for learning purposes

⭐ 55 ⑂ 12 Python · 2026-01-02推送

attention attention-mechanism pytorch transformer transformers grouped-query-attention multi-head-attention multi-query-attention scale-dot-product-attention softmax-layer

55

Watchers

0

贡献者

0

Commits

0

Releases

0

Open Issues

2026-01-02

最近推送

原文中文

暂无 README