self-attention

《李宏毅深度学习教程》（李宏毅老师推荐👍，苹果书🍎），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases

The GitHub repository for the paper "Informer" accepted by AAAI 2021.

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!

Datasets, tools, and benchmarks for representation learning of code.

[CVPR 2025] Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

[MIR-2023-Survey] A continuously updated paper list for multi-modal pre-trained big models

Live-bending a foundation model’s output at neural network level.

Awesome Transformers (self-attention) in Computer Vision

1-shot image segmentation using Stable Diffusion

Contains code for the paper "Vision Transformers are Robust Learners" (AAAI 2022).

An unofficial pytorch implementation of 'Efficient Infinite Context Transformers with Infini-attention'

Flexible Python library providing building blocks (layers) for reproducible Transformers research (Tensorflow ✅, Pytorch 🔜, and Jax 🔜)