attention

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

Keras beit,caformer,CMT,CoAtNet,convnext,davit,dino,efficientdet,edgenext,efficientformer,efficientnet,eva,fasternet,fastervit,fastvit,flexivit,gcvit,ghostnet,gpvit,hornet,hiera,iformer,inceptionnext,lcnet,levit,maxvit,mobilevit,moganet,nat,nfnets,pvt,swin,tinynet,tinyvit,uniformer,volo,vanillanet,yolor,yolov7,yolov8,yolox,gpt2,llama2, alias kecam

https://wavespeed.ai/ Context parallel attention that accelerates DiT model inference with dynamic caching

多模态情感分析——基于BERT+ResNet的多种融合方法

An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning", an all-new multi modal AI that uses just a decoder to generate both text and images

Probing the representations of Vision Transformers.

Implementation of Spear-TTS - multi-speaker text-to-speech attention network, in Pytorch

Code and written solutions of the assignments of the Stanford CS224N: Natural Language Processing with Deep Learning course from winter 2022/2023

Source code for GNN-LSPE (Graph Neural Networks with Learnable Structural and Positional Representations), ICLR 2022

[ECCV2024 Oral] Official implementation of the paper "Relation DETR: Exploring Explicit Position Relation Prior for Object Detection"

A Deep-Learning-Based Persian Speech Recognition System

[CVPR'22 Best Paper Finalist] Official PyTorch implementation of the method presented in "Learning Multi-View Aggregation In the Wild for Large-Scale 3D Semantic Segmentation"

[CVPR 2024] Official implementation of the paper "Salience DETR: Enhancing Detection Transformer with Hierarchical Salience Filtering Refinement"

Implementation of Danijar's latest iteration for his Dreamer line of work

pretrained BERT model for cyber security text, learned CyberSecurity Knowledge

Holds code for our CVPR'23 tutorial: All Things ViTs: Understanding and Interpreting Attention in Vision.

Deep Learning based Automatic Speech Recognition with attention for the Nvidia Jetson.

Official Implementation of ResViT: Residual Vision Transformers for Multi-modal Medical Image Synthesis

CVPR 2021: "Generating Diverse Structure for Image Inpainting With Hierarchical VQ-VAE"

The "tl;dr" on a few notable transformer papers (pre-2022).