transformers

Repository for the companion Colab notebook of the Domain-Specific Small Language Models book.

Relational Graph Transformer

Implementation of a GPT-4o like Multimodal from Scratch using Python

🤖 language modeling sft demos

Amortized Inference for Causal Structure Learning, NeurIPS 2022

Tensorflow, Pytorch, Huggingface Transformer, Fastai, etc. tutorial Colab Notebooks.

[ICCV 2023] When Epipolar Constraint Meets Non-local Operators in Multi-View Stereo

Transformer-powered hashtag segmentation with beam search, RRF ensembles, and agent-ready MCP workflows. A scalable alternative to heuristic splitters and massive LLMs.

Solutions for CS224n (2022)

🌹 Rose: Range-Of-Slice Equilibration PyTorch optimizer. Stateless optimization through range-normalized gradient updates.

Zero-Shot Text-to-Image Generation VQGAN+CLIP Dockerized

This project provides implementations with Keras/Tensorflow of some deep learning algorithms for Multivariate Time Series Forecasting: Transformers, Recurrent neural networks (LSTM and GRU), Convolutional neural networks, Multi-layer perceptron

Implementation of Marge, Pre-training via Paraphrasing, in Pytorch

PyTorch-IE: State-of-the-art Information Extraction in PyTorch

This is the official implementation of the work presented at CVPR 2024, titled Multiple View Geometry Transformers for 3D Human Pose Estimation (MVGFormer).

Example of transformers.js on React Native

Official repository of cross-modal transformer for interpretable automatic sleep stage classification. https://arxiv.org/abs/2208.06991

CUDA and Triton implementations of Flash Attention with SoftmaxN.

A Hybrid CNN-Transformer Architecture for Precise Medical Image Segmentation

[IEEE TCSVT 2023] Official implementation of DATFuse: Infrared and Visible Image Fusion via Dual Attention Transformer