transformer-architecture

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

Self-contained Machine Learning and Natural Language Processing library in Go

Build high-performance AI models with modular building blocks

A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest AI framework ever.

Simple State-of-the-Art BERT-Based Sentence Classification with Keras / TensorFlow 2. Built with HuggingFace's Transformers.

LLM을 활용한 실전 AI 애플리케이션 개발

Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper

My implementation of "Algorithm of Thoughts: Enhancing Exploration of Ideas in Large Language Models"

This repository is used to collect papers and code in the field of AI.

A numpy implementation of the Transformer model in "Attention is All You Need"

Evolutionary Neural Architecture Search on Transformers for RUL Prediction

MinimalGPT is a concise, adaptable, and streamlined code framework that encompasses the essential components necessary for the construction, training, inference, and fine-tuning of the GPT model. This framework is implemented exclusively using Keras and TensorFlow, ensuring compatibility and coherence within the broader deep learning ecosystem.