transformers

Access to Sulie foundation models for time-series forecasting 📈

Full finetuning of large language models without large memory requirements

Absolutely amazing SOTA Google Colab (Jupyter) Notebooks for creating/training SOTA Music AI models and for generating music with Transformer technology (Google XLNet/Transformer-XL)

ECML 2019: Graph Neural Networks for Multi-Label Classification

Scripts and Approach for Amazon ML Challenge

🥶Vilio: State-of-the-art VL models in PyTorch & PaddlePaddle

Pytorch code for ICRA'21 paper: "Hierarchical Cross-Modal Agent for Robotics Vision-and-Language Navigation"

Anonymization of legal cases (Fr) based on Flair embeddings

AI-powered text compression library for RAG systems and API calls. Reduce token usage by up to 50-60% while preserving semantic meaning with advanced compression strategies.

Finetune mistral-7b-instruct for sentence embeddings

A repository with exploration into using transformers to predict DNA ↔ transcription factor binding

Implementation of Perceiver, General Perception with Iterative Attention

Standalone Product Key Memory module in Pytorch - for augmenting Transformer models

classy is a simple-to-use library for building high-performance Machine Learning models in NLP.

Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*

reference pytorch code for named entity tagging

Blazing fast training of 🤗 Transformers on Graphcore IPUs

This is a repository of transformer-like models, including Transformer, GPT, BERT, ViT and much more to be implemented along my journey into the fascinating deep learning field.

Official source code for "Graph Neural Networks for Learning Equivariant Representations of Neural Networks". In ICLR 2024 (oral).

HanBert on 🤗 Huggingface Transformers 🤗