flax

Python code for "Probabilistic Machine learning" book by Kevin Murphy

Repository of Jupyter notebook tutorials for teaching the Deep Learning Course at the University of Amsterdam (MSc AI), Fall 2023

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

Long Range Arena for Benchmarking Efficient Transformers

Run Effective Large Batch Contrastive Learning Beyond GPU/TPU Memory Constraint

Train very large language models in Jax.

Unofficial JAX implementations of deep learning research papers

A multi-modal CLIP model trained on the medical dataset ROCO

Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation

This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.

SciFive: a text-text transformer model for biomedical literature

Chef Transformer 🍲 .

Train GEMMA on TPU/GPU! (Codebase for training Gemma-Ko Series)

Serialize JAX, Flax, Haiku, or Objax model params with 🤗`safetensors`

🤗 HuggingFace Diffusers Flax TPU and PyTorch GPU for Colab

A simple and intuitive library for diffusion models using Flax and Jax. Includes detailed notebooks on DDPM, DDIM, and EDM with simplified mathematical explanations. Made as part of my journey for learning and experimenting with generative AI.

RoBERTa Marathi Language model trained from scratch during huggingface 🤗 x flax community week

Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.