high-performance-computing

Build, Manage and Deploy AI/ML Systems

Training and serving large-scale neural networks with auto parallelization.

cuda-oxide is an experimental Rust-to-CUDA compiler that lets you write (SIMT) GPU kernels in safe(ish), idiomatic Rust. It compiles standard Rust code directly to PTX — no DSLs, no foreign language bindings, just Rust.

A list of awesome compiler projects and papers for tensor computation and deep learning.

BLAS-like Library Instantiation Software Framework

FlashAttention (Metal Port)

A high-performance, universal serving framework for any-to-any models.

Open source skill library for AI coding agents to write, optimize, and debug high performance compute kernels across CUDA, Triton, and quantized workloads.

hummingbird is a lightweight, zero dependency runtime for massive open source Mixture of Experts (MoE) language models. It unifies SSD, RAM, and VRAM into a single intelligent memory hierarchy, enabling inference of models like GPT-OSS 120B, GLM, DeepSeek, Qwen, and more on consumer hardware