hpc

The Julia Programming Language

Making large AI models cheaper, faster and more accessible

A Cloud Native Batch System (Project under CNCF)

BLAS-like Library Instantiation Software Framework

Open MPI main development repository

UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

Hands-on GPU/HPC infrastructure operations: K8s GPU scheduling, HAMi sharing, Slurm, observability & vLLM inference. Learn it free on a laptop; validate on one cheap GPU.

Distributed Inference with vLLM