cuda

A flexible framework of neural networks for deep learning

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.

NVIDIA cuML: GPU-Accelerated Machine Learning

Optimized primitives for collective multi-GPU communication

Fast inference engine for Transformer models

Tengine is a lite, high performance, modular inference engine for embedded device

Lightning fast C++/CUDA neural network framework

A retargetable MLIR-based machine learning compiler and runtime toolkit.

[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.

Single C file, Realtime CPU/GPU Profiler with Remote Web Viewer

Jittor is a high-performance deep learning framework based on JIT compiling and meta-operators.

how to optimize some algorithm in cuda.

Open source neural network chess engine with GPU acceleration and broad hardware support.

cuda-oxide is an experimental Rust-to-CUDA compiler that lets you write (SIMT) GPU kernels in safe(ish), idiomatic Rust. It compiles standard Rust code directly to PTX — no DSLs, no foreign language bindings, just Rust.

Agent Skills for NVIDIA products — install into Claude Code, Codex, and other coding agents to run Physical AI, robotics, simulation, CUDA, and RAG workflows end to end.

HeavyDB (formerly MapD/OmniSciDB)

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT