cuda

Minkowski Engine is an auto-diff neural network library for high-dimensional sparse tensors

CV-CUDA™ is an open-source, GPU accelerated library for cloud-scale image processing and computer vision.

computer vision projects | 计算机视觉相关好玩的AI项目（Python、C++、embedded system）

Pytorch domain library for recommendation systems

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

🤖 A Python library for learning and evaluating knowledge graph embeddings

A deep learning package for many-body potential energy representation and molecular dynamics

OneDiff: An out-of-the-box acceleration library for diffusion models.

Deep learning in Rust, with shape checked tensors and neural networks

Large-scale LLM inference engine

PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.

🚀🚀🚀 A collection of some awesome public YOLO object detection series projects and the related object detection datasets.

Ultrafast serverless GPU inference, sandboxes, and background jobs

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

🔥 Real-time NVIDIA GPU dashboard

UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)

Open Source Continuous Inference Benchmark Research Platform — Kimi K3 2.8T, MiniMax M3, DeepSeekv4, GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 & soon™ TPUv6e/v7/Trainium2/3 | 开源持续推理基准研究平台 — Kimi K2.7-Code、MiniMax M3、DeepSeekv4、GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72，即将推出™ TPUv6e/v7/Trainium2/3

Self-host the powerful Chatterbox TTS model. This server offers a user-friendly Web UI, flexible API endpoints (incl. OpenAI compatible), predefined voices, voice cloning, and large audiobook-scale text processing. Runs accelerated on NVIDIA (CUDA), AMD (ROCm), and CPU.

https://wavespeed.ai/ Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM