C++ 排行榜

Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.

Code release for Local Light Field Fusion at SIGGRAPH 2019

Declarative way to run AI models in React Native on device, powered by ExecuTorch.

This repository provides code for machine learning algorithms for edge devices developed at Microsoft Research India.

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

Speech Note Linux app. Note taking, reading and translating with offline Speech to Text, Text to Speech and Machine translation.

Fast Multimodal LLM on Mobile Devices

OBS plugin for local speech recognition and captioning using AI

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

Talk to your Mac, query your docs, no cloud required. On-device voice AI + RAG

UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)

[CVPR 2024] GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splatting

Cross-platform desktop application for content-aware file organization and renaming. Supports local and remote LLMs, preview-based workflows, and fully user-controlled changes.

移动版二次元 AI 老婆聊天器

Nearest Neighbor Search with Neighborhood Graph and Tree for High-dimensional Data

Endee.io – A high-performance vector database, designed to handle up to 1B vectors on a single node, delivering significant performance gains through optimized indexing and execution. Also available in cloud https://endee.io/

Game Boy / Game Boy Color / Super Game Boy emulator, debugger and embedded MCP server for macOS, Windows, Linux, BSD and RetroArch.

Native A2UI Renderer for iOS/Android/HarmonyOS. High performance streaming Generative UI. Custom Components, Styles and more.

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

Stable Diffusion in NCNN with c++, supported txt2img and img2img