C++ 排行榜

A high-performance RDMA distributed file system for fast LLM Inference and GPU Training.

Free speech to text module for ESP32 with WakeWord & NLP. No API Key or Credit Card is needed.

Your private AI companion that lives on your wrist. Complete local AI assistant with emotional intelligence.

A python library for efficient KNN search within metric spaces using multiple distance functions.

🔥 Alternative to Ollama — multi-model serving with sub-ms model switching · CPU-only 20B inference for Edge AI · llama.cpp + stablediffusion.cpp

C++企业微信消息推送服务器

Cloud AI live transcription and translation service plugin

Qt C++ library for working with AI/LLM Providers and MCP

LoRA Manager for Civit Models

Embedded on-device vector database for AI agent memory and local RAG — disk-based HNSW in an LSM-tree, C++/Python, optimized for low memory footprint

Offline neural translation across English, Spanish, French & Italian — type or speak, read or hear it. Built on ggml.

[SIGMOD 2026] DARTH: Declarative Recall Through Early Termination for Approximate Nearest Neighbor Search.

Nemotron ASR rewrite to GGML

🧠 Predictable, embedded multimodal vector database & offline RAG engine for Edge AI (ARM64 / Zero-OOM). Built in C++20.

[ECCV 2022] Multimodal Transformer with Variable-length Memory for Vision-and-Language Navigation

🎙️ Uzbek system-wide speech-to-text dictation for macOS (rubaiSTT + whisper.cpp, Metal, offline). Press Ctrl+Opt+D anywhere.

VTuber application which only requires your voice and microphone, no need for a webcam or other tracking nonsense.

Continuous Dictation Speech Recognition and Speech Synthesis in Win32

A hackable vector db built on top of uSearch+rocksdb, for you to break it down, dissect and scale on demand

Whisper in TensorRT-LLM