C++ 排行榜

EFFICIENT AND OPTIMIZED TOKENIZER ENGINE FOR LLM INFERENCE SERVING

Accelerate your Stable Diffusion inference with the library's universal C/C++ framework design, powered by ONNXRuntime & across platforms.

No code AI agents

QodeAssist is an AI-powered coding assistant plugin for Qt Creator

Vector search engine inside Milvus, integrating FAISS, HNSW, DiskANN.

Fast, SQL powered, in-process vector search for any language with an SQLite driver

ChatGPT Bot in CLI with long term memory support using Embeddings.

audio.cpp with a full-task WebUI - pure C++ audio-model inference engine powered by ggml. TTS, ASR/STT, VAD, voice conversion, speaker diarization, music generation. No Python dependency.

OpenAI C++ is a community-maintained library for the Open AI API

CPU inference for the DeepSeek family of large language models in C++

a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features (GGUF, RadixAttention, Cache-aware scheduling, ...)

ML software (llama.cpp, ComfyUI, vLLM) builds for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60

Run generative AI models in sophgo BM1684X/BM1688

Ultra fast and portable Parakeet implementation for on-device inference in C++ using Axiom with MPS+Unified Memory

Cross-platform, real-time, offline speech recognition plugin for Unreal Engine. Based on Whisper OpenAI technology, whisper.cpp.

A simple Windows / Xbox app for generating AI images with Stable Diffusion.

llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2

An official lightweight library for the RaBitQ algorithm and its applications in vector search.

FreeSWITCH module to stream audio to websocket and receive response

CleanStream is an OBS plugin that uses AI to clean live audio streams from unwanted words and utterances