C++ 排行榜

Modern, Header-only C++ bindings for the Ollama API.

This plugin integrates Azure Speech Cognitive Services in Unreal Engine.

AlayaLite – A Fast, Flexible Vector Database for Everyone.

LLaVA server (llama.cpp).

The AI Toolkit for Modern C++. From the engineers at ClickHouse, ai-sdk-cpp is a free, open‑source library for building AI‑powered applications and agents.

The Next-Gen Database for AI—an infrastructure designed for data and AI. As the MySQL of the AI era.

Deep Learning Deployment Framework: Supports tf/torch/trt/trtllm/vllm and other NN frameworks. Support dynamic batching, and streaming modes. It is dual-language compatible with Python and C++, offering scalability, extensibility, and high performance. It helps users quickly deploy models and provide services through HTTP/RPC interfaces.

Booster - open accelerator for LLM models. Better inference and debugging for AI hackers

Explore LLM model deployment based on AXera's AI chips, It provides OpenAI‑compatible APIs and supports AX620E, AX650 and AX637 series chips.

A distributed Key-Value Storage using Raft

Kroko ASR - Speech-to-text

NekoDraw: CLIP STUDIO PAINT plugin for executing Stable Diffusion txt2img and img2img processor.

A low-latency, billion-scale, and updatable graph-based vector store on SSD.

X-Transformer: Taming Pretrained Transformers for eXtreme Multi-label Text Classification

[AAAI-2025] This repository contains MAPF-GPT, a deep learning-based model for solving MAPF problems. Trained with imitation learning on trajectories produced by LaCAM, it generates actions under partial observability without heuristics or agent communication. MAPF-GPT excels on unseen instances and outperforms learnable state-of-the-art solvers

Welcome to the Microsoft Voice Assistant samples repository! Here you will find samples to help you get started building client application for your bot or Custom Command service. You will also be able to easily deploy a working Custom Command based Voice Assistant to your own Azure subscription

A High-Performance LLM Inference Engine with vLLM-Style Continuous Batching

MSVBASE is a system that efficiently supports complex queries of both approximate similarity search and relational operators. It integrates high-dimensional vector indices into PostgreSQL, a relational database to facilitate complex approximate similarity queries.

Stable Diffusion GUI written in C++

A high performance C++ SDK for AI Agents