Rust 排行榜

Modular Rust transformer/LLM library using Candle

Embedded-first vector database that grows into a self-hosted service and lightweight cluster.

Pixel-native visual RAG ported to Rust on the ruvector ANN substrate (HNSW + IVF-Flat) — screenshot/document retrieval over visual embeddings, a Rust port of PixelRAG, with a metaharness benchmark CLI: npx rupixel

Ask Ollama about your local text files

Run, quantize, and fine-tune LLMs on Apple Silicon. Pure Rust, no Python, no CUDA, no ONNX

To implement LLM as a services.

LLM-powered code auditor for GitHub repos.

Vemcache is an in-memory vector database.

CLI-native local AI image and video generation for people, scripts, and agents — CUDA on Linux, Metal on macOS, plus desktop, web, TUI, iPhone, REST/SSE, and MCP.

Unofficial Rust CLI/library and local Whisper-compatible REST shim for Codex Desktop ASR using local ChatGPT auth

Run 70B+ LLMs on Apple Silicon by using SSD as extended memory — intelligent layer streaming and caching for Mac

Scalable Embedded Vector Index for Go and Rust

Free offline noise suppression, transcription & meeting recording -- runs locally, no cloud

Local, private push-to-talk dictation for macOS. Hold a key, speak, release — your words appear in any text field. Runs entirely on-device via whisper.cpp with bundled multilingual model. No cloud, no telemetry, no paywall.

A crate using DeepSpeech bindings to convert mic audio from speech to text

SitRep — free, open-source, offline voice dictation. Press a shortcut, speak, and your words appear in any text field. Powered by Whisper/Parakeet, built with Tauri.

A multi-tenant vector database focused on extreme RAM efficiency. Lightweight, scalable, and optimized for high-density deployments.

🦀 Rust powered LLM, Whisper, Embedding inference, backed by 🤗 candle from HuggingFace

⚡️Lightning fast in-memory VectorDB written in rust🦀

A unified SDK for IronCore encryption operations including vector encryption for AI data