candle

Instant, controllable, local pre-trained AI models in Rust

Rust multi‑backend OCR/VLM engine (DeepSeek‑OCR-1/2, PaddleOCR‑VL, DotsOCR) with DSQ quantization and an OpenAI‑compatible server & CLI – run locally without Python.

Low rank adaptation (LoRA) for Candle.

An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Wasm) frontend packaged with Tauri!

This repository lists some awesome public Rust projects, Videos, Blogs and Jobs.

CLI-native local AI image and video generation for people, scripts, and agents — CUDA on Linux, Metal on macOS, plus desktop, web, TUI, iPhone, REST/SSE, and MCP.

🦀 Rust powered LLM, Whisper, Embedding inference, backed by 🤗 candle from HuggingFace

A Rust-based cursor like chat with your codebase tool.

Open-source Prompt Firewall — deflect up to 95% of redundant LLM traffic before it leaves your infrastructure. Documents: https://isartor-ai.github.io/Isartor/index.html