rust

A CLI in Rust to generate synthetic data for MLX friendly training

LLM-free, layout-aware PDF chunking for RAG pipelines. Preserves document structure via regex and font heuristics. Written in pure Rust.

Persistent cognitive memory for AI agents — drop-in MCP server for Claude Code, Cursor, Windsurf. Temporal decay, contradiction detection, knowledge graph, autonomous consolidation. Backed by the YantrikDB Rust engine. Install: pip install yantrikdb-mcp.

Self-hosted AI knowledge base with hybrid semantic search (pgvector + FTS + RRF), MCP server, multi-provider LLM inference (Ollama, OpenAI, OpenRouter, llama.cpp), multimodal ingestion (vision, audio transcription, speaker diarization), and knowledge graph. Rust + PostgreSQL.

One Mac process. Many models. Real speed. Multi-model LLM serving with prefix reuse, MTP acceleration, and OpenAI APIs — built for Apple Silicon, measured against mlx-lm and llama.cpp.

Real-time meeting & audio transcription for Windows (system audio + mic) — live captions via Deepgram, AI summaries via OpenAI. Tauri 2 + React.

Privacy‑first, real‑time speech‑to‑text dictation. 100% local inference in Rust; hotkey to dictate anywhere (macOS, Linux, Windows).

Sumi — Free, open-source voice dictation for macOS. Local-first Whisper + LLM polish, with built-in free cloud APIs.

a rust crate for easily implementing faster-whisper stt into your rust programs.

The official Rust client for the Pinecone vector database

Elixir in memory VectorDB build with Rust using rustler! It's small, fast, efficient, simple!

The free, open-source meeting-notes app for your Mac — offline transcription and AI notes, free in the cloud or 100% on-device.

Download Huggingface repositories without the need to install dependencies

Embedded database for agentic memory — relational, graph, and vector under unified MVCC transactions

Speech to text bot for Discord using Mozilla's DeepSpeech

Open-source Prompt Firewall — deflect up to 95% of redundant LLM traffic before it leaves your infrastructure. Documents: https://isartor-ai.github.io/Isartor/index.html

Training-free ordinal & sign quantization for compressed nearest-neighbour retrieval over high-dimensional embeddings. Pure Rust, zero system dependencies.

A better version of KU's course catalogue

[Unofficial] Simple .NET wrapper of HuggingFace Tokenizers library

🤖 AI-powered CLI for file reorganization. Runs fully locally — no data leaves your machine.