llamacpp

DocMind AI is a powerful, open-source Streamlit application leveraging LlamaIndex, LangGraph, and local Large Language Models (LLMs) via Ollama, LMStudio, llama.cpp, or vLLM for advanced document analysis. Analyze, summarize, and extract insights from a wide array of file formats, securely and privately, all offline.

Never give AI companies your secrets! A local LLM-based privacy filter for LLM users. Seamless integration with your existing AI tools as a Python library / OpenAI SDK replacement / API Gatetway / Web Server.

🪶 Lightweight OpenAI drop-in replacement for Kubernetes

Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.

Synthetic Autonomic Mind - An AI assistant for everyone.

A simple NPM interface for seamlessly interacting with 36 Large Language Model (LLM) providers, including OpenAI, Anthropic, Google Gemini, Cohere, Hugging Face Inference, NVIDIA AI, Mistral AI, AI21 Studio, LLaMA.CPP, and Ollama, and hundreds of models.

Privacy-first AI roleplay & BYOK (Bring Your Own Key) & roleplaying, companion and storytelling app with long-term memory, custom characters, and 20+ providers. Android, Windows, macOS, Linux. Supports 20+ LLM Providers.

VT.ai - multimodal AI chat app with dynamic conversation routing

LocalChat is a ChatGPT-like chat that runs on your computer

InferrLM - On-device AI for iOS & Android

(Windows/Linux/MacOS) Local WebUI with neural network models (Text, Image, Video, 3D, Audio) on python (Gradio interface). Translated on 3 languages

Open source, local first AI medical agent for desktop and web.

📚 Local PDF-Integrated Chat Bot: Secure Conversations and Document Assistance with LLM-Powered Privacy

Gradio based tool to run opensource LLM models directly from Huggingface

Friendly interface to chat with an Ollama instance.

An AI-app that allows you to upload a PDF and ask questions about it. It uses StableVicuna 13B and runs locally.

The AI agent script CLI for Programmable Prompt Engine.

Completion After Prompt Probability. Make your LLM make a choice

Inference Hub for AI at Scale

Retrieval Augmented Generation API using Open LLMs and FastAPI