llms

Laozy is a self-hosted web application that helps you build and deploy LLM-based dialogue robots. The robot you built can connect to instant messaging platforms like WeChat, Telegram, etc. You can also integrate it into your app with REST APIs.

ZON → 35-70% cheaper LLM prompts than JSON/TOON. Zero overhead.

A unified client for AI providers with built-in agent support.

Python bindings for llama.cpp

Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"

This application uses LLMs like DeepSeek, GPT-5, Claude, Gemini or Llama, Mixtral (locally) in order to generate text based on the user input. The user input is used to retrieve relevant information from the database and then the retrieved information is used to generate the text. This approach combines power of LLMs and access to source documen

Polyglot is a fast, elegant, and free translation tool using AI.

The repository explores various RAG techniques, including implementation guides, use cases, and best practices. Each article is designed to help researchers, developers, and enthusiasts understand and implement RAG systems efficiently.

Medical RAG QA App using Meditron 7B LLM, Qdrant Vector Database, and PubMedBERT Embedding Model.

A tool for benchmarking LLMs on Modal

Make AI Free Again - Shard is a GUI for Ollama LLM's. Powered by Next.js.

Automated Course Content Generator (ACCG) is an AI-powered Streamlit app for SMEs, Content Creators, and Educators. Input Course Name, Audience Level, Difficulty, and Credits to get a dynamic course outline, full course content, and quizzes. Download everything as a PDF, PPT and customize as needed!

An AI-powered assistant that simplifies DevOps tasks with intelligent prompts, reducing repetitive work and enhancing productivity

DuckDB Community Extension to prompt LLMs from SQL

A data-centric AI package for ML/AI. Get the best high-quality data for the best results. Discord: https://discord.gg/t6ADqBKrdZ

Mark web pages for use with vision-language models

OpenChat's goal is to become the most feature rich AI user interface on the open source market.

AI tool that generates an Audio short story based on the context of an uploaded image by prompting a GenAI LLM model, Hugging Face AI models together with OpenAI & LangChain

Structured Output Is All You Need!

Go SDK for interacting with the MCP Toolbox for Databases.