llamacpp

Query, ask and chat with a document-index via transformer models!

Open Server is an OpenAI API Compatible Server for generating text, images, embeddings, and storing them in vector databases. It also includes a chat functionality.

Agentic SDLC with local LLM's.

chap - A Python interface to chatgpt, including a terminal user interface (tui)

Hugging Face Model downloader and GGUF Converter.

GPU Service Manager for LLM workloads on Linux/NVIDIA systems.

Build LLM-enabled FastAPI applications without build configuration.

An Amazon SageMaker Container for Hugging Face Inference on Graviton and Intel CPUs

豆芽 Douya — 基于 llama.cpp 的隐私优先本地 AI 桌面助手 · 完全离线 · 多后端(CUDA/HIP/SYCL/Vulkan/OpenVINO/CPU) · GPU 加速 · 多模态 · RAG · OpenAI 兼容 API

Finetuning of Gemma-2 2B for structured output