self-hosted
520 个项目 · ⭐ 3300.4kKubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
Deploy intelligence. Open-source infrastructure for AI agents in production.
Fully-featured, beautiful web interface for vLLM - built with NextJS.
The free open source offline writing assistant assist with grammar, rewriting & tone entirely on your machine.
AI assistant in Telegram that remembers everything and helps you run your life. Self-hosted in one command.
A front-end UI for ComfyUI made for beginner level users.
Self-hosted AI agent platform built on OpenClaw. Enterprise-ready, offline-capable, open source. 🦞
Free, self-hostable, AI-native design software for creating graphics, social posts, and more, with no paywalls or watermarks.
🦙 Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline capable and easy to setup.
共 520 条 · 第 18 / 26 页