geeks-accelerator/ollama-herd

Local AI load balancer for Ollama and MLX fleets. Auto-discovery, smart routing, OpenAI-compatible API, zero config. Perfect for Mac Minis & Studios.

⭐ 19 ⑂ 1 Python MIT · 4 天前推送

https://ollamaherd.com

ai-gateway ai-infrastructure apple-silicon edge-ai embeddings fastapi llm load-balancer local-llm multimodal ollama openai-compatible python self-hosted-ai ai-router zero-config fleet-management inference-router ollama-cluster

19

Watchers

0

贡献者

0

Commits

0

Releases

1

Open Issues

4 天前

最近推送

原文中文

暂无 README