lordmathis/llamactl

Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.

⭐ 145 ⑂ 29 Go MIT · 3 天前推送

http://llamactl.org/

llama-cpp llamacpp llm llm-inference mlx openai-api self-hosted vllm llm-router localllama localllm llama-server mlx-lm

145

Watchers

0

贡献者

0

Commits

0

Releases

5

Open Issues

3 天前

最近推送

原文中文

暂无 README