bentoml/OpenLLM

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

⭐ 12.5k ⑂ 834 Python Apache-2.0 · 5 天前推送

https://bentoml.com

fine-tuning llama llama2 llm llm-inference llm-ops llm-serving llmops mistral mlops vicuna bentoml llama3-1 llama3-2 llama3-2-vision model-inference open-source-llm openllm

12.5k

Watchers

0

贡献者

0

Commits

0

Releases

16

Open Issues

5 天前

最近推送

📦 版本动态

v0.6.30 2025-04-21

v0.6.29 2025-04-16

v0.6.28 2025-04-16

v0.6.27 2025-04-16

v0.6.26 2025-04-16

原文中文

暂无 README