bentoml

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

A simple web application that lets you replace any part of an image with an image generated based on your description.

Serve Llama 3.3 70B (with AWQ quantization) using vLLM and deploy it on BentoCloud.

Miscellaneous codes and writings for MLOps

Generate novel text - novel finetuned from skt KoGPT2 base v2 - 한국어