llama3-1

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.

A holistic way of understanding how Llama and its components run in practice, with code and detailed documentation.

An Automated AI-Powered Prompt Optimization Framework

Drop in replacement for the OpenAI Assistants API

Simple RAG system powered by Milvus.