ray

Learn how to develop, deploy and iterate on production-grade ML applications.

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

CSGHub is a brand-new open-source platform for managing LLMs, developed by the OpenCSG team. It offers both open-source and on-premise/SaaS solutions, with features comparable to Hugging Face. Gain full control over the lifecycle of LLMs, datasets, and agents, with Python SDK compatibility with Hugging Face. Join us! ⭐️

Learn how to design, develop, deploy and iterate on production-grade ML applications.

LakeSoul is an end-to-end, realtime cloud-native Lakehouse framework for fast data ingestion, concurrent updates, incremental analytics, multimodal data processing and vector search — powering next-generation BI and AI workloads.

Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.

A toolkit to run Ray applications on Kubernetes

A comprehensive guide to building RAG-based LLM applications for production.

GPU environment and cluster management with LLM support

Crater is a cloud-native AI training & inference platform.

This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.

🏭 Mega Scale Multimodal DataPipeline for SOTA Foundation Models

syftr is an agent optimizer that helps you find the best agentic workflows for your budget.

Examples on how to use LangChain and Ray

Unified storage framework for the entire machine learning lifecycle

A Web Crawler based on LLMs implemented with Ray and Huggingface. The embeddings are saved into a vector database for fast clustering and retrieval. Use it for your RAG.

✈️ Kubernetes-native platform for deploying and managing AI inference across multiple providers

llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deployment, such as UI, RESTful API, auto-scaling, computing resource management, monitoring, and more.