pipeline

Event Driven Orchestration & Scheduling Platform for Mission Critical Applications

Declarative Continuous Deployment for Kubernetes

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

☁️ Build multimodal AI applications with cloud-native stack

Turns Data and AI algorithms into production-ready web applications in no time.

Always know what to expect from your data.

PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement

httpx is a fast and multi-purpose HTTP toolkit that allows running multiple probes using the retryablehttp library.

A cloud-native Pipeline resource.

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Build powerful pipelines in any programming language.

AutoRAG: Now your agent can find anything in your computer. It gets smarter if you are using it frequently.

A guideline for building practical production-level deep learning systems to be deployed in real world applications.

Machine Learning Pipelines for Kubeflow

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

Kubernetes-native platform to run massively parallel data/streaming jobs

QuantMind is an agent-native knowledge extraction and retrieval framework for quantitative finance.

Machine learning platform for Web developers