pipelines

A high-performance observability data pipeline.

Turns Data and AI algorithms into production-ready web applications in no time.

Workflow Engine for Kubernetes

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Concourse is a container-based automation system written in Go. It's mostly used for CI/CD.

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

Build data pipelines, the easy way 🛠️

AI Infra / AI Orchestration / AI Control Plane

The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning

Elyra extends JupyterLab with an AI centric approach.

A Julia machine learning framework

Platform for Situated Intelligence

Pluggable metadata management framework for versioned incremental multimodal data/ML pipelines.

This repository provides resources and guidelines to facilitate the integration of Open-WebUI and Langfuse, enabling seamless monitoring and management of AI model usage statistics.

This repository is now archived. Further development has been moved to https://github.com/medkit-lib/medkit.

Elixir RAG library with multi-LLM routing (Gemini, Claude, OpenAI, Ollama), GraphRAG, knowledge graphs, modular retrievers/rerankers, composable pipelines, pgvector integration, advanced chunking, and tool-using agents. Fork of bitcrowd/rag.