etl-pipeline

Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.

Make stream processing easier! Easy-to-use streaming application development framework and operation platform.

Build data pipelines, the easy way 🛠️

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

The open document intelligence platform for builders and hackers - DMS for the agentic world

Integrate LLM in any pipeline - fit/predict pattern, JSON driven flows, and built in concurency support.

The Supabase of AI era. A modular, open-source backend for building AI-native software — designed for knowledge, not static data.

Build super simple end-to-end data & ETL pipelines for your vector databases and Generative AI applications

Reference Java & Spring implementation of the Open Ingestion Standard (OIS). It provides a secure, decoupled, and vendor-neutral enterprise data integration platform leveraging modern Java 25 features, Spring Boot, Spring AI and vector search infrastructure to orchestrate data flows

📊 ETL pipeline for YouTube competitor analytics. Orchestrated with Airflow, Docker, and AWS. Features sentiment analysis and a Power BI dashboard.