etl-framework

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Logstash - transport and process your logs, events, or other data

Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

Structured Data Extractor for AI Agents. Search your documents or the web for specific data and get it back in JSON or Markdown in a single tool call.

Build super simple end-to-end data & ETL pipelines for your vector databases and Generative AI applications