datafusion

Apache DataFusion SQL Query Engine

Create full-fledged APIs for slowly moving datasets without writing a single line of code.

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

LakeSoul is an end-to-end, realtime cloud-native Lakehouse framework for fast data ingestion, concurrent updates, incremental analytics, multimodal data processing and vector search — powering next-generation BI and AI workloads.

Lakehouse native graph engine with git-style workflows

Vector search using only Parquet and DataFusion