arrow

Extremely fast Query Engine for DataFrames, written in Rust

Apache DataFusion SQL Query Engine

The perfect companion for your Kotlin journey - Inspired by functional, data-oriented and concurrent programming

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

Official Rust implementation of Apache Arrow

Create full-fledged APIs for slowly moving datasets without writing a single line of code.

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

LakeSoul is an end-to-end, realtime cloud-native Lakehouse framework for fast data ingestion, concurrent updates, incremental analytics, multimodal data processing and vector search — powering next-generation BI and AI workloads.

An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.

BlazingSQL is a lightweight, GPU accelerated, SQL engine for Python. Built on RAPIDS cuDF.

Apache Arrow Flight clustered vector engine for high throughput Agent memory sharing