bigdata

🚀2.3x faster than MinIO for 4KB object payloads. RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platforms such as MinIO and Ceph.

High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios

Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.

大数据入门指南 :star:

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

Data Agent Ready Warehouse : One for Analytics, Search, AI, Python Sandbox. — rebuilt from scratch. Unified architecture on your S3.

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀

Upserts, Deletes And Incremental Processing on Big Data.

A Cloud Native Batch System (Project under CNCF)

A data integration framework

Aix-DB 基于 LangChain/LangGraph 框架，结合 MCP Skills 多智能体协作架构，实现自然语言到数据洞察的端到端转换。

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Byzer (former MLSQL): A low-code open-source programming language for data pipeline, analytics and AI.

Google, Naver multiprocess image web crawler (Selenium)

The open-source context layer for your AI. Catalog your tables, topics, queues and APIs then expose real metadata to your AI agents.