crates.io · PyPI
apache/datafusion
Apache DataFusion SQL Query Engine
Apache-2.0Aug 28, 2026 · metrics 2.10.0
All tags
Catalogue tag
#big-data
Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.
60 records
PyPI · crates.io
Eventual-Inc/Daft
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
Apache-2.0Aug 28, 2026 · metrics 2.10.0
crates.io · PyPI
apache/datafusion-ballista
Apache DataFusion Ballista Distributed Query Engine
Apache-2.0Sep 12, 2026 · metrics 2.10.0
crates.io
apache/datafusion-sqlparser-rs
Extensible SQL Lexer and Parser for Rust
Apache-2.0Sep 15, 2026 · metrics 2.10.0
PyPI · npm
delta-io/delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Apache-2.0Sep 15, 2026 · metrics 2.10.0
PyPI · npm · Go +1
feast-dev/feast
The Open Source Feature Store for AI/ML
Apache-2.0Aug 28, 2026 · metrics 2.10.0
PyPI
man-group/ArcticDB
ArcticDB is a high performance, serverless DataFrame database built for the Python Data Science ecosystem.
Custom licenseSep 8, 2026 · metrics 2.10.0
Maven · PyPI
prestodb/presto
The official home of the Presto distributed SQL query engine for big data
Apache-2.0Sep 16, 2026 · metrics 2.10.0
Maven
trinodb/trino
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
Apache-2.0Aug 27, 2026 · metrics 2.10.0
Go · Maven
apache/beam
Apache Beam is a unified programming model for Batch and Streaming data processing.
Apache-2.0Aug 28, 2026 · metrics 2.10.0
npm · PyPI
microsoft/SynapseML
Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark
MITSep 17, 2026 · metrics 2.10.0
Maven · PyPI
StarRocks/starrocks
The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.
Apache-2.0Sep 17, 2026 · metrics 2.10.0
Maven
apache/bookkeeper
Apache BookKeeper - a scalable, fault tolerant and low latency storage service optimized for append-only workloads
Apache-2.0Oct 19, 2026 · metrics 2.10.0
Maven · npm · PyPI
apache/paimon
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
Apache-2.0Oct 19, 2026 · metrics 2.10.0
Maven · npm · PyPI +1
apache/spark
Apache Spark - A unified analytics engine for large-scale data processing
Apache-2.0Sep 16, 2026 · metrics 2.10.0
PyPI
graphframes/graphframes
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs
Apache-2.0Sep 17, 2026 · metrics 2.10.0
crates.io
quickwit-oss/quickwit
Cloud-native OSS search engine for observability
Apache-2.0Sep 18, 2026 · metrics 2.10.0
Maven · RubyGems
vespa-engine/vespa
The AI search platform
Apache-2.0Oct 3, 2026 · metrics 2.10.0
PyPI · Go · Maven +1
apache/tsfile
Apache TsFile
Apache-2.0Sep 14, 2026 · metrics 2.10.0
Maven
apache/hugegraph
A graph database that supports more than 100+ billion data, high performance and scalability (Include OLTP Engine & REST-API & Backends)
Apache-2.0Sep 19, 2026 · metrics 2.10.0
crates.io · Go · PyPI
apache/paimon-rust
Apache Paimon Rust The rust implementation of Apache Paimon.
Apache-2.0Sep 19, 2026 · metrics 2.10.0
PyPI
cython/cython
The most widely used Python to C compiler
Apache-2.0Aug 28, 2026 · metrics 2.10.0
Maven
alibaba/fastjson2
🚄 FASTJSON2 is a Java JSON library with excellent performance.
Apache-2.0Aug 28, 2026 · metrics 2.10.0
Maven · PyPI
apache/flink
Apache Flink
Apache-2.0Sep 16, 2026 · metrics 2.10.0
crates.io
reductstore/reductstore
High-performance, time-indexed object storage for robotics and industrial IoT
Apache-2.0Oct 21, 2026 · metrics 2.10.0
NuGet
G-Research/ParquetSharp
ParquetSharp is a .NET library for reading and writing Apache Parquet files.
Apache-2.0Sep 7, 2026 · metrics 2.10.0
Maven · RubyGems
apache/calcite
Apache Calcite
Apache-2.0Oct 20, 2026 · metrics 2.10.0
PyPI
delta-io/delta-sharing
An open protocol for secure data sharing
Apache-2.0Oct 20, 2026 · metrics 2.10.0
Maven
hazelcast/hazelcast
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
Custom licenseOct 20, 2026 · metrics 2.10.0
npm
visgl/loaders.gl
Loaders for big data visualization. Website:
Custom licenseSep 20, 2026 · metrics 2.10.0