crates.io · PyPI
apache/datafusion
Apache DataFusion SQL Query Engine
Apache-2.0Aug 28, 2026 · metrics 2.10.0
All tags
Catalogue tag
#big-data
Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.
39 records
PyPI · crates.io
Eventual-Inc/Daft
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
Apache-2.0Aug 28, 2026 · metrics 2.10.0
PyPI · npm
delta-io/delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Apache-2.0Aug 2, 2026 · metrics 2.10.0
PyPI · npm · Go +1
feast-dev/feast
The Open Source Feature Store for AI/ML
Apache-2.0Aug 28, 2026 · metrics 2.10.0
Maven
trinodb/trino
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
Apache-2.0Aug 27, 2026 · metrics 2.10.0
Go · Maven
apache/beam
Apache Beam is a unified programming model for Batch and Streaming data processing.
Apache-2.0Aug 28, 2026 · metrics 2.10.0
Maven · PyPI
prestodb/presto
The official home of the Presto distributed SQL query engine for big data
Apache-2.0Aug 5, 2026 · metrics 2.10.0
Maven · RubyGems
vespa-engine/vespa
The AI search platform
Apache-2.0Aug 28, 2026 · metrics 2.10.0
Maven · PyPI
StarRocks/starrocks
The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.
Apache-2.0Aug 12, 2026 · metrics 2.10.0
PyPI · Maven · npm
apache/tsfile
Apache TsFile
Apache-2.0Jul 27, 2026 · metrics 2.10.0
PyPI
graphframes/graphframes
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs
Apache-2.0Aug 13, 2026 · metrics 2.10.0
PyPI
man-group/arcticdb
ArcticDB is a high performance, serverless DataFrame database built for the Python Data Science ecosystem.
Custom licenseJul 16, 2026 · metrics 2.10.0
Maven · npm · PyPI +1
apache/spark
Apache Spark - A unified analytics engine for large-scale data processing
Apache-2.0Aug 5, 2026 · metrics 2.10.0
npm · PyPI
microsoft/SynapseML
Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark
MITAug 12, 2026 · metrics 2.10.0
crates.io · PyPI
apache/datafusion-ballista
Apache DataFusion Ballista Distributed Query Engine
Apache-2.0Jul 21, 2026 · metrics 2.10.0
PyPI
cython/cython
The most widely used Python to C compiler
Apache-2.0Aug 28, 2026 · metrics 2.10.0
Maven
alibaba/fastjson2
🚄 FASTJSON2 is a Java JSON library with excellent performance.
Apache-2.0Aug 28, 2026 · metrics 2.10.0
PyPI
delta-io/delta-sharing
An open protocol for secure data sharing
Apache-2.0Aug 21, 2026 · metrics 2.10.0
Maven
hazelcast/hazelcast
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
Custom licenseAug 22, 2026 · metrics 2.10.0
crates.io
reductstore/reductstore
High-performance, time-indexed object storage for robotics and industrial IoT
Apache-2.0Aug 30, 2026 · metrics 2.10.0
Maven · PyPI
apache/flink
Apache Flink
Apache-2.0Aug 5, 2026 · metrics 2.10.0
Maven · RubyGems
apache/orc
Apache ORC - the smallest, fastest columnar storage for Hadoop workloads
Apache-2.0Jul 22, 2026 · metrics 2.10.0
npm
catboost/catboost
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
Apache-2.0Aug 12, 2026 · metrics 2.10.0
Maven · RubyGems
apache/calcite
Apache Calcite
Apache-2.0Aug 21, 2026 · metrics 2.10.0
Go
ytsaurus/ytsaurus-k8s-operator
Kubernetes operator for YTsaurus.
Custom licenseAug 9, 2026 · metrics 2.10.0
npm
hazelcast/hazelcast-nodejs-client
Hazelcast Node.js Client
Apache-2.0Aug 28, 2026 · metrics 2.10.0
PyPI · Maven · npm +1
h2oai/h2o-3
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
Apache-2.0Aug 24, 2026 · metrics 2.10.0
PyPI
SuperCowPowers/workbench
Workbench: An easy to use Python API for creating and deploying AWS SageMaker Models
MITJul 18, 2026 · metrics 2.10.0
PyPI · crates.io
mabel-dev/opteryx
🦖 A SQL-on-everything Query Engine you can execute over multiple databases and file formats. Query your data, where it lives.
Apache-2.0Jul 18, 2026 · metrics 2.10.0
crates.io · Maven · PyPI
apache/paimon-vector-index
Apache Paimon Vector Index: pure Rust IVF-PQ for data lake vector search.
Apache-2.0Jul 30, 2026 · metrics 2.10.0