All tags
Catalogue tag

#big-data

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

60 records
Tagged “big-data”Ranked by health index
PyPI · crates.io
90Excellenthealth index
KeyviDev/keyvi
Keyvi - the key value index. It is an in-memory FST-based data structure highly optimized for size and lookup performance.
C++★ 261↓ 18.6K/moOct 13, 2026
Apache-2.0Oct 13, 2026 · metrics 2.10.0
npm
90Excellenthealth index
catboost/catboost
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
C++ · Python★ 9,103↓ 23.4K/moSep 17, 2026
Apache-2.0Sep 17, 2026 · metrics 2.10.0
Maven · RubyGems
89Excellenthealth index
apache/orc
Apache ORC - the smallest, fastest columnar storage for Hadoop workloads
Java · C++★ 770Sep 12, 2026
Apache-2.0Sep 12, 2026 · metrics 2.10.0
PyPI
88Excellenthealth index
SuperCowPowers/workbench
Workbench: An easy to use Python API for creating and deploying AWS SageMaker Models
Python★ 51↓ 11K/moSep 11, 2026
MITSep 11, 2026 · metrics 2.10.0
npm
88Excellenthealth index
hazelcast/hazelcast-nodejs-client
Hazelcast Node.js Client
TypeScript · JavaScript★ 152↓ 25.5K/moAug 28, 2026
Apache-2.0Aug 28, 2026 · metrics 2.10.0
Go
88Excellenthealth index
ytsaurus/ytsaurus-k8s-operator
Kubernetes operator for YTsaurus.
Go★ 47Sep 17, 2026
Custom licenseSep 17, 2026 · metrics 2.10.0
PyPI · Maven · npm +1
87Excellenthealth index
h2oai/h2o-3
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
Jupyter Notebook · HTML · Java★ 7,495↓ 3,086/moAug 24, 2026
Apache-2.0Aug 24, 2026 · metrics 2.10.0
PyPI · crates.io
83Excellenthealth index
mabel-dev/opteryx
🦖 A SQL-on-everything Query Engine you can execute over multiple databases and file formats. Query your data, where it lives.
Python★ 113↓ 9,689/moSep 11, 2026
Apache-2.0Sep 11, 2026 · metrics 2.10.0
crates.io · Maven · PyPI
81Excellenthealth index
apache/paimon-vector-index
Apache Paimon Vector Index: pure Rust IVF-PQ for data lake vector search.
Rust★ 21↓ 7,682/moSep 14, 2026
Apache-2.0Sep 14, 2026 · metrics 2.10.0
PyPI
78Goodhealth index
elastic/eland
Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch
Python · Jupyter Notebook★ 693Sep 14, 2026
Apache-2.0Sep 14, 2026 · metrics 2.10.0
npm · Maven
75Goodhealth index
awslabs/amazon-kinesis-client-nodejs
Amazon Kinesis Client Library for Node.js
JavaScript★ 304↓ 63.4K/moSep 6, 2026
Apache-2.0Sep 6, 2026 · metrics 2.10.0
crates.io · Maven
71Goodhealth index
datafusion-contrib/StreamFusion
World's First OSS Flink Accelerator built on Apache DataFusion
Java · Rust★ 141Oct 19, 2026
Apache-2.0Oct 19, 2026 · metrics 2.10.0
npm · Maven
67Goodhealth index
Netflix/genie
Distributed Big Data Orchestration Service
Java · Groovy★ 1,766Sep 13, 2026
Apache-2.0Sep 13, 2026 · metrics 2.10.0
Maven · RubyGems
67Goodhealth index
apache/calcite-avatica
Apache Calcite Avatica
Java★ 272Oct 19, 2026
Apache-2.0Oct 19, 2026 · metrics 2.10.0
PyPI
67Goodhealth index
avikhagol/avica
Automated VLBI pipeline in CASA (AVICA) is a batch VLBI processing and calibration pipeline with zero learning curve and no input configuration.
Python★ 2↓ 3,472/moSep 26, 2026
MITSep 26, 2026 · metrics 2.10.0
—
65Goodhealth index
apache/spark-connect-swift
Apache Spark Connect Client for Swift
Swift★ 33Sep 20, 2026
Apache-2.0Sep 20, 2026 · metrics 2.10.0
npm
62Moderatehealth index
AllenInstitute/vis
Typescript packages for building big-data visualization tools & components, with examples for a variety of common data types & formats
TypeScript★ 10↓ 4,775/moOct 13, 2026
BSD-3-ClauseOct 13, 2026 · metrics 2.10.0
PyPI
60Moderatehealth index
adidas/lakehouse-engine
The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for several lakehouse algorithms, data flows and utilities for Data Products.
Python★ 293↓ 3,910/moOct 19, 2026
Apache-2.0Oct 19, 2026 · metrics 2.10.0
PyPI
54Moderatehealth index
Kenzy-Zero/kenze
Big-file data prep that never runs out of memory - an interactive shell and CLI, powered by DuckDB.
Python★ 10↓ 167/moSep 17, 2026
MITSep 17, 2026 · metrics 2.10.0
npm
54Moderatehealth index
mfuu/vue-virtual-sortable
A virtual scrolling list component that can be sorted by dragging
TypeScript★ 51↓ 5,812/moSep 18, 2026
MITSep 18, 2026 · metrics 2.10.0
Go
53Moderatehealth index
PeterRK/estuary
Dictionary designed for read-mostly scene.
C++ · Go★ 13Sep 20, 2026
LGPL-2.1Sep 20, 2026 · metrics 2.10.0
PyPI
53Moderatehealth index
xeondb/Xeondb
Xeondb is a real-time big data database that is designed to be fast, efficient, and easy to use. It is built on top of a custom storage engine that is optimized for high performance and low latency.
C++★ 5Sep 18, 2026
MITSep 18, 2026 · metrics 2.10.0
PyPI
51Moderatehealth index
bigbio/quantms-rescoring
quantms and ms2rescore helper functions and scripts
Python★ 1↓ 205/moSep 19, 2026
Apache-2.0Sep 19, 2026 · metrics 2.10.0
—
47Weakhealth index
sigmf/SigMF
The Signal Metadata Format Specification
Python★ 471Oct 19, 2026
CC-BY-SA-4.0Oct 19, 2026 · metrics 2.10.0
npm · RubyGems
43Weakhealth index
kantord/just-dashboard
:bar_chart: :clipboard: Dashboards using YAML or JSON files
TypeScript★ 1,586Oct 18, 2026
MITOct 18, 2026 · metrics 2.10.0
PyPI
34At Riskhealth index
databricks/koalas
Koalas: pandas API on Apache Spark
Python★ 3,375↓ 666.1K/moSep 17, 2026
Apache-2.0Sep 17, 2026 · metrics 2.10.0
Maven · npm
34At Riskhealth index
provectus/kafka-ui
Open-Source Web UI for Apache Kafka Management
Java · TypeScript★ 12.3KAug 27, 2026
Apache-2.0Aug 27, 2026 · metrics 2.10.0
PyPI
34At Riskhealth index
uxlfoundation/oneDAL
oneAPI Data Analytics Library (oneDAL)
C++★ 653Oct 16, 2026
Apache-2.0Oct 16, 2026 · metrics 2.10.0
Maven
34At Riskhealth index
ytsaurus/ytsaurus
YTsaurus is a scalable and fault-tolerant open-source big data platform.
C++ · C · Python★ 2,319Oct 19, 2026
Apache-2.0Oct 19, 2026 · metrics 2.10.0
Maven · npm
19Criticalhealth index
thingsboard/thingsboard
Open-source IoT Platform - Device management, data collection, processing and visualization.
Java · TypeScript★ 22.4KSep 16, 2026
Apache-2.0Sep 16, 2026 · metrics 2.10.0