PyPI · npm98Exceptionalhealth index
delta-io/deltaAn open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Scala · Java★ 8,926↓ 37M/moAug 2, 2026
PyPI96Exceptionalhealth index
Scala · Python★ 1,201Aug 13, 2026
PyPI96Exceptionalhealth index
Python · JavaScript★ 2,336Aug 13, 2026
Maven · npm · PyPI +195Exceptionalhealth index

apache/sparkApache Spark - A unified analytics engine for large-scale data processing
Scala · Python★ 43.8KAug 5, 2026
npm · PyPI95Exceptionalhealth index

microsoft/SynapseMLSimple and Distributed Machine Learning Python Library porting ML algorithms for Spark
Scala · Python★ 5,236Aug 12, 2026
PyPI94Exceptionalhealth index
Python★ 227↓ 140M/moAug 4, 2026
Maven93Exceptionalhealth index
apache/uniffleUniffle is a high performance, general purpose Remote Shuffle Service.
Java★ 451Jul 21, 2026
PyPI93Exceptionalhealth index
Scala · Python★ 956↓ 1.4M/moAug 21, 2026
Maven · PyPI93Exceptionalhealth index
Java★ 1,483Jul 25, 2026
PyPI93Exceptionalhealth index
Python★ 9,573↓ 86.7M/moAug 27, 2026
npm91Excellenthealth index
TypeScript★ 2,886↓ 16M/moAug 13, 2026
PyPI89Excellenthealth index
flyteorg/flytekitExtensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.
Python★ 315Jul 28, 2026
PyPI · Maven89Excellenthealth index
Python · Java★ 15↓ 222.9K/moAug 19, 2026
npm87Excellenthealth index

ChatLunaLab/chatluna多平台模型接入,可扩展,多种输出格式,提供大语言模型聊天服务的插件 | A bot plugin for LLM chat with multi-model integration, extensibility, and various output formats
TypeScript · Vue★ 436↓ 13.7K/moAug 22, 2026
PyPI · Maven · npm +187Excellenthealth index

h2oai/h2o-3H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
Jupyter Notebook · HTML · Java★ 7,495↓ 3,086/moAug 24, 2026
PyPI86Excellenthealth index
Python★ 51↓ 10.1K/moJul 18, 2026
PyPI86Excellenthealth index
Scala · Python★ 1,543↓ 2.1M/moAug 27, 2026
PyPI84Excellenthealth index
Python · JavaScript★ 1↓ 2,246/moAug 28, 2026
Maven83Excellenthealth index

gorpipe/gorGORpipe is a tool based on a genomic ordered relational architecture and allows analysis of large sets of genomic and phenotypic tabular data using declarative query language, in a parallel execution engine.
Java · Scala★ 47Aug 16, 2026
RubyGems81Excellenthealth index
Scala · Python · HTML★ 4,154Aug 13, 2026
Maven81Excellenthealth index

RoaringBitmap/RoaringBitmapA better compressed bitset in Java: used by Apache Spark, Netflix Atlas, Apache Pinot, Tablesaw, and many others
Java★ 3,918Aug 28, 2026

fugue-project/fugueA unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
Python★ 2,169↓ 2.2M/moAug 27, 2026
p33ves/databricks-axiDatabricks CLI built for AI agents. Compact TOON output, lean default schemas, and errors that say what to try next. Runs on top of the official databricks CLI, following the AXI standard.
TypeScript★ 3↓ 2,603/moJul 23, 2026
Scala · Java★ 4Aug 28, 2026
Go · npm65Goodhealth index
okdp/spark-web-proxyMonitor running Spark applications within Spark History Server UI on Kubernetes.
Go★ 2Jul 19, 2026
PyPI63Moderatehealth index

cloudera/impylaPython DB API 2.0 client for Impala and Hive (HiveServer2 protocol)
Python · Thrift★ 744↓ 8.9M/moAug 22, 2026
PyPI60Moderatehealth index

adidas/lakehouse-engineThe Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for several lakehouse algorithms, data flows and utilities for Data Products.
Python★ 294↓ 3,910/moAug 18, 2026
npm · crates.io59Moderatehealth index
lightning-node-interface/lniLNI Remote - Lightning Node Interface. A standard interface to remote connect to CLN, LND, Phoenixd, LNURL, BOLT 11, BOLT 12, NWC, Spark, Strike, Blink, and Speed. Language Binding support for kotlin, swift, react-native, nodejs (ts, js).
Swift · Rust · TypeScript★ 11↓ 2,988/moJul 21, 2026
Maven · PyPI59Moderatehealth index
Scala★ 5Sep 5, 2026

deeplearning4j/deeplearning4jSuite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learn...
Java · C++★ 14.2KAug 27, 2026