All tags
Catalogue tag

#spark

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

36 records
Tagged “spark”Ranked by health index
PyPI · npm
98Exceptionalhealth index
delta-io/delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Scala · Java★ 8,926↓ 37M/moAug 2, 2026
Apache-2.0Aug 2, 2026 · metrics 2.10.0
PyPI
96Exceptionalhealth index
graphframes/graphframes
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs
Scala · Python★ 1,201Aug 13, 2026
Apache-2.0Aug 13, 2026 · metrics 2.10.0
PyPI
96Exceptionalhealth index
moj-analytical-services/splink
Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends
Python · JavaScript★ 2,336Aug 13, 2026
MITAug 13, 2026 · metrics 2.10.0
Maven · npm · PyPI +1
95Exceptionalhealth index
apache/spark
Apache Spark - A unified analytics engine for large-scale data processing
Scala · Python★ 43.8KAug 5, 2026
Apache-2.0Aug 5, 2026 · metrics 2.10.0
npm · PyPI
95Exceptionalhealth index
microsoft/SynapseML
Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark
Scala · Python★ 5,236Aug 12, 2026
MITAug 12, 2026 · metrics 2.10.0
PyPI
94Exceptionalhealth index
dbt-labs/dbt-adapters
No repository description published.
Python★ 227↓ 140M/moAug 4, 2026
Apache-2.0Aug 4, 2026 · metrics 2.10.0
Maven
93Exceptionalhealth index
apache/uniffle
Uniffle is a high performance, general purpose Remote Shuffle Service.
Java★ 451Jul 21, 2026
Apache-2.0Jul 21, 2026 · metrics 2.10.0
PyPI
93Exceptionalhealth index
delta-io/delta-sharing
An open protocol for secure data sharing
Scala · Python★ 956↓ 1.4M/moAug 21, 2026
Apache-2.0Aug 21, 2026 · metrics 2.10.0
Maven · PyPI
93Exceptionalhealth index
projectnessie/nessie
Nessie: Transactional Catalog for Data Lakes with Git-like semantics
Java★ 1,483Jul 25, 2026
Apache-2.0Jul 25, 2026 · metrics 2.10.0
PyPI
93Exceptionalhealth index
tobymao/sqlglot
Python SQL Parser and Transpiler
Python★ 9,573↓ 86.7M/moAug 27, 2026
MITAug 27, 2026 · metrics 2.10.0
npm
91Excellenthealth index
sql-formatter-org/sql-formatter
A whitespace formatter for different query languages
TypeScript★ 2,886↓ 16M/moAug 13, 2026
MITAug 13, 2026 · metrics 2.10.0
PyPI
89Excellenthealth index
flyteorg/flytekit
Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.
Python★ 315Jul 28, 2026
Apache-2.0Jul 28, 2026 · metrics 2.10.0
PyPI · Maven
89Excellenthealth index
logicalclocks/hopsworks-api
Python SDK to interact with the Hopsworks API
Python · Java★ 15↓ 222.9K/moAug 19, 2026
Apache-2.0Aug 19, 2026 · metrics 2.10.0
npm
87Excellenthealth index
ChatLunaLab/chatluna
多平台模型接入,可扩展,多种输出格式,提供大语言模型聊天服务的插件 | A bot plugin for LLM chat with multi-model integration, extensibility, and various output formats
TypeScript · Vue★ 436↓ 13.7K/moAug 22, 2026
AGPL-3.0Aug 22, 2026 · metrics 2.10.0
PyPI · Maven · npm +1
87Excellenthealth index
h2oai/h2o-3
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
Jupyter Notebook · HTML · Java★ 7,495↓ 3,086/moAug 24, 2026
Apache-2.0Aug 24, 2026 · metrics 2.10.0
PyPI
86Excellenthealth index
SuperCowPowers/workbench
Workbench: An easy to use Python API for creating and deploying AWS SageMaker Models
Python★ 51↓ 10.1K/moJul 18, 2026
MITJul 18, 2026 · metrics 2.10.0
PyPI
86Excellenthealth index
combust/mleap
MLeap: Deploy ML Pipelines to Production
Scala · Python★ 1,543↓ 2.1M/moAug 27, 2026
Apache-2.0Aug 27, 2026 · metrics 2.10.0
PyPI
84Excellenthealth index
OvertureMaps/overture-airflow-provider
Airflow provider to interact with various services used by Overture.
Python · JavaScript★ 1↓ 2,246/moAug 28, 2026
MITAug 28, 2026 · metrics 2.10.0
Maven
83Excellenthealth index
gorpipe/gor
GORpipe is a tool based on a genomic ordered relational architecture and allows analysis of large sets of genomic and phenotypic tabular data using declarative query language, in a parallel execution engine.
Java · Scala★ 47Aug 16, 2026
AGPL-3.0Aug 16, 2026 · metrics 2.10.0
RubyGems
81Excellenthealth index
JohnSnowLabs/spark-nlp
State of the Art Natural Language Processing
Scala · Python · HTML★ 4,154Aug 13, 2026
Apache-2.0Aug 13, 2026 · metrics 2.10.0
Maven
81Excellenthealth index
RoaringBitmap/RoaringBitmap
A better compressed bitset in Java: used by Apache Spark, Netflix Atlas, Apache Pinot, Tablesaw, and many others
Java★ 3,918Aug 28, 2026
Apache-2.0Aug 28, 2026 · metrics 2.10.0
PyPI
78Goodhealth index
fugue-project/fugue
A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
Python★ 2,169↓ 2.2M/moAug 27, 2026
Apache-2.0Aug 27, 2026 · metrics 2.10.0
npm
77Goodhealth index
p33ves/databricks-axi
Databricks CLI built for AI agents. Compact TOON output, lean default schemas, and errors that say what to try next. Runs on top of the official databricks CLI, following the AXI standard.
TypeScript★ 3↓ 2,603/moJul 23, 2026
MITJul 23, 2026 · metrics 2.10.0
Go · npm
65Goodhealth index
okdp/spark-web-proxy
Monitor running Spark applications within Spark History Server UI on Kubernetes.
Go★ 2Jul 19, 2026
Apache-2.0Jul 19, 2026 · metrics 2.10.0
PyPI
63Moderatehealth index
cloudera/impyla
Python DB API 2.0 client for Impala and Hive (HiveServer2 protocol)
Python · Thrift★ 744↓ 8.9M/moAug 22, 2026
Apache-2.0Aug 22, 2026 · metrics 2.10.0
PyPI
60Moderatehealth index
adidas/lakehouse-engine
The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for several lakehouse algorithms, data flows and utilities for Data Products.
Python★ 294↓ 3,910/moAug 18, 2026
Apache-2.0Aug 18, 2026 · metrics 2.10.0
npm · crates.io
59Moderatehealth index
lightning-node-interface/lni
LNI Remote - Lightning Node Interface. A standard interface to remote connect to CLN, LND, Phoenixd, LNURL, BOLT 11, BOLT 12, NWC, Spark, Strike, Blink, and Speed. Language Binding support for kotlin, swift, react-native, nodejs (ts, js).
Swift · Rust · TypeScript★ 11↓ 2,988/moJul 21, 2026
No licenseJul 21, 2026 · metrics 2.10.0
Maven · PyPI
59Moderatehealth index
sparkutils/quality
A Quality Spark DQ and transformation Library
Scala★ 5Sep 5, 2026
Apache-2.0Sep 5, 2026 · metrics 2.10.0
Maven
55Moderatehealth index
deeplearning4j/deeplearning4j
Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learn...
Java · C++★ 14.2KAug 27, 2026
Apache-2.0Aug 27, 2026 · metrics 2.10.0