PyPI · npm
delta-io/delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Apache-2.0Sep 15, 2026 · metrics 2.10.0
All tags
Catalogue tag
#spark
Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.
63 records
Go
kubeflow/spark-operator
Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.
Apache-2.0Oct 16, 2026 · metrics 2.10.0
PyPI
moj-analytical-services/splink
Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends
MITSep 17, 2026 · metrics 2.10.0
npm · PyPI
microsoft/SynapseML
Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark
MITSep 17, 2026 · metrics 2.10.0
Maven · npm · PyPI
apache/paimon
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
Apache-2.0Oct 19, 2026 · metrics 2.10.0
Maven · npm · PyPI +1
apache/spark
Apache Spark - A unified analytics engine for large-scale data processing
Apache-2.0Sep 16, 2026 · metrics 2.10.0
PyPI
graphframes/graphframes
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs
Apache-2.0Sep 17, 2026 · metrics 2.10.0
PyPI
graphistry/pygraphistry
PyGraphistry is a Python library to quickly load, shape, embed, and explore big graphs with the GPU-accelerated Graphistry visual graph analyzer
BSD-3-ClauseOct 3, 2026 · metrics 2.10.0
Maven · crates.io · npm +1
apache/celeborn
Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.
Apache-2.0Sep 29, 2026 · metrics 2.10.0
Maven · PyPI
apache/kyuubi
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
Apache-2.0Sep 19, 2026 · metrics 2.10.0
PyPI
dbt-labs/dbt-adapters
No repository description published.
Apache-2.0Sep 16, 2026 · metrics 2.10.0
Maven
apache/uniffle
Uniffle is a high performance, general purpose Remote Shuffle Service.
Apache-2.0Sep 12, 2026 · metrics 2.10.0
PyPI · npm
microsoft/dbt-fabricspark
A dbt adapter for Fabric Lakehouse backed by Apache Spark.
MITOct 17, 2026 · metrics 2.10.0
PyPI
tobymao/sqlglot
Python SQL Parser and Transpiler
MITAug 27, 2026 · metrics 2.10.0
PyPI
capitalone/datacompy
Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!
Apache-2.0Sep 20, 2026 · metrics 2.10.0
PyPI
Nike-Inc/koheesio
Python framework for building efficient data pipelines. It promotes modularity and collaboration, enabling the creation of complex pipelines from simple, reusable components.
Apache-2.0Oct 16, 2026 · metrics 2.10.0
PyPI
delta-io/delta-sharing
An open protocol for secure data sharing
Apache-2.0Oct 20, 2026 · metrics 2.10.0
—
dotnet/spark
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
MITOct 13, 2026 · metrics 2.10.0
PyPI
flyteorg/flytekit
Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.
Apache-2.0Sep 14, 2026 · metrics 2.10.0
npm
sql-formatter-org/sql-formatter
A whitespace formatter for different query languages
MITSep 17, 2026 · metrics 2.10.0
Go · npm · PyPI
calvinchengx/fabric-emulator
Local Microsoft Fabric emulator in one Go binary. Control plane, OneLake, T-SQL warehouse and Spark, verified against unmodified Microsoft tools.
Apache-2.0Sep 10, 2026 · metrics 2.10.0
Maven · PyPI
projectnessie/nessie
Nessie: Transactional Catalog for Data Lakes with Git-like semantics
Apache-2.0Sep 13, 2026 · metrics 2.10.0
npm
DTStack/dt-sql-parser
SQL Parsers for BigData, built with antlr4.
MITSep 26, 2026 · metrics 2.10.0
PyPI · Maven
logicalclocks/hopsworks-api
Python SDK to interact with the Hopsworks API
Apache-2.0Oct 19, 2026 · metrics 2.10.0
npm
ChatLunaLab/chatluna
多平台模型接入，可扩展，多种输出格式，提供大语言模型聊天服务的插件 | A bot plugin for LLM chat with multi-model integration, extensibility, and various output formats
AGPL-3.0Oct 20, 2026 · metrics 2.10.0
PyPI
MigoXLab/dingo
Dingo: A Comprehensive AI Data, Model and Application Quality Evaluation Tool
Apache-2.0Oct 19, 2026 · metrics 2.10.0
PyPI
SuperCowPowers/workbench
Workbench: An easy to use Python API for creating and deploying AWS SageMaker Models
MITSep 11, 2026 · metrics 2.10.0
—
typelevel/frameless
Expressive types for Spark.
Apache-2.0Sep 19, 2026 · metrics 2.10.0
Maven · npm · PyPI
aehrc/pathling
Tools that make it easier to use FHIR and clinical terminology within data analytics, built on Apache Spark.
Apache-2.0Oct 13, 2026 · metrics 2.10.0
PyPI · Maven · npm +1
h2oai/h2o-3
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
Apache-2.0Aug 24, 2026 · metrics 2.10.0