# big-data-europe/docker-spark

Apache Spark docker image

Repository: https://github.com/big-data-europe/docker-spark
Canonical: https://ross.abutalabs.com/products/docker-spark
Language: Shell
License Family: other
Topics: spark-kubernetes, kubernetes, k8s-spark, docker, apache-spark
Last push: 2026-04-20T23:29:19+00:00

## Health v2 (maintenance only)
Score: 67/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 78, release rhythm 35, longevity 100
- inputs: {"age_days": 3982, "days_push": 135, "days_rel": null, "gap_med": null, "n_releases_24m": 0}
- flags: no_releases, no_license
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 2050, forks 684 (observed 2026-08-28T04:06:09.152177+00:00)

## What it is
A set of Dockerfiles and Docker Compose configurations for building Apache Spark Docker images that run a standalone Spark cluster with one master and multiple workers. It supports many Spark/Hadoop/OpenJDK version combinations and lets users build Spark applications in Java, Scala, or Python to run on the cluster.

## Use cases
- spin up a standalone apache spark cluster with docker compose
- run spark master and worker containers for big data pipelines
- containerize spark applications in java scala or python
- deploy spark on kubernetes with docker images
- test spark jobs locally without installing spark
- integrate spark into a bde big data europe pipeline

## When to choose
- you want a quick containerized spark cluster for development or testing
- you need specific spark hadoop and jdk version combinations as docker images
- you use docker compose or kubernetes to orchestrate spark master and workers
- you want to build spark apps against a consistent containerized environment

## When to avoid
- you need a fully managed spark service like databricks or emr
- you require the newest spark version not yet covered by these images
- you prefer official apache spark binaries or spark kubernetes operator for production
- you need a license-cleared dependency since the repo has no explicit license

## Facets
- artifact type: infra-config
- maturity: active
- function: container-runtime, deployment, developer-tools, data-science, etl
- domain: big-data, microservices
- platform: cross-platform
- tags: apache-spark, docker-images, spark-cluster, docker-compose, spark-master, spark-worker, hadoop, standalone-cluster, big-data-europe, containerization, data-engineering, containers, devops, docker, kubernetes, linux

## Member repositories
- big-data-europe/docker-spark (main) score 67

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:06:09.152177+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-30T02:57:35.543655+00:00, confidence not recorded.
  - readme: https://github.com/big-data-europe/docker-spark (fetched 2026-08-28T04:06:09.152177+00:00, sha 0233528fe714)
- Data as of 2026-08-30T08:39:29.467469+00:00.
