kubeflow/spark-operator resource
Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes. observed · 2026-08-28
Health v2 · maintenance only
94/100
- Activity 99
- Release rhythm 83
- Longevity 100
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-02. Adoption (stars, forks) is never an input.
- gap_med: 61
- age_days: 3164
- days_rel: 33
- days_push: 7
- n_releases_24m: 12
Adoption not part of the score
3149 stars · 1519 forks observed · 2026-08-28
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded
A Kubernetes operator that manages the full lifecycle of Apache Spark applications using custom resources (SparkApplication CRDs). It lets you declare, run, and monitor Spark jobs on Kubernetes just like any other native workload.
Use cases
- run spark jobs on kubernetes
- manage spark application lifecycle with a kubernetes operator
- deploy sparkapplication crd via helm
- schedule batch spark workloads in a k8s cluster
- monitor spark job status with kubectl
- migrate spark workloads from dataproc to kubernetes
When to choose
- you already run workloads on Kubernetes and want Spark jobs managed declaratively with CRDs
- you need automated retries, status reporting, and lifecycle management for Spark applications
- you want to install via Helm or Kustomize into an existing cluster
When to avoid
- you run Spark on dedicated clusters or managed services like Databricks or EMR instead of Kubernetes
- you need a lightweight way to submit one-off Spark jobs without a controller installed
- your cluster cannot run the operator's RBAC and CRDs
Facets
infra-config · maturity active
container-orchestration deployment workflow-automation scheduling big-data cloud-computing cloud go python kubernetes-operator apache-spark crd helm-chart spark-applications dataproc data-engineering containers devops kubernetes docker
1 source
- readme: https://github.com/kubeflow/spark-operator · fetched 2026-08-28 · ad66127db9a8
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| kubeflow/spark-operator | main | 94 |
For agents
markdown · JSON · MCP: product_card(name="kubeflow/spark-operator")
Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem