spark-jobserver/spark-jobserver
Some data may be outdated — see provenance labels.
REST job server for Apache Spark observed · 2026-09-29
Health v2 · maintenance only
51/100
- Activity 62
- Release rhythm 8
- Longevity 100
Flags: no_license
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-10-21. Adoption (stars, forks) is never an input.
- gap_med: n/a
- age_days: 4443
- days_rel: n/a
- days_push: 231
- n_releases_24m: 0
Adoption not part of the score
2834 stars · 967 forks observed · 2026-09-29
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded
Spark Job Server is a RESTful service for submitting, managing, and monitoring Apache Spark jobs, jars, and job contexts. It supports persistent Spark contexts, named RDDs, authentication via Shiro or Keycloak, and deployment on YARN, Mesos, and EMR clusters.
Use cases
- submit spark jobs over a rest api
- manage shared spark contexts for related jobs
- run ad-hoc spark jobs without a cluster console
- upload and version spark job jars
- secure spark job submission with authentication and access control
- deploy spark jobs on yarn or mesos
When to choose
- you need a long-running service to submit and monitor Spark jobs via HTTP
- you want persistent Spark contexts shared across multiple jobs for faster startup
- you need job management features like named RDDs, access control, and SSL
When to avoid
- you only need to run occasional Spark jobs and can use spark-submit directly
- you use Spark's newer native REST APIs or a workflow orchestrator like Airflow for job scheduling
- your stack is not JVM/Scala-based and you cannot package jobs as jars
Facets
service · maturity maintenance
http-server api-framework scheduling middleware big-data apis microservices jvm self-hosted apache-spark job-scheduler rest-api spark-jobs job-management data-engineering web-server
1 source
- readme: https://github.com/spark-jobserver/spark-jobserver · fetched 2026-09-29 · 29ba099cdf2b
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| spark-jobserver/spark-jobserver | main | 51 |
For agents
markdown · JSON · MCP: product_card(name="spark-jobserver/spark-jobserver")
Data as of 2026-10-19T08:05:51.212177+00:00 · Report a problem