# spark-jobserver/spark-jobserver

REST job server for Apache Spark

Repository: https://github.com/spark-jobserver/spark-jobserver
Canonical: https://ross.abutalabs.com/products/spark-jobserver
Language: Scala
License: NOASSERTION
License Family: other
Topics: spark, rest-api, spark-jobserver, scala
Last push: 2026-03-03T12:09:21+00:00

## Health v2 (maintenance only)
Score: 54/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 70, release rhythm 8, longevity 100
- inputs: {"age_days": 4395, "days_push": 183, "days_rel": null, "gap_med": null, "n_releases_24m": 0}
- flags: no_license
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 2836, forks 970 (observed 2026-08-28T04:07:24.587320+00:00)

## What it is
Spark Job Server is a RESTful service for submitting, managing, and monitoring Apache Spark jobs, jars, and job contexts. It supports persistent Spark contexts, named RDDs, authentication via Shiro or Keycloak, and deployment on YARN, Mesos, and EMR clusters.

## Use cases
- submit spark jobs over a rest api
- manage shared spark contexts for related jobs
- run ad-hoc spark jobs without a cluster console
- upload and version spark job jars
- secure spark job submission with authentication and access control
- deploy spark jobs on yarn or mesos

## When to choose
- you need a long-running service to submit and monitor Spark jobs via HTTP
- you want persistent Spark contexts shared across multiple jobs for faster startup
- you need job management features like named RDDs, access control, and SSL

## When to avoid
- you only need to run occasional Spark jobs and can use spark-submit directly
- you use Spark's newer native REST APIs or a workflow orchestrator like Airflow for job scheduling
- your stack is not JVM/Scala-based and you cannot package jobs as jars

## Facets
- artifact type: service
- maturity: maintenance
- function: http-server, api-framework, scheduling, middleware
- domain: big-data, apis, microservices
- platform: jvm, self-hosted
- tags: apache-spark, job-scheduler, rest-api, spark-jobs, job-management, data-engineering, web-server

## Member repositories
- spark-jobserver/spark-jobserver (main) score 54

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:07:24.587320+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-30T07:37:46.963272+00:00, confidence not recorded.
  - readme: https://github.com/spark-jobserver/spark-jobserver (fetched 2026-08-28T04:07:24.587320+00:00, sha 29ba099cdf2b)
- Data as of 2026-08-30T08:39:29.467469+00:00.