cloudera/livy

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

1007 stars · 311 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Livy is an open-source REST service for interacting with Apache Spark remotely, supporting interactive Scala, Python, and R sessions as well as batch job submissions. It runs Spark locally or on YARN and allows multiple users to share the same server with impersonation support.

Use cases

• submit spark jobs over rest
• run interactive pyspark sessions from a notebook server
• share a spark cluster among multiple users
• submit batch spark jobs from a web app
• run spark code remotely without installing spark locally

When to choose

• you need remote REST access to a Spark cluster
• you want multi-user interactive Spark sessions with impersonation
• you submit Spark jobs from applications or notebooks over HTTP

When to avoid

• you need a actively maintained project - releases are infrequent and the project is largely dormant
• you run Spark on Kubernetes and can use spark-submit or native schedulers instead
• you only need local single-user Spark development

Facets

service · maturity maintenance

http-server rpc api-framework big-data apis microservices jvm self-hosted apache-spark rest-api yarn spark-submission scala data-engineering linux macos web-server

Member repositories

For agents

markdown · JSON · MCP: product_card(name="cloudera/livy")