Netflix/genie
Distributed Big Data Orchestration Service observed · 2026-08-28
Health v2 · maintenance only
64/100
- Activity 92
- Release rhythm 8
- Longevity 100
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-03. Adoption (stars, forks) is never an input.
- gap_med: n/a
- age_days: 4822
- days_rel: n/a
- days_push: 51
- n_releases_24m: 0
Adoption not part of the score
1767 stars · 373 forks observed · 2026-08-28
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded
Genie is a federated distributed job orchestration and execution engine developed by Netflix, exposing REST APIs to run big data jobs like Hadoop, Hive, Spark, Presto, and Pig. It manages metadata for clusters, commands, and applications, dynamically assembling the right binaries and configurations for each job.
Use cases
- run spark jobs against a cluster via a rest api without local setup
- route hive queries to the correct hadoop cluster automatically
- manage metadata for multiple big data clusters and applications
- let data scientists submit jobs without installing hadoop or spark locally
- audit and debug past big data job executions
- abstract cluster upgrades away from data consumers
When to choose
- you operate multiple big data clusters and need federated job routing
- you want users to submit hadoop/spark/hive jobs through a REST API
- you need centralized job configuration, monitoring, and auditing
When to avoid
- you only need simple cron-style scheduling without cluster management
- your workloads are not big data jobs (e.g., generic microservice orchestration)
- you want a lightweight single-node job runner
Facets
service · maturity active
workflow-automation scheduling api-framework configuration-management big-data microservices apis jvm cloud self-hosted job-orchestration big-data hadoop spark hive netflix-oss rest-api microservices data-engineering automation docker
2 sources
- readme: https://github.com/Netflix/genie · fetched 2026-08-28 · 72ef6d221d66
- homepage: https://netflix.github.io/genie · fetched 2026-08-29 · 326615b9f933
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| Netflix/genie | main | 64 |
For agents
Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem