# Netflix/genie

Distributed Big Data Orchestration Service

Repository: https://github.com/Netflix/genie
Canonical: https://ross.abutalabs.com/products/netflix-genie
Homepage: https://netflix.github.io/genie
Language: Java
License: Apache-2.0
License Family: permissive
Topics: big-data, bigdata, orchestration, configuration, configuration-management, java, spring-boot, distributed-systems, netflixoss, cloud, netflix-oss, microservice, microservices
Last push: 2026-07-13T23:55:51+00:00

## Health v2 (maintenance only)
Score: 64/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 92, release rhythm 8, longevity 100
- inputs: {"age_days": 4822, "days_push": 51, "days_rel": null, "gap_med": null, "n_releases_24m": 0}
- flags: none
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 1767, forks 373 (observed 2026-08-28T04:05:33.571805+00:00)

## What it is
Genie is a federated distributed job orchestration and execution engine developed by Netflix, exposing REST APIs to run big data jobs like Hadoop, Hive, Spark, Presto, and Pig. It manages metadata for clusters, commands, and applications, dynamically assembling the right binaries and configurations for each job.

## Use cases
- run spark jobs against a cluster via a rest api without local setup
- route hive queries to the correct hadoop cluster automatically
- manage metadata for multiple big data clusters and applications
- let data scientists submit jobs without installing hadoop or spark locally
- audit and debug past big data job executions
- abstract cluster upgrades away from data consumers

## When to choose
- you operate multiple big data clusters and need federated job routing
- you want users to submit hadoop/spark/hive jobs through a REST API
- you need centralized job configuration, monitoring, and auditing

## When to avoid
- you only need simple cron-style scheduling without cluster management
- your workloads are not big data jobs (e.g., generic microservice orchestration)
- you want a lightweight single-node job runner

## Facets
- artifact type: service
- maturity: active
- function: workflow-automation, scheduling, api-framework, configuration-management
- domain: big-data, microservices, apis
- platform: jvm, cloud, self-hosted
- tags: job-orchestration, big-data, hadoop, spark, hive, netflix-oss, rest-api, microservices, data-engineering, automation, docker

## Member repositories
- Netflix/genie (main) score 64

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:05:33.571805+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-30T03:26:23.743618+00:00, confidence not recorded.
  - readme: https://github.com/Netflix/genie (fetched 2026-08-28T04:05:33.571805+00:00, sha 72ef6d221d66)
  - homepage: https://netflix.github.io/genie (fetched 2026-08-29T11:04:40.676451+00:00, sha 326615b9f933)
- Data as of 2026-08-30T08:39:29.467469+00:00.