Yelp/mrjob
Run MapReduce jobs on Hadoop or Amazon Web Services observed · 2026-08-28
Health v2 · maintenance only
66/100
- Activity 75
- Release rhythm 35
- Longevity 100
Flags: no_releases no_license
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-03. Adoption (stars, forks) is never an input.
- gap_med: n/a
- age_days: 5803
- days_rel: n/a
- days_push: 153
- n_releases_24m: 0
Adoption not part of the score
2613 stars · 580 forks observed · 2026-08-28
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded
mrjob is a Python library for writing and running Hadoop Streaming MapReduce jobs, with support for Amazon EMR, Google Cloud Dataproc, self-managed Hadoop clusters, and local execution for testing. It also supports launching Spark jobs and handles multi-step jobs, environment setup, and error log interpretation.
Use cases
- run mapreduce jobs on hadoop from python
- run batch data processing on amazon emr
- test hadoop streaming jobs locally before deploying
- run multi-step mapreduce pipelines
- launch spark jobs on emr from python
- process large log files with mapreduce
- run word count and frequency analysis on a hadoop cluster
When to choose
- you need to write Hadoop Streaming jobs in pure Python without JVM boilerplate
- you want to run the same job locally, on EMR, Dataproc, or your own Hadoop cluster
- you need multi-step MapReduce pipelines with automatic config and log interpretation
When to avoid
- you are starting a new project - modern data processing tools like Spark, Dask, or Ray are better supported
- you need real-time or stream processing rather than batch MapReduce
- you are not tied to Hadoop or EMR infrastructure
Facets
library · maturity maintenance
etl streaming data-science cli big-data cloud-computing developer-tools python cli cloud mapreduce hadoop hadoop-streaming amazon-emr google-cloud-dataproc spark distributed-computing batch-processing data-engineering
2 sources
- readme: https://github.com/Yelp/mrjob · fetched 2026-08-28 · d1cd578f9851
- registry_pypi: https://pypi.org/pypi/mrjob/json · fetched 2026-08-29 · 4bf39c634e73
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| Yelp/mrjob | main | 66 |
For agents
Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem