jadianes/spark-py-notebooks resource
Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks observed · 2026-08-28
Health v2 · maintenance only
32/100
- Activity 0
- Release rhythm 35
- Longevity 100
Flags: no_releases no_license
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-03. Adoption (stars, forks) is never an input.
- gap_med: n/a
- age_days: 4137
- days_rel: n/a
- days_push: 900
- n_releases_24m: 0
Adoption not part of the score
1659 stars · 904 forks observed · 2026-08-28
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded
A collection of Jupyter/IPython notebooks teaching Apache Spark with Python (pySpark), from RDD basics to MLlib machine learning. It uses the KDD Cup 1999 dataset and is meant to be run in pySpark mode with a local Spark installation.
Use cases
- learn pyspark from scratch
- understand RDD transformations like map and filter
- tutorials for machine learning with Spark MLlib
- big data analysis examples in Python
- hands-on Spark notebooks to follow along
- introduction to Spark for data science
When to choose
- you want a free, notebook-based introduction to Spark with Python
- you learn best by running code step by step
- you need beginner-to-intermediate coverage of RDDs and MLlib
When to avoid
- you need up-to-date Spark APIs like DataFrame-first Spark 3.x patterns
- you want production-ready code rather than tutorials
- you prefer Scala or R for Spark
Facets
learning-resource · maturity maintenance
data-science machine-learning etl big-data data-science machine-learning tutorials python cross-platform spark pyspark jupyter-notebooks mllib rdd big-data educational
2 sources
- readme: https://github.com/jadianes/spark-py-notebooks · fetched 2026-08-28 · 67349ac210e8
- homepage: http://jadianes.github.io/spark-py-notebooks · fetched 2026-08-29 · a4e53c95b2d6
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| jadianes/spark-py-notebooks | main | 32 |
For agents
markdown · JSON · MCP: product_card(name="jadianes/spark-py-notebooks")
Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem