# mahmoudparsian/pyspark-tutorial

PySpark-Tutorial provides basic algorithms using PySpark

Repository: https://github.com/mahmoudparsian/pyspark-tutorial
Canonical: https://ross.abutalabs.com/products/pyspark-tutorial
Homepage: http://mapreduce4hackers.com
Language: Jupyter Notebook
License: NOASSERTION
License Family: other
Topics: big-data, big-data-analytics, data-algorithms, pyspark, spark, spark-dataframes, spark-rdd, dataframes, pyspark-sql, pyspark-tutorial, ranking-functions, rdds
Last push: 2025-05-26T04:08:23+00:00

## Health v2 (maintenance only)
Score: 43/100 (v2, computed 2026-09-02T17:46:02.011165+00:00)
- activity 23, release rhythm 35, longevity 100
- inputs: {"age_days": 4192, "days_push": 464, "days_rel": null, "gap_med": null, "n_releases_24m": 0}
- flags: no_releases, no_license
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 1279, forks 473 (observed 2026-08-28T04:04:13.525395+00:00)

## What it is
A tutorial repository of Jupyter Notebook examples teaching basic distributed algorithms using PySpark, the Python API for Apache Spark. It covers RDDs and DataFrames with examples like word count, joins, top-N, and ranking functions.

## Use cases
- learn pyspark basics with runnable examples
- understand rdd transformations like map, filter, and combineByKey
- learn spark dataframes and pyspark sql
- implement word count and bigram frequency in spark
- find top-N and bottom-N records with spark
- learn ranking functions in pyspark
- install and run spark with python

## When to choose
- you are learning PySpark from scratch and want hands-on notebook examples
- you need reference implementations of classic distributed algorithms like word count and joins
- you want to understand both RDD and DataFrame abstractions in Spark

## When to avoid
- you need production-ready data pipeline code rather than educational examples
- you use Spark with Scala or Java rather than Python
- you need a maintained library with an API rather than a tutorial collection

## Facets
- artifact type: learning-resource
- maturity: active
- function: developer-tools, data-science, etl
- domain: big-data, data-science, tutorials, developer-tools
- platform: python, cross-platform
- tags: pyspark, spark, rdd, dataframes, distributed-algorithms, big-data, jupyter-notebook, tutorial

## Member repositories
- mahmoudparsian/pyspark-tutorial (main) score 43

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:04:13.525395+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-30T05:02:41.731405+00:00, confidence not recorded.
  - readme: https://github.com/mahmoudparsian/pyspark-tutorial (fetched 2026-08-28T04:04:13.525395+00:00, sha dd29be9c35fd)
  - homepage: http://mapreduce4hackers.com (fetched 2026-08-29T12:13:32.994116+00:00, sha 2a982d55672e)
- Data as of 2026-08-30T08:39:29.467469+00:00.