mahmoudparsian/pyspark-tutorial resource

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

1279 stars · 473 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A tutorial repository of Jupyter Notebook examples teaching basic distributed algorithms using PySpark, the Python API for Apache Spark. It covers RDDs and DataFrames with examples like word count, joins, top-N, and ranking functions.

Use cases

• learn pyspark basics with runnable examples
• understand rdd transformations like map, filter, and combineByKey
• learn spark dataframes and pyspark sql
• implement word count and bigram frequency in spark
• find top-N and bottom-N records with spark
• learn ranking functions in pyspark
• install and run spark with python

When to choose

• you are learning PySpark from scratch and want hands-on notebook examples
• you need reference implementations of classic distributed algorithms like word count and joins
• you want to understand both RDD and DataFrame abstractions in Spark

When to avoid

• you need production-ready data pipeline code rather than educational examples
• you use Spark with Scala or Java rather than Python
• you need a maintained library with an API rather than a tutorial collection

Facets

learning-resource · maturity active

developer-tools data-science etl big-data data-science tutorials developer-tools python cross-platform pyspark spark rdd dataframes distributed-algorithms big-data jupyter-notebook tutorial

Member repositories

For agents

markdown · JSON · MCP: product_card(name="mahmoudparsian/pyspark-tutorial")