# spark-examples/pyspark-examples

Pyspark RDD, DataFrame and Dataset Examples in Python language

Repository: https://github.com/spark-examples/pyspark-examples
Canonical: https://ross.abutalabs.com/products/pyspark-examples
Homepage: https://sparkbyexamples.com
Language: Python
License Family: other
Last push: 2025-12-07T16:27:23+00:00

## Health v2 (maintenance only)
Score: 57/100 (v2, computed 2026-09-02T17:46:02.011165+00:00)
- activity 56, release rhythm 35, longevity 100
- inputs: {"age_days": 2472, "days_push": 269, "days_rel": null, "gap_med": null, "n_releases_24m": 0}
- flags: no_releases, no_license
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 1365, forks 985 (observed 2026-08-28T04:04:31.169622+00:00)

## What it is
A collection of runnable Python example scripts demonstrating PySpark RDD, DataFrame, and SQL operations, companion to the SparkByExamples tutorial site. Each example is a single-file script with sample data for learning Apache Spark in Python.

## Use cases
- learn pyspark dataframe operations with runnable examples
- understand rdd vs dataframe in spark with python code
- find example pyspark join groupby and filter code
- practice spark sql queries in python
- prepare for data engineering interviews on spark
- set up a local pyspark learning environment

## When to choose
- you are learning PySpark and want copy-paste runnable example scripts
- you need quick reference snippets for RDD, DataFrame, or Spark SQL operations
- you follow the sparkbyexamples.com tutorials and want the companion code

## When to avoid
- you need a production data pipeline framework rather than learning material
- you want a maintained library with a license and API guarantees
- you need Scala, Java, or R Spark examples instead of Python

## Facets
- artifact type: learning-resource
- maturity: active
- function: developer-tools, data-science, etl
- domain: big-data, tutorials, data-science
- platform: python, cross-platform, cli
- tags: pyspark, apache-spark, rdd, dataframe, examples, tutorial, spark-sql, big-data, data-engineering

## Member repositories
- spark-examples/pyspark-examples (main) score 57

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:04:31.169622+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-30T04:41:17.134165+00:00, confidence not recorded.
  - readme: https://github.com/spark-examples/pyspark-examples (fetched 2026-08-28T04:04:31.169622+00:00, sha 58dc036ba117)
  - homepage: https://sparkbyexamples.com (fetched 2026-08-29T11:58:47.447336+00:00, sha 12f7a01c37c9)
  - site_page: https://sparkbyexamples.com/about-sparkbyexamples (fetched 2026-08-29T11:58:47.463124+00:00, sha 2443520a3ed2)
  - site_page: https://sparkbyexamples.com/spark/apache-spark-installation-on-windows (fetched 2026-08-29T11:58:47.467840+00:00, sha 71380dc8f464)
  - site_page: https://sparkbyexamples.com/spark/spark-installation-on-linux-ubuntu (fetched 2026-08-29T11:58:47.469755+00:00, sha a9732d62e40f)
  - site_page: https://sparkbyexamples.com/spark/install-apache-spark-on-mac (fetched 2026-08-29T11:58:47.471665+00:00, sha 5d57168c2ce6)
  - site_page: https://sparkbyexamples.com/spark/apache-spark-3-5-0-features (fetched 2026-08-29T11:58:47.473464+00:00, sha cd24e8739793)
  - site_page: https://sparkbyexamples.com/membership-account/membership-levels (fetched 2026-08-29T11:58:47.465778+00:00, sha 417090292fd6)
- Data as of 2026-08-30T08:39:29.467469+00:00.