palantir/pyspark-style-guide resource
This is a guide to PySpark code style presenting common situations and the associated best practices based on the most frequent recurring topics across the PySpark repos we've encountered. observed · 2026-08-28
Health v2 · maintenance only
51/100
- Activity 41
- Release rhythm 35
- Longevity 100
Flags: no_releases
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-03. Adoption (stars, forks) is never an input.
- gap_med: n/a
- age_days: 2148
- days_rel: n/a
- days_push: 359
- n_releases_24m: 0
Adoption not part of the score
1260 stars · 169 forks observed · 2026-08-28
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded
An opinionated style guide for PySpark code from Palantir, presenting common situations and best practices drawn from recurring patterns across many PySpark repositories. It is documentation rather than software, aimed at helping Python developers write maintainable Spark code.
Use cases
- how to write clean pyspark code
- pyspark column selection best practices
- pyspark code style guide
- best way to reference columns in spark dataframes
- pyspark coding conventions for teams
- learn pyspark idioms for large data pipelines
When to choose
- you are writing or reviewing PySpark code and want opinionated best practices
- you are standardizing code style across a team's Spark repositories
- you are an experienced Python developer new to Spark's JVM-influenced patterns
When to avoid
- you need runnable tooling, linters, or formatters rather than prose guidance
- you work with Scala or Java Spark rather than the PySpark API
- you need a general Python style guide rather than Spark-specific advice
Facets
learning-resource · maturity active
documentation developer-tools big-data developer-tools tutorials python pyspark style-guide code-style spark best-practices clean-code data-engineering
1 source
- readme: https://github.com/palantir/pyspark-style-guide · fetched 2026-08-28 · 2cbd09eb8b45
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| palantir/pyspark-style-guide | main | 51 |
For agents
markdown · JSON · MCP: product_card(name="palantir/pyspark-style-guide")
Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem