# ArthurHeitmann/arctic_shift

Making Reddit data accessible to researchers, moderators and everyone else.  Interact with the data through large dumps, an API or web interface.

Repository: https://github.com/ArthurHeitmann/arctic_shift
Canonical: https://ross.abutalabs.com/products/arctic_shift
Homepage: https://arctic-shift.photon-reddit.com
Language: TypeScript
License Family: other
Topics: archived, reddit, pushshift
Last push: 2026-08-09T21:15:23+00:00

## Health v2 (maintenance only)
Score: 93/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 96, release rhythm 96, longevity 80
- inputs: {"age_days": 1126, "days_push": 24, "days_rel": 24, "gap_med": 29.5, "n_releases_24m": 25}
- flags: no_license
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 1438, forks 85 (observed 2026-08-28T04:04:43.644755+00:00)

## What it is
Project Arctic Shift is an archive of Reddit data (posts, comments) made accessible through large compressed dumps, a limited API, and a web search interface. It includes helper Python scripts for processing the .zst/.jsonl dump files.

## Use cases
- download historical reddit comments and posts for research
- search archived reddit data by username or subreddit
- analyze reddit social media trends over time
- replace pushshift for reddit data access
- process large compressed reddit dump files in python
- moderation research on deleted reddit content

## When to choose
- you need bulk historical Reddit data for research or analysis
- Pushshift is unavailable and you need an alternative archive
- you want a web interface or API to query archived Reddit content

## When to avoid
- you need real-time Reddit data rather than archived dumps
- you need a fully supported API with SLAs - the API is explicitly limited
- you require a formally licensed dataset - the repository has no license

## Facets
- artifact type: dataset
- maturity: active
- function: search-engine, data-science, web-scraping, etl
- domain: social-media, data-science, analytics
- platform: python, cross-platform
- tags: reddit, pushshift, archived-data, social-media-archive, jsonl, zstandard, data-dumps, research, web-server

## Member repositories
- ArthurHeitmann/arctic_shift (main) score 93

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:04:43.644755+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-30T04:36:38.067995+00:00, confidence not recorded.
  - readme: https://github.com/ArthurHeitmann/arctic_shift (fetched 2026-08-28T04:04:43.644755+00:00, sha db4786769a39)
  - homepage: https://arctic-shift.photon-reddit.com (fetched 2026-08-29T11:47:22.035877+00:00, sha 49ee7afd680c)
- Data as of 2026-08-30T08:39:29.467469+00:00.