# jonbakerfish/TweetScraper

TweetScraper is a simple crawler/spider for Twitter Search without using API

Repository: https://github.com/jonbakerfish/TweetScraper
Canonical: https://ross.abutalabs.com/products/tweetscraper
Language: Python
License: GPL-2.0
License Family: copyleft
Topics: twitter-search, scrapy, tweets, twitter
Last push: 2021-04-03T17:33:40+00:00

## Health v2 (maintenance only)
Score: 23/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 0, release rhythm 8, longevity 100
- inputs: {"age_days": 3915, "days_push": 1978, "days_rel": null, "gap_med": null, "n_releases_24m": 0}
- flags: none
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 1062, forks 306 (observed 2026-08-28T04:03:26.109254+00:00)

## What it is
TweetScraper is a Scrapy-based crawler that scrapes tweets and user information from Twitter Search without using Twitter's official APIs. It saves results as JSON files and avoids API rate limits, at the cost of less clean data.

## Use cases
- scrape tweets for a keyword or hashtag
- collect twitter search results without api keys
- gather tweet and user data as  for research
- crawl twitter search results with scrapy
- download tweets mentioning a topic for analysis

## When to choose
- you need tweet data beyond official API rate limits
- you want a simple scrapy-based twitter crawler
- you prefer JSON output of tweets and user info

## When to avoid
- you need clean, structured API-quality data
- you need official API features like streaming or posting
- you need an actively maintained tool for current Twitter/X markup

## Facets
- artifact type: cli-tool
- maturity: maintenance
- function: web-scraping, cli, data-science
- domain: crawlers, social-media, data-science
- platform: python, cli, cross-platform
- tags: twitter, scrapy, selenium, crawler, tweets, -output, linux

## Member repositories
- jonbakerfish/TweetScraper (main) score 23

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:03:26.109254+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-30T06:56:45.164183+00:00, confidence not recorded.
  - readme: https://github.com/jonbakerfish/TweetScraper (fetched 2026-08-28T04:03:26.109254+00:00, sha b218c3f6b1e4)
  - registry_pypi: https://pypi.org/pypi/tweetscraper/json (fetched 2026-08-29T12:58:32.736445+00:00, sha 918d115bf9b5)
- Data as of 2026-08-30T08:39:29.467469+00:00.