# wistbean/learn_python3_spider

python爬虫教程系列、从0到1学习python爬虫，包括浏览器抓包，手机APP抓包，如 fiddler、mitmproxy，各种爬虫涉及的模块的使用，如：requests、beautifulSoup、selenium、appium、scrapy等，以及IP代理，验证码识别，Mysql，MongoDB数据库的python使用，多线程多进程爬虫的使用，css 爬虫加密逆向破解，JS爬虫逆向，分布式爬虫，爬虫项目实战实例等

Repository: https://github.com/wistbean/learn_python3_spider
Canonical: https://ross.abutalabs.com/products/learn_python3_spider
Homepage: http://fxxkpython.com
Language: Python
License: MIT
License Family: permissive
Topics: python3, python-script, python-spider
Last push: 2026-07-25T09:59:15+00:00

## Health v2 (maintenance only)
Score: 75/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 94, release rhythm 35, longevity 100
- inputs: {"age_days": 2710, "days_push": 39, "days_rel": null, "gap_med": null, "n_releases_24m": 0}
- flags: no_releases
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 22033, forks 3912 (observed 2026-08-28T04:11:32.333306+00:00)

## What it is
A Chinese-language tutorial series and example code repository teaching Python web scraping from zero to advanced, covering packet capture (Fiddler, mitmproxy), libraries like requests, BeautifulSoup, Selenium, Appium, and Scrapy, plus IP proxies, captcha recognition, JS reverse engineering, and distributed crawling. It is a curated collection of lessons with accompanying Python scripts rather than a reusable library.

## Use cases
- learn python web scraping from scratch
- tutorial for scrapy and selenium crawling
- how to capture mobile app traffic with fiddler or mitmproxy
- bypass anti-scraping with ip proxy pools
- reverse engineer javascript-encrypted web requests
- build a distributed crawler in python
- scrape websites with requests and beautifulsoup

## When to choose
- you want a structured, example-driven path to learn Python scraping in Chinese
- you need sample code for proxies, captchas, or JS reverse engineering
- you are a beginner who wants tutorials from zero experience

## When to avoid
- you need a production-ready scraping framework or library to import
- you require English-language documentation
- you want actively maintained, tested software rather than tutorial snippets

## Facets
- artifact type: learning-resource
- maturity: active
- function: web-scraping, parser, developer-tools
- domain: crawlers, tutorials, web-development
- platform: python, cross-platform
- tags: python3, scrapy, selenium, beautifulsoup, mitmproxy, anti-scraping, chinese-language, python

## Member repositories
- wistbean/learn_python3_spider (main) score 75

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:11:32.333306+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-29T16:57:44.229225+00:00, confidence not recorded.
  - readme: https://github.com/wistbean/learn_python3_spider (fetched 2026-08-28T04:11:32.333306+00:00, sha face15a33d5f)
  - homepage: http://fxxkpython.com (fetched 2026-08-29T07:55:58.576444+00:00, sha 877eebc451db)
- Data as of 2026-08-30T08:39:29.467469+00:00.