# howie6879/ruia

Async Python 3.6+ web scraping micro-framework based on asyncio

Repository: https://github.com/howie6879/ruia
Canonical: https://ross.abutalabs.com/products/ruia
Homepage: https://www.howie6879.com/ruia/
Language: Python
License: Apache-2.0
License Family: permissive
Topics: asyncio, aiohttp, asyncio-spider, crawler, crawling-framework, spider, uvloop, ruia, python-ruia, middlewares, python
Last push: 2023-07-01T08:23:28+00:00

## Health v2 (maintenance only)
Score: 23/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 0, release rhythm 8, longevity 100
- inputs: {"age_days": 2977, "days_push": 1159, "days_rel": null, "gap_med": null, "n_releases_24m": 0}
- flags: none
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 1738, forks 185 (observed 2026-08-28T04:05:30.008630+00:00)

## What it is
Ruia is an async web scraping micro-framework for Python 3.6+ built on asyncio and aiohttp. It offers declarative Item/Field extraction (XPath, CSS selectors), spider control, and extensibility through middlewares and plugins.

## Use cases
- scrape product prices from e-commerce sites
- crawl multiple pages concurrently with asyncio
- extract structured data from HTML using CSS selectors or XPath
- build a custom web crawler with middlewares
- fetch and parse Hacker News-style listing pages
- write an async spider without heavy frameworks like Scrapy

## When to choose
- you want a lightweight, asyncio-native alternative to Scrapy
- you prefer declarative item definitions with XPath/CSS extraction
- you need fine-grained control via middlewares and plugins
- your scraping workload benefits from async concurrency

## When to avoid
- you need distributed crawling out of the box (still a TODO)
- you require heavy JavaScript rendering without adding plugins
- you need a framework with a large ecosystem and long-term commercial support
- you are on Python older than 3.6

## Facets
- artifact type: framework
- maturity: maintenance
- function: web-scraping, http-client, middleware, plugin-system
- domain: crawlers, web-development
- platform: python, windows, cross-platform
- tags: asyncio, aiohttp, spider, crawler, declarative, uvloop, micro-framework, automation, linux, macos

## Member repositories
- howie6879/ruia (main) score 23

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:05:30.008630+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-30T03:30:36.537846+00:00, confidence not recorded.
  - readme: https://github.com/howie6879/ruia (fetched 2026-08-28T04:05:30.008630+00:00, sha 2fd443b15765)
  - homepage: https://www.howie6879.com/ruia/ (fetched 2026-08-29T11:07:49.225384+00:00, sha ebdda3f6b488)
  - site_page: https://www.howie6879.com/ruia/docs/00_%E5%BF%AB%E9%80%9F%E5%BC%80%E5%A7%8B (fetched 2026-08-29T11:07:49.234197+00:00, sha 3811bc3dc38b)
  - site_page: https://www.howie6879.com/ruia/docs/01_%E5%85%A5%E9%97%A8%E6%8C%87%E5%8D%97/1.%E6%A6%82%E8%A7%88 (fetched 2026-08-29T11:07:49.236298+00:00, sha 134732b9aaa2)
  - site_page: https://www.howie6879.com/ruia/docs/01_%E5%85%A5%E9%97%A8%E6%8C%87%E5%8D%97/2.%E5%AE%89%E8%A3%85 (fetched 2026-08-29T11:07:49.238060+00:00, sha e993a32010ca)
  - site_page: https://www.howie6879.com/ruia/docs/01_%E5%85%A5%E9%97%A8%E6%8C%87%E5%8D%97/3.%E5%AE%9A%E4%B9%89-Item (fetched 2026-08-29T11:07:49.239951+00:00, sha eb3d1a3d36ba)
  - site_page: https://www.howie6879.com/ruia/docs/01_%E5%85%A5%E9%97%A8%E6%8C%87%E5%8D%97/4.%E8%BF%90%E8%A1%8C-Spider (fetched 2026-08-29T11:07:49.241840+00:00, sha a2bb226da8f5)
  - site_page: https://www.howie6879.com/ruia/docs/01_%E5%85%A5%E9%97%A8%E6%8C%87%E5%8D%97/5.%E4%B8%AA%E6%80%A7%E5%8C%96 (fetched 2026-08-29T11:07:49.243895+00:00, sha f011edb50871)
  - site_page: https://www.howie6879.com/ruia/docs/01_%E5%85%A5%E9%97%A8%E6%8C%87%E5%8D%97/6.%E6%8F%92%E4%BB%B6 (fetched 2026-08-29T11:07:49.245774+00:00, sha e4c59898e1fb)
  - site_page: https://www.howie6879.com/ruia/docs/01_%E5%85%A5%E9%97%A8%E6%8C%87%E5%8D%97/7.%E5%B8%AE%E5%8A%A9 (fetched 2026-08-29T11:07:49.247565+00:00, sha e4b2899a38af)
- Data as of 2026-08-30T08:39:29.467469+00:00.