psf/requests-html

Health v2 · maintenance only

Adoption not part of the score

13814 stars · 999 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

A Python library that combines HTTP requests with intuitive HTML parsing, offering CSS selector and XPath support plus JavaScript rendering via Chromium. It provides both sync and async sessions with a Requests-like API.

Use cases

• scrape data from web pages in python
• parse html with css selectors
• render javascript-heavy pages before scraping
• extract all links from a webpage
• fetch and parse multiple sites concurrently
• convert html elements to markdown

When to choose

• you want a Requests-style API with built-in HTML parsing
• you need simple scraping with optional JS rendering
• you want both sync and async scraping in one library

When to avoid

• you need a large-scale, high-performance scraping framework like Scrapy
• the project appears minimally maintained and depends on outdated pyppeteer
• you only need parsing without HTTP - use BeautifulSoup or lxml directly

Facets

library · maturity maintenance

web-scraping parser http-client web-development crawlers developer-tools python cross-platform html-parsing css-selectors xpath javascript-rendering pyppeteer async requests

Member repositories

For agents

markdown · JSON · MCP: product_card(name="psf/requests-html")