oxylabs/ai-scraper-py

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

1055 stars · 3 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

AI-Scraper is a Python library and scrape agent from Oxylabs AI Studio that extracts data from webpages using natural language prompts instead of CSS/XPath selectors. It returns structured JSON or Markdown, with automatic schema generation from prompts or user-defined OpenAPI schemas.

Use cases

• extract product names and prices from e-commerce pages with a plain English prompt
• scrape a webpage into markdown for AI/LLM workflows
• generate a JSON schema automatically from a natural language description of the data I want
• parse news articles or blog content without writing custom parsers
• integrate AI-powered web extraction into automation pipelines
• get structured JSON from any public webpage for APIs

When to choose

• you want to extract data from a single webpage without maintaining CSS/XPath selectors
• you prefer describing extraction targets in natural language
• you need both JSON and Markdown output formats for AI pipelines
• you already have or plan to get an Oxylabs AI Studio API key

When to avoid

• you need fully self-hosted scraping with no external API dependency
• you require bulk crawling of many pages rather than single-page extraction
• you cannot rely on a paid third-party service (API key and credits required)
• you need a battle-tested, long-term-stable library with a clear license

Facets

library · maturity experimental

web-scraping nlp llm-inference sdk parser data-science crawlers artificial-intelligence developer-tools python cli cloud ai-scraper web-scraping scrape-agent natural-language-extraction schema-generation oxylabs firecrawl-alternative tavily-alternative markdown-output -output data-engineering automation

Member repositories

For agents

markdown · JSON · MCP: product_card(name="oxylabs/ai-scraper-py")