zorlan/skycaiji

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

2089 stars · 608 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

SkyCaiji (蓝天采集器) is an open-source, PHP+MySQL based visual web scraping system where users define collection rules by point-and-click in a browser. It supports multi-level/paginated crawling, browser-rendered pages, regex/XPath/JSON extraction, and automatic publishing to CMS platforms, databases, files, or API endpoints.

Use cases

• scrape website data without coding
• collect articles and publish to a CMS automatically
• extract data from paginated multi-level pages
• gather training data for LLM/AIGC applications
• schedule automated recurring web scraping tasks
• export scraped data to Excel or a database
• scrape JavaScript-rendered pages with a simulated browser
• serve collected data through a REST API

When to choose

• you want a self-hosted, browser-based visual scraper with no coding
• you need to publish scraped content directly into CMS platforms
• you run PHP hosting or shared virtual hosts and want a cross-platform crawler
• you need scheduled, fully automated collection with proxy rotation

When to avoid

• you need a programmable scraping library to embed in your own code
• your stack is Python/Node and you prefer code-first frameworks like Scrapy or Playwright
• you need large-scale distributed crawling beyond a single PHP server
• you require a license without restrictions (license is non-standard)

Facets

application · maturity active

web-scraping etl parser workflow-automation scheduling plugin-system crawlers web-development cms php self-hosted windows cross-platform visual-scraping no-code-crawler cms-integration proxy-rotation browser-rendering data-publishing cloud-deployable data-engineering automation web-server linux docker

Member repositories

For agents

markdown · JSON · MCP: product_card(name="zorlan/skycaiji")