lc/gau

Health v2 · maintenance only

Adoption not part of the score

5076 stars · 523 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

gau (getallurls) is a Go CLI tool that fetches known URLs for a given domain from AlienVault's Open Threat Exchange, the Wayback Machine, Common Crawl, and URLScan. It supports filtering by extension, status code, mime type, and date range, with threaded fetching and JSON output.

Use cases

• fetch all known URLs for a domain from historical archives
• enumerate endpoints for bug bounty reconnaissance
• find old or forgotten pages of a website via the Wayback Machine
• filter archived URLs by file extension or HTTP status code
• gather URL lists for security scanning pipelines
• include subdomains when collecting URLs for a target

When to choose

• you need historical/archived URLs for a domain rather than crawling it live
• you want a fast, scriptable CLI that fits into recon pipelines
• you need filtering by extension, status code, mime type, or date range

When to avoid

• you need to crawl a site's current live content rather than archived URLs
• you want a GUI or web interface instead of a command-line tool
• you need real-time vulnerability scanning rather than URL discovery

Facets

cli-tool · maturity active

web-scraping http-client security cli developer-tools security osint crawlers developer-tools windows cli cross-platform recon bug-bounty url-discovery wayback-machine common-crawl alienvault-otx urlscan attack-surface command-line linux macos

Member repositories

For agents

markdown · JSON · MCP: product_card(name="lc/gau")