# lc/gau

Fetch known URLs from AlienVault's Open Threat Exchange, the Wayback Machine, and Common Crawl.

Repository: https://github.com/lc/gau
Canonical: https://ross.abutalabs.com/products/gau
Language: Go
License: MIT
License Family: permissive
Topics: gau, wayback-machine, hacktoberfest, security, alienvault
Last push: 2026-03-20T18:36:42+00:00

## Health v2 (maintenance only)
Score: 56/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 73, release rhythm 8, longevity 100
- inputs: {"age_days": 2382, "days_push": 166, "days_rel": 674, "gap_med": null, "n_releases_24m": 1}
- flags: none
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 5076, forks 523 (observed 2026-08-28T04:09:09.456723+00:00)

## What it is
gau (getallurls) is a Go CLI tool that fetches known URLs for a given domain from AlienVault's Open Threat Exchange, the Wayback Machine, Common Crawl, and URLScan. It supports filtering by extension, status code, mime type, and date range, with threaded fetching and JSON output.

## Use cases
- fetch all known URLs for a domain from historical archives
- enumerate endpoints for bug bounty reconnaissance
- find old or forgotten pages of a website via the Wayback Machine
- filter archived URLs by file extension or HTTP status code
- gather URL lists for security scanning pipelines
- include subdomains when collecting URLs for a target

## When to choose
- you need historical/archived URLs for a domain rather than crawling it live
- you want a fast, scriptable CLI that fits into recon pipelines
- you need filtering by extension, status code, mime type, or date range

## When to avoid
- you need to crawl a site's current live content rather than archived URLs
- you want a GUI or web interface instead of a command-line tool
- you need real-time vulnerability scanning rather than URL discovery

## Facets
- artifact type: cli-tool
- maturity: active
- function: web-scraping, http-client, security, cli, developer-tools
- domain: security, osint, crawlers, developer-tools
- platform: windows, cli, cross-platform
- tags: recon, bug-bounty, url-discovery, wayback-machine, common-crawl, alienvault-otx, urlscan, attack-surface, command-line, linux, macos

## Member repositories
- lc/gau (main) score 56

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:09:09.456723+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-29T18:02:36.777183+00:00, confidence not recorded.
  - readme: https://github.com/lc/gau (fetched 2026-08-28T04:09:09.456723+00:00, sha 789e27ecb27f)
- Data as of 2026-08-30T08:39:29.467469+00:00.