s0md3v/uro

Health v2 · maintenance only

Adoption not part of the score

1587 stars · 173 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

uro is a Python CLI tool that declutters URL lists for crawling and security testing without making any HTTP requests. It removes duplicate, incremental, and uninteresting URLs (blogs, images, static assets) and offers filters for extensions, query parameters, and potentially vulnerable parameter patterns.

Use cases

• deduplicate large url lists from crawlers
• filter out static assets like images js and css from url lists
• remove incremental urls like /page/1/ /page/2/ before pentesting
• keep only urls with query parameters for vulnerability scanning
• clean up wayback or gau output for bug bounty recon
• whitelist or blacklist file extensions in a url list

When to choose

• you have a huge url list from a crawler and need only unique, interesting endpoints
• you want fast offline url deduplication with no http requests
• you need granular filtering by extension, parameters, or vulnerable parameter names

When to avoid

• you need to actually fetch or verify urls are alive
• you need full crawling or spidering functionality
• you need browser-based rendering or javascript analysis of pages

Facets

cli-tool · maturity stable

security web-scraping cli developer-tools security penetration-testing crawlers developer-tools cli python windows cross-platform url-deduplication recon bug-bounty url-filtering stdin-stdout command-line linux macos

Member repositories

For agents

markdown · JSON · MCP: product_card(name="s0md3v/uro")