# s0md3v/uro

declutters url lists for crawling/pentesting

Repository: https://github.com/s0md3v/uro
Canonical: https://ross.abutalabs.com/products/uro
Language: Python
License: Apache-2.0
License Family: permissive
Last push: 2025-02-23T11:53:31+00:00

## Health v2 (maintenance only)
Score: 29/100 (v2, computed 2026-09-02T17:46:02.011165+00:00)
- activity 8, release rhythm 16, longevity 100
- inputs: {"age_days": 1830, "days_push": 556, "days_rel": 556, "gap_med": 112, "n_releases_24m": 2}
- flags: none
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 1587, forks 173 (observed 2026-08-28T04:05:07.801661+00:00)

## What it is
uro is a Python CLI tool that declutters URL lists for crawling and security testing without making any HTTP requests. It removes duplicate, incremental, and uninteresting URLs (blogs, images, static assets) and offers filters for extensions, query parameters, and potentially vulnerable parameter patterns.

## Use cases
- deduplicate large url lists from crawlers
- filter out static assets like images js and css from url lists
- remove incremental urls like /page/1/ /page/2/ before pentesting
- keep only urls with query parameters for vulnerability scanning
- clean up wayback or gau output for bug bounty recon
- whitelist or blacklist file extensions in a url list

## When to choose
- you have a huge url list from a crawler and need only unique, interesting endpoints
- you want fast offline url deduplication with no http requests
- you need granular filtering by extension, parameters, or vulnerable parameter names

## When to avoid
- you need to actually fetch or verify urls are alive
- you need full crawling or spidering functionality
- you need browser-based rendering or javascript analysis of pages

## Facets
- artifact type: cli-tool
- maturity: stable
- function: security, web-scraping, cli, developer-tools
- domain: security, penetration-testing, crawlers, developer-tools
- platform: cli, python, windows, cross-platform
- tags: url-deduplication, recon, bug-bounty, url-filtering, stdin-stdout, command-line, linux, macos

## Member repositories
- s0md3v/uro (main) score 29

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:05:07.801661+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-30T03:55:26.406056+00:00, confidence not recorded.
  - readme: https://github.com/s0md3v/uro (fetched 2026-08-28T04:05:07.801661+00:00, sha 69626d24dfa0)
  - registry_pypi: https://pypi.org/pypi/uro/json (fetched 2026-08-29T11:25:56.556435+00:00, sha 8f0674bd9335)
- Data as of 2026-08-30T08:39:29.467469+00:00.