markfasheh/duperemove
Some data may be outdated — see provenance labels.
Tools for deduping file systems observed · 2026-09-21
Health v2 · maintenance only
47/100
- Activity 38
- Release rhythm 28
- Longevity 100
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-10-21. Adoption (stars, forks) is never an input.
- gap_med: 49.5
- age_days: 4935
- days_rel: 524
- days_push: 374
- n_releases_24m: 3
Adoption not part of the score
1008 stars · 104 forks observed · 2026-09-21
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded
Duperemove is a Linux command-line tool that finds duplicate file extents by hashing file contents and submits them for deduplication via the kernel FIDEDUPRANGE ioctl. It supports incremental runs through a persistent hashfile so unchanged data is not re-hashed.
Use cases
- free up disk space by deduplicating duplicate file blocks on btrfs or xfs
- find duplicate files and extents on a linux filesystem
- run repeated dedupe scans without re-hashing unchanged files
- dedupe a large directory tree recursively
- reduce storage usage on a backup or media server
When to choose
- you run Linux with a reflink-capable filesystem like btrfs or xfs and want kernel-level deduplication
- you want incremental dedupe with a persistent hashfile
- you need a fast C tool with multithreaded hashing
When to avoid
- you are on macOS, Windows, or a filesystem without FIDEDUPRANGE support
- you need cross-platform duplicate file finding rather than block-level dedupe
- you want automatic, scheduled deduplication without scripting it yourself
Facets
cli-tool · maturity active
file-system compression cli developer-tools files developer-tools cli deduplication btrfs xfs hashfile storage-optimization fiduprange command-line linux
1 source
- readme: https://github.com/markfasheh/duperemove · fetched 2026-09-21 · 9266e70b2baf
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| markfasheh/duperemove | main | 47 |
For agents
markdown · JSON · MCP: product_card(name="markfasheh/duperemove")
Data as of 2026-10-19T08:05:51.212177+00:00 · Report a problem