markfasheh/duperemove
Tools for deduping file systems observed · 2026-08-28
Health v2 · maintenance only
50/100
- Activity 46
- Release rhythm 28
- Longevity 100
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-02. Adoption (stars, forks) is never an input.
- gap_med: 49.5
- age_days: 4887
- days_rel: 476
- days_push: 326
- n_releases_24m: 3
Adoption not part of the score
1005 stars · 103 forks observed · 2026-08-28
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded
Duperemove is a Linux command-line tool that finds duplicate file extents by hashing file contents and submits them for deduplication via the kernel FIDEDUPRANGE ioctl. It supports incremental runs through a persistent hashfile so unchanged data is not re-hashed.
Use cases
- free up disk space by deduplicating duplicate file blocks on btrfs or xfs
- find duplicate files and extents on a linux filesystem
- run repeated dedupe scans without re-hashing unchanged files
- dedupe a large directory tree recursively
- reduce storage usage on a backup or media server
When to choose
- you run Linux with a reflink-capable filesystem like btrfs or xfs and want kernel-level deduplication
- you want incremental dedupe with a persistent hashfile
- you need a fast C tool with multithreaded hashing
When to avoid
- you are on macOS, Windows, or a filesystem without FIDEDUPRANGE support
- you need cross-platform duplicate file finding rather than block-level dedupe
- you want automatic, scheduled deduplication without scripting it yourself
Facets
cli-tool · maturity active
file-system compression cli developer-tools files developer-tools cli deduplication btrfs xfs hashfile storage-optimization fiduprange command-line linux
1 source
- readme: https://github.com/markfasheh/duperemove · fetched 2026-08-28 · 9266e70b2baf
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| markfasheh/duperemove | main | 50 |
For agents
markdown · JSON · MCP: product_card(name="markfasheh/duperemove")
Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem