# alex000kim/nsfw_data_scraper

Collection of scripts to aggregate image data for the purposes of training an NSFW Image Classifier

Repository: https://github.com/alex000kim/nsfw_data_scraper
Canonical: https://ross.abutalabs.com/products/nsfw_data_scraper
Language: Shell
License: MIT
License Family: permissive
Topics: nsfw-classifier, nsfw, deep-learning, content-moderation, pornography, machine-learning
Last push: 2024-01-21T23:49:42+00:00

## Health v2 (maintenance only)
Score: 32/100 (v2, computed 2026-09-03T02:39:23.370411+00:00)
- activity 0, release rhythm 35, longevity 100
- inputs: {"age_days": 2792, "days_push": 955, "days_rel": null, "gap_med": null, "n_releases_24m": 0}
- flags: no_releases
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 12588, forks 2843 (observed 2026-08-28T04:10:59.377144+00:00)

## What it is
A collection of shell scripts that automatically aggregate tens of thousands of images across five categories (porn, hentai, sexy, neutral, drawings) for training an NSFW image classifier. It runs inside Docker and produces train/test splits ready for CNN training with fastai.

## Use cases
- build a dataset for training an NSFW image classifier
- collect labeled images for content moderation model training
- scrape images from subreddits into train/test splits
- create a porn vs safe-for-work image classification dataset
- gather neutral and adult image categories for deep learning experiments

## When to choose
- you need a large, pre-categorized NSFW image dataset for training a classifier
- you want an automated, Docker-based scraping pipeline with train/test splitting
- you are building content moderation tooling and need training data

## When to avoid
- you need a clean, curated dataset - the authors warn the data is noisy
- you need a production-ready classifier rather than raw training data
- your environment cannot run Docker or long-running scraping jobs

## Facets
- artifact type: dataset
- maturity: maintenance
- function: web-scraping, image-processing, machine-learning, data-generation
- domain: machine-learning, computer-vision, image-processing
- platform: -
- tags: nsfw-classifier, content-moderation, image-classification, dataset-collection, shell-scripts, deep-learning, docker, linux, shell

## Member repositories
- alex000kim/nsfw_data_scraper (main) score 32

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:10:59.377144+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-29T17:13:56.760119+00:00, confidence not recorded.
  - readme: https://github.com/alex000kim/nsfw_data_scraper (fetched 2026-08-28T04:10:59.377144+00:00, sha bbd52e7c591d)
- Data as of 2026-08-30T08:39:29.467469+00:00.