# YoongiKim/AutoCrawler

Google, Naver multiprocess image web crawler (Selenium)

Repository: https://github.com/YoongiKim/AutoCrawler
Canonical: https://ross.abutalabs.com/products/autocrawler
Language: Python
License: Apache-2.0
License Family: permissive
Topics: crawler, selenium, deep-learning, image-crawler, chromedriver, bigdata, google, multiprocess, thread, customizable, python
Last push: 2024-04-15T10:15:21+00:00

## Health v2 (maintenance only)
Score: 32/100 (v2, computed 2026-09-02T17:46:02.011165+00:00)
- activity 0, release rhythm 35, longevity 100
- inputs: {"age_days": 2842, "days_push": 870, "days_rel": null, "gap_med": null, "n_releases_24m": 0}
- flags: no_releases
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 1691, forks 423 (observed 2026-08-28T04:05:22.616130+00:00)

## What it is
A Python multiprocess image web crawler that downloads images from Google and Naver image search using Selenium and ChromeDriver. It is designed for building image datasets, with options for full-resolution downloads, face search mode, threading, proxies, and headless operation.

## Use cases
- scrape images from google image search for a dataset
- download training images for a deep learning model
- bulk download images by keyword list
- crawl naver images
- collect face images for face recognition training
- headless image crawling on a remote server

## When to choose
- you need to quickly assemble an image dataset from search engines
- you want a customizable Selenium-based crawler you can patch when sites change
- you need multiprocess downloading with proxy support and headless server operation

## When to avoid
- you need a supported official image API instead of scraping
- you need sources other than Google or Naver without writing your own crawler module
- you need a maintained turnkey scraper with no breakage risk from site changes

## Facets
- artifact type: cli-tool
- maturity: maintenance
- function: web-scraping, cli, image-processing
- domain: crawlers, machine-learning, developer-tools
- platform: python, windows
- tags: image-crawler, selenium, chromedriver, multiprocess, dataset-collection, google-images, naver, linux, macos, docker

## Member repositories
- YoongiKim/AutoCrawler (main) score 32

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:05:22.616130+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-30T03:38:15.791319+00:00, confidence not recorded.
  - readme: https://github.com/YoongiKim/AutoCrawler (fetched 2026-08-28T04:05:22.616130+00:00, sha f29e79d56c18)
- Data as of 2026-08-30T08:39:29.467469+00:00.