Ross ROSS = Recommend OSS · open-source software intelligence for agents

JayBizzle/Crawler-Detect

🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent observed · 2026-08-28

github.com/JayBizzle/Crawler-Detect · homepage · PHP · MIT (permissive) observed · 2026-08-28

Health v2 · maintenance only

95/100

  • Activity 95
  • Release rhythm 92
  • Longevity 100
How is this computed?

round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-03. Adoption (stars, forks) is never an input.

  • gap_med: 28
  • age_days: 4181
  • days_rel: 54
  • days_push: 34
  • n_releases_24m: 16

Full methodology

Adoption not part of the score

2400 stars · 280 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

CrawlerDetect is a zero-dependency PHP library that detects bots, crawlers, and spiders by matching User-Agent and HTTP_FROM headers against thousands of community-maintained signatures. It exposes a tiny three-method API (isCrawler, getMatches, setUserAgent) and works standalone or with frameworks like Laravel, Symfony, and Yii.

Use cases

  • detect bots visiting my php site
  • check if a user agent is a crawler
  • block spiders and scrapers in laravel
  • identify googlebot from request headers
  • filter bot traffic from analytics
  • detect crawlers from psr-7 request headers

When to choose

  • you need lightweight, offline bot detection in PHP with no external API calls
  • you want a simple drop-in class with zero dependencies
  • you need to inspect headers from PSR-7, Symfony, Swoole, or Lambda requests

When to avoid

  • you need behavioral bot detection beyond user-agent matching
  • you require real-time IP reputation or JavaScript fingerprinting
  • you are not working in PHP or a language with a community port

Facets

library · maturity active

security nlp web-development security developer-tools php bot-detection user-agent crawler-detection zero-dependency

2 sources

Member repositories

RepositoryRoleHealth v2
JayBizzle/Crawler-Detectmain95

For agents

markdown · JSON · MCP: product_card(name="JayBizzle/Crawler-Detect")

Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem