gocolly/colly
Elegant Scraper and Crawler Framework for Golang observed · 2026-10-15
Health v2 · maintenance only
67/100
- Activity 98
- Release rhythm 8
- Longevity 100
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-10-21. Adoption (stars, forks) is never an input.
- gap_med: n/a
- age_days: 3308
- days_rel: 572
- days_push: 15
- n_releases_24m: 1
Adoption not part of the score
25552 stars · 1862 forks observed · 2026-10-15
What it is AI-extracted, prompt v1, taxonomy v1, 2026-10-12, confidence 0.99
Colly is a Go library that provides a clean, fast API for building web scrapers and crawlers. It supports synchronous, asynchronous, and parallel scraping with features like request throttling, caching, and robots.txt compliance.
Use cases
- scrape product data from e‑commerce sites
- crawl news articles for sentiment analysis
- extract structured information from public directories
- monitor price changes across multiple websites
- collect data for research or market analysis
- automate data collection for SEO audits
When to choose
- You need a high‑performance scraper written in Go.
- You require fine‑grained control over request concurrency and delays.
- You want built‑in support for cookies, sessions, and robots.txt.
- You plan to run distributed scraping jobs or integrate with Redis.
When to avoid
- You prefer a no‑code or low‑code scraping solution.
- Your project is in a language other than Go.
- You need a visual UI for building scrapers.
- You require advanced anti‑bot evasion features not provided out of the box.
Facets
library · maturity active
http-client web-scraping caching parser web-development data-science go windows cross-platform fast elegant async parallel robots-txt rate-limiting session-handling distributed-scraping data-engineering linux macos
3 sources
- readme: https://github.com/gocolly/colly · fetched 2026-10-15 · 76ae63595b98
- homepage: https://go-colly.org/ · fetched 2026-09-28 · e534022ebbb1
- site_page: https://go-colly.org/docs · fetched 2026-09-28 · 4488744c1021
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| gocolly/colly | main | 67 |
For agents
Data as of 2026-10-19T08:05:51.212177+00:00 · Report a problem