gocolly/colly
Elegant Scraper and Crawler Framework for Golang observed · 2026-08-28
Health v2 · maintenance only
66/100
- Activity 97
- Release rhythm 8
- Longevity 100
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-02. Adoption (stars, forks) is never an input.
- gap_med: n/a
- age_days: 3260
- days_rel: 524
- days_push: 19
- n_releases_24m: 1
Adoption not part of the score
25483 stars · 1855 forks observed · 2026-08-28
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded
Colly is a fast and elegant web scraping and crawling framework for Go. It provides a clean callback-based API for making HTTP requests, parsing HTML, and extracting structured data, with built-in support for rate limiting, caching, cookies, and distributed scraping.
Use cases
- scrape product prices from e-commerce sites
- crawl a website and extract all links
- build a spider to collect structured data from web pages
- mine data from websites for analysis
- archive web content automatically
- scrape news headlines or comments from sites like Hacker News or Reddit
When to choose
- you need a high-performance scraper in Go
- you want built-in rate limiting, concurrency control, and robots.txt compliance
- you need sync, async, or distributed crawling
- you prefer a clean callback-based API for HTML extraction
When to avoid
- you need to scrape JavaScript-rendered single-page apps (use a headless browser tool instead)
- your project is in Python (Scrapy/BeautifulSoup may fit better)
- you only need a one-off simple HTTP fetch without crawling logic
Facets
framework · maturity stable
web-scraping http-client parser crawlers web-development developer-tools go cross-platform scraper crawler spider html-parsing distributed-scraping robots-txt data-engineering
3 sources
- readme: https://github.com/gocolly/colly · fetched 2026-08-28 · 4aba788dfdfb
- homepage: https://go-colly.org/ · fetched 2026-08-29 · 9a4dcc826b6e
- site_page: https://go-colly.org/docs · fetched 2026-08-29 · 4488744c1021
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| gocolly/colly | main | 66 |
For agents
Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem