# bjesus/pipet

Swiss-army tool for scraping and extracting data from online assets, made for hackers

Repository: https://github.com/bjesus/pipet
Canonical: https://ross.abutalabs.com/products/pipet
Language: Go
License: MIT
License Family: permissive
Topics: css, curl, gjson, json, playwright, scraper, scraping
Last push: 2024-10-12T07:47:38+00:00

## Health v2 (maintenance only)
Score: 24/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 0, release rhythm 40, longevity 52
- inputs: {"age_days": 732, "days_push": 690, "days_rel": 690, "gap_med": 5, "n_releases_24m": 6}
- flags: none
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 4772, forks 220 (observed 2026-08-28T04:08:59.434766+00:00)

## What it is
Pipet is a command-line web scraper written in Go that extracts data from online assets using HTML parsing, JSON parsing, and client-side JavaScript evaluation via Playwright. It composes with curl and Unix pipes, supports JSON output, templating, and change monitoring with notifications.

## Use cases
- scrape data from web pages from the command line
- extract fields from JSON APIs
- render JavaScript-heavy pages and extract content
- monitor a page for changes and get notified
- track stock prices or ticket availability
- pipe scraped values through shell commands like wc or htmlq

## When to choose
- you want a lightweight terminal-based scraper with Unix-pipe composability
- you need to mix HTML, JSON, and JS-rendered extraction in one tool
- you want simple change monitoring with custom commands on change

## When to avoid
- you need large-scale distributed crawling or proxy rotation
- you prefer a GUI or browser-based scraping tool
- you need a library API to embed scraping in an application

## Facets
- artifact type: cli-tool
- maturity: active
- function: web-scraping, parser, cli, developer-tools
- domain: crawlers, developer-tools
- platform: cli, cross-platform, windows
- tags: html-parsing, -parsing, playwright, curl, unix-pipes, monitoring, go, command-line, automation, linux, macos

## Member repositories
- bjesus/pipet (main) score 24

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:08:59.434766+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-29T18:18:47.165466+00:00, confidence not recorded.
  - readme: https://github.com/bjesus/pipet (fetched 2026-08-28T04:08:59.434766+00:00, sha 86d6ccfd2d4c)
- Data as of 2026-08-30T08:39:29.467469+00:00.