function: web-scraping
1985 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| EvilCult/Video-Downloader A Python-based desktop application that resolves the real video file URLs from Chinese video sites (Youku, Tudou, LeTV, Sohu, Bilibili, AcF… | 23 | 1446 | abandoned |
| yask123/Instant-Music-Downloader A Python CLI tool that downloads songs from the web given a song name, lyrics snippet, or artist, and embeds ID3 metadata (title, artist, a… | 23 | 1445 | abandoned |
| jamesturk/scrapeghost scrapeghost is an experimental Python library that uses OpenAI's GPT models to scrape structured data from websites without writing page-sp… | 49 | 1442 | abandoned |
| dark-kingA/superSearchPlus superSearchPlus is a Chrome browser extension that aggregates information gathering for white-hat hackers, integrating common asset mapping… | 32 | 1436 | abandoned |
| mafintosh/torrent-mount A Node.js CLI tool that mounts torrents or magnet links as a filesystem in real time using torrent-stream and FUSE. Files appear in a mount… | 32 | 1415 | abandoned |
| OpnTec/parliament-scraper A collection of scrapers (in Python, Ruby, and Scala) that download public parliamentary data such as written questions from the EU Parliam… | 32 | 1403 | abandoned |
| DocNow/twarc twarc is a command line tool and Python library for collecting and archiving Twitter JSON data via the Twitter v1.1 and v2 APIs. It was dev… | 50 | 1394 | abandoned |
| leonardocardoso/SwiftLinkPreview A Swift library that generates link previews from URLs by extracting titles, relevant text, and images. It supports iOS, macOS, watchOS, an… | 10 | 1385 | abandoned |
| regenrek/deepwiki-mcp An unofficial MCP server that fetches deepwiki.com documentation, crawls its pages, converts them to Markdown, and serves them to MCP-compa… | 52 | 1383 | abandoned |
| SamyPesse/tv.js A Node.js smart TV application that searches for movies via iTunes' API and isoHunt, then streams them over BitTorrent directly to a TV-con… | 32 | 1364 | abandoned |
| dinubs/jam-api Jam API is a hosted service (self-hostable Node.js app) that turns any website into a JSON API by extracting data using CSS query selectors… | 32 | 1363 | abandoned |
| Vespa314/bilibili-api A collection of Bilibili (B站) API documentation and Python tooling for scraping video, user, comment, danmaku, and bangumi data. It include… | 32 | 1357 | abandoned |
| romannurik/LayerVisualizer A simple web-based 3D layer visualizer for visualizing material UIs and other designs involving depth and shadows. It also includes a layou… | 32 | 1349 | abandoned |
| filamentgroup/SocialCount SocialCount is a small jQuery plugin providing progressively enhanced, lazy-loaded social sharing widgets for Facebook, Twitter, and Google… | 10 | 1348 | abandoned |
| Jefferson-Henrique/GetOldTweets-python A Python library that retrieves old tweets by mimicking the JSON calls Twitter Search makes in the browser, bypassing the official API's ti… | 32 | 1340 | abandoned |
| rhiever/TwitterFollowBot A Python library that automates Twitter actions such as following users and favoriting tweets via the Twitter API. It is explicitly no long… | 23 | 1333 | abandoned |
| aki66938/xhs-toolkit A Python MCP toolkit for Xiaohongshu (RED) creators that lets AI clients like Claude Desktop publish image/video notes, manage login cookie… | 60 | 1332 | abandoned |
| rialto-php/puphpeteer PuPHPeteer is a PHP library that bridges to Puppeteer via Node, exposing the full Puppeteer API for controlling headless Chrome from PHP co… | 10 | 1331 | abandoned |
| acheong08/ChatGPTProxy A Go-based proxy server that bypasses Cloudflare protection on ChatGPT using TLS spoofing, exposing ChatGPT through an API-like interface. … | 10 | 1330 | abandoned |
| wintercn/dog-fucked-zhihu A browser plugin (userscript) that helps users quit Zhihu by backing up their answers, removing all upvotes, and batch-replacing or deletin… | 32 | 1317 | abandoned |
| adyzng/jd-autobuy A Python 2.7 command-line scraper that logs into JD.com (via QR code or credentials), monitors product stock and price, and automatically p… | 32 | 1309 | abandoned |
| Skyexu/TopSup A Python CLI assistant for live trivia quiz apps like 冲顶大会 (Top Hero) that captures Android phone screenshots via ADB, OCRs the question an… | 32 | 1302 | abandoned |
| defaultnamehere/zzzzz A Python application that continuously collects Facebook friends' activity data and generates graphs visualizing when they are online or ac… | 32 | 1299 | abandoned |
| szdc/tiktok-api An unofficial, reverse-engineered TypeScript API wrapper for TikTok (formerly Musical.ly), published as the npm package tiktok-api. It lets… | 10 | 1292 | abandoned |
| mov-cli/mov-cli mov-cli is a Python CLI tool that lets users search for and stream movies and TV shows directly from the terminal, using a plugin system to… | 54 | 1290 | abandoned |
| LiuRoy/zhihu_spider A Scrapy-based web crawler that scrapes Zhihu user profiles and their follower/following relationship graphs, storing data in MongoDB. It s… | 32 | 1282 | abandoned |
| zhaoxianjin/91porn An unofficial Android client for the adult video site 91Porn, built with RxJava, Retrofit, RxCache, MVP, and Jsoup. It bypasses the guest l… | 32 | 1271 | abandoned |
| hilongjw/vue-zhihu-daily A single-page web application that presents Zhihu Daily content, built with Vue.js on the frontend and Node.js/Express on the backend. It o… | 32 | 1268 | abandoned |
| MiningCattiva/x-spider X-Spider is a desktop media downloader for X (Twitter) that fetches images and videos from accounts. It supports media filters, configurabl… | 10 | 1261 | abandoned |
| breakdowns/slam-mirrorbot Slam Mirror Bot is a Python-based multipurpose Telegram bot that mirrors files from torrents, direct links, Mega, and Telegram to Google Dr… | 10 | 1256 | abandoned |
| vaycore/OneScan OneScan is a BurpSuite extension written in Java for recursive directory scanning, helping discover hidden vulnerabilities in deeper direct… | 10 | 1251 | abandoned |
| n0tr00t/Sreg Sreg is a Python CLI OSINT tool that checks whether an email, phone number, or username has been used to register accounts across many Chin… | 32 | 1246 | abandoned |
| Zeal-L/BiliBili-Manga-Downloader A GUI-based Bilibili Manga downloader built with Python and PySide6 that supports keyword search, QR-code login, multi-threaded downloads, … | 36 | 1242 | abandoned |
| syrusakbary/gdom GDOM is a Python CLI tool that lets you scrape and traverse web page DOM using GraphQL queries, built on the Graphene framework. You write … | 32 | 1242 | abandoned |
| prose-intelligence-ltd/Telepathy-Community Telepathy-Community is a Python command-line OSINT toolkit for collecting and analyzing public Telegram chats, including archiving messages… | 76 | 1235 | abandoned |
| the-robot/sqliv SQLiv is a Python command-line tool that scans websites for SQL injection vulnerabilities. It supports dork-based scanning via search engin… | 10 | 1229 | abandoned |
| 0xlousie/OSIF OSIF is a Python command-line tool that gathers sensitive information from Facebook accounts, such as residence, date of birth, occupation,… | 32 | 1223 | abandoned |
| eprendre/tingshu An Android app for streaming audiobooks from multiple free online audiobook sites, written in Kotlin. It supports user-written custom sourc… | 59 | 1221 | abandoned |
| chenjiandongx/mzitu A Python web crawler that downloads full photo galleries from mzitu.com, collecting over 3,000 image sets. It also performs word-frequency … | 32 | 1220 | abandoned |
| mintapi/mintapi An unofficial Python library and CLI that screen-scrapes Mint.com using Selenium/WebDriver to programmatically retrieve account, transactio… | 32 | 1202 | abandoned |
| FeezyHendrix/Insta-mass-account-creator A Python CLI tool that automatically mass-creates Instagram accounts, generating disposable email addresses, fetching OTPs, and populating … | 10 | 1200 | abandoned |
| jito-labs/mev-bot A TypeScript bot that performs backrun arbitrage on Solana by monitoring the Jito mempool for large trades and executing circular arbitrage… | 39 | 1198 | abandoned |
| foolcage/fooltrader fooltrader is a Python quantitative analysis and trading framework that crawls, cleans, and structures market data (stocks, futures, forex,… | 23 | 1198 | abandoned |
| ClaudiuGeorgiu/PlaystoreDownloader A Python command line tool (with an optional web interface) that downloads Android APK files directly from the Google Play Store by package… | 10 | 1193 | abandoned |
| 4x99/code6 Code6 (码小六) is a self-hosted web application that monitors GitHub for leaked code and secrets, scanning periodically and alerting via email… | 23 | 1177 | abandoned |
| k1995/BaiduyunSpider A distributed crawler and search engine for Baidu Netdisk (Baidu Cloud) shared links, built with Scrapy and Scrapy-Redis, with a React-base… | 23 | 1177 | abandoned |
| xiaoxu193/PyTeaser PyTeaser is a Python library that summarizes news articles by ranking sentences for relevance to the title, keywords, position, and length,… | 32 | 1171 | abandoned |
| xiaoguyu/wechatDownload A desktop application built with Electron, TypeScript, and Vue3 for downloading WeChat Official Account (公众号) articles. It captures require… | 10 | 1170 | abandoned |
| natewong1313/bird-bot Bird Bot is a Python desktop auto-checkout bot with a PyQt5 interface that monitors Walmart and Best Buy for Nintendo Switch console restoc… | 10 | 1169 | abandoned |
| shadowmoose/RedditDownloader Reddit Media Downloader is a Python CLI tool that scans Reddit posts, comments, saved lists, and subreddits to download linked media locall… | 10 | 1161 | abandoned |
| jamietre/CsQuery CsQuery is a C# jQuery port for .NET 4 that provides a complete CSS2/CSS3 selector engine, a standards-compliant HTML parser, and jQuery-st… | 32 | 1148 | abandoned |
| Jinnrry/getAwayBSG A Go CLI web crawler that scrapes job listings from Zhilian Zhaopin and housing (rental and second-hand) data from Lianjia across Chinese c… | 10 | 1147 | abandoned |
| xillwillx/skiptracer Skiptracer is a Python-based OSINT web scraping framework that aggregates paid and free lookup services to enumerate target information suc… | 23 | 1146 | abandoned |
| ring04h/weakfilescan A Python-based multi-threaded sensitive information leakage detection tool that crawls a target site, dynamically builds dictionary rules f… | 32 | 1138 | abandoned |
| vesche/scanless A Python CLI utility and library that scrapes online port scanning websites to perform port scans on a target IP or domain on your behalf. … | 10 | 1121 | abandoned |
| joshhighet/ransomwatch A transparent ransomware claim tracker that monitors ransomware groups' leak sites on the dark web and records their victim claims. It aggr… | 10 | 1116 | abandoned |
| AllanWang/Frost-for-Facebook Frost is an open-source third-party Facebook client for Android built as a web wrapper with extensive theming, multi-account support, and n… | 10 | 1100 | abandoned |
| fzaninotto/screenshot-as-a-service A self-hosted Node.js web service that renders PNG screenshots of websites using PhantomJS behind an Express HTTP API. It supports custom v… | 10 | 1096 | abandoned |
| bytebuff/JSpider JSpider is a collection of JavaScript decryption files for website-encrypted request parameters, shared weekly alongside Python snippets th… | 32 | 1091 | abandoned |
| TobiaszCudnik/phpquery phpQuery is a server-side, chainable, CSS3-selector-driven DOM API for PHP5 modeled on the jQuery JavaScript library. It also ships a comma… | 10 | 1064 | abandoned |
| VikParuchuri/apartment-finder A Python Slack bot that scrapes Craigslist for real-time apartment listings matching configurable criteria (price, neighborhoods, transit p… | 10 | 1059 | abandoned |
| loklak/loklak_jlib_api A Java client library for the Loklak server, which scrapes and provides open access to social media data (primarily Twitter) without requir… | 32 | 1057 | abandoned |
| iBreaker/bjguahao A Python-based helper script for booking appointments on the Beijing unified hospital registration platform (北京市预约挂号统一平台). The source code … | 32 | 1057 | abandoned |
| cloudroc/baidu-nolimit A tiny Chrome extension that bypasses Baidu Netdisk's large-file download restrictions by spoofing the navigator.platform property so the w… | 32 | 1043 | abandoned |
| 7sDream/zhihu-py3 An unofficial Python 3 API library for Zhihu, the Chinese Q&A site, letting users build objects from Zhihu URLs to fetch questions, answers… | 10 | 1033 | abandoned |
| ahertel/Amazon-Fresh-Whole-Foods-delivery-slot-finder A Mac-only AppleScript tool that repeatedly checks Amazon's Whole Foods delivery and Amazon Fresh pages to find available delivery slots an… | 32 | 1020 | abandoned |
| Planetary-Computers/autotab-starter autotab-starter is a Python toolkit for building AI-powered browser agents by recording point-and-click demonstrations in Chrome and genera… | 27 | 1009 | abandoned |
| SpiderClub/smart_login A Python collection of simulated login implementations for major Chinese websites (Weibo, Zhihu, QQ Zone, JD, Baidu, etc.), using either di… | 32 | 1008 | abandoned |
| owenthereal/hacker-menu Hacker Menu is a macOS menu bar desktop application that delivers top Hacker News stories directly to your desktop. It is built with Electr… | 23 | 1001 | abandoned |
| yt-dlp/yt-dlp yt-dlp is a feature-rich command-line audio/video downloader supporting thousands of websites, forked from youtube-dl. It offers extensive … | 99 | 187167 | active |
| puppeteer/puppeteer Puppeteer is a JavaScript library providing a high-level API to control Chrome or Firefox over the DevTools Protocol or WebDriver BiDi, run… | 95 | 95497 | stable |
| sherlock-project/sherlock Sherlock is a Python CLI tool that hunts down social media accounts by username across 400+ social networks. It is widely used for OSINT re… | 70 | 90369 | active |
| infiniflow/ragflow RAGFlow is an open-source Retrieval-Augmented Generation (RAG) engine that combines deep document understanding with agent orchestration to… | 93 | 89328 | active |
| odysseus-dev/odysseus Odysseus is a self-hosted, privacy-first AI workspace that combines chat, autonomous agents, tools/MCP integration, model serving, and deep… | 58 | 86318 | active |
| bytedance/deer-flow DeerFlow is an open-source SuperAgent harness from ByteDance that orchestrates a lead agent with sub-agents, memory, tools, skills, and Doc… | 72 | 80958 | active |
| Mintplex-Labs/anything-llm AnythingLLM is an all-in-one, local-first AI application for chatting with your documents, running AI agents, and building workflows entire… | 95 | 65257 | active |
| ZhuLinsen/daily_stock_analysis An LLM-powered stock analysis application that aggregates multi-source market data, news, and fundamentals for A-share, HK, US, Japanese, K… | 82 | 64010 | active |
| sansan0/TrendRadar TrendRadar is a self-hostable AI-powered public opinion and trending-news monitor that aggregates hot topics across multiple platforms and … | 61 | 61855 | active |
| mvanhorn/last30days-skill An AI agent skill/plugin that researches any topic across Reddit, X, YouTube, Hacker News, Polymarket, TikTok, and the web in parallel, sco… | 82 | 59340 | active |
| laurent22/joplin Joplin is an open-source, privacy-focused note-taking and to-do application that stores notes in Markdown and supports notebooks, tags, and… | 99 | 56115 | stable |
| KeygraphHQ/shannon Shannon is an open-source, autonomous AI pentester for web applications and APIs that runs locally from the command line. It analyzes sourc… | 84 | 47226 | active |
| vercel-labs/agent-browser A fast, native Rust CLI for browser automation designed specifically for AI agents, communicating with Chrome via CDP through a client-daem… | 78 | 41389 | active |
| spacedriveapp/spacedrive Spacedrive is an open-source cross-platform file explorer powered by a virtual distributed filesystem written in Rust. It indexes files acr… | 65 | 38859 | active |
| khoj-ai/khoj Khoj is a self-hostable personal AI assistant ('second brain') that answers questions from your own documents and the web using local or on… | 85 | 36730 | active |
| ItzCrazyKns/Vane Vane is a self-hosted, privacy-focused AI answering engine that combines web search (via SearxNG) with LLMs to deliver cited answers. It su… | 74 | 36489 | active |
| MadsLorentzen/ai-job-search An AI-powered job application framework built on Claude Code that runs locally: it evaluates job postings, tailors CVs, writes cover letter… | 81 | 36468 | active |
| reworkd/AgentGPT AgentGPT is a web application for assembling, configuring, and deploying autonomous AI agents directly in the browser. Users name a custom … | 10 | 36303 | active |
| gchq/CyberChef CyberChef is a browser-based web application for performing a wide range of 'cyber' operations such as encryption, encoding, compression, h… | 98 | 35679 | active |
| onyx-dot-app/onyx Onyx is an open-source, self-hostable AI chat platform that connects LLMs to company documents, apps, and people via RAG, 50+ data connecto… | 92 | 31777 | active |
| stanford-oval/storm STORM is an LLM-powered system that researches a topic via internet search and generates full-length, cited, Wikipedia-like reports. It is … | 38 | 31135 | active |
| karakeep-app/karakeep Karakeep (formerly Hoarder) is a self-hostable 'bookmark everything' app for saving links, notes, images, and PDFs with AI-based automatic … | 92 | 28617 | active |
| Fosowl/agenticSeek AgenticSeek is a fully local, privacy-focused AI assistant that serves as an open-source alternative to Manus AI. It runs reasoning models … | 64 | 27027 | active |
| xiaojieonly/Ehviewer_CN_SXJ EhViewer is an Android client app for browsing and downloading galleries from E-Hentai/ExHentai. It is a community-maintained fork with act… | 97 | 26482 | active |
| 1Panel-dev/MaxKB MaxKB is an open-source, self-hosted platform for building enterprise-grade AI agents with RAG pipelines, workflow orchestration, and MCP t… | 94 | 22612 | active |
| FreeTubeApp/FreeTube FreeTube is an open-source desktop YouTube client built with privacy in mind, letting users watch videos without ads or Google tracking. Al… | 86 | 21766 | active |
| MobSF/Mobile-Security-Framework-MobSF MobSF is an automated all-in-one mobile application security testing framework for Android, iOS, and Windows Mobile apps. It performs stati… | 94 | 21650 | active |
| Alibaba-NLP/DeepResearch Tongyi DeepResearch is an open-source agentic large language model (30.5B total parameters, 3.3B activated per token) plus training and inf… | 52 | 19878 | active |
| wled/WLED WLED is a fast, feature-rich open-source firmware for ESP32 (and legacy ESP8266) microcontrollers that controls addressable RGB LED strips … | 93 | 18603 | active |
| Jackett/Jackett Jackett is a self-hosted proxy server that translates queries from media automation apps (Sonarr, Radarr, Lidarr, etc.) into tracker-site-s… | 95 | 15961 | active |
| eigent-ai/eigent Eigent is an open-source desktop application for building and running AI agent workforces that automate complex multi-step workflows. Built… | 83 | 15128 | active |