reworkd/tarsier

Health v2 · maintenance only

Adoption not part of the score

1761 stars · 121 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Tarsier is a Python library providing vision utilities for LLM-driven web interaction agents. It visually tags interactable page elements with bracketed IDs and converts page screenshots into whitespace-structured text via OCR so even text-only LLMs can perceive and act on webpages.

Use cases

• let an LLM agent click buttons and fill forms on a webpage
• convert a page screenshot into text an LLM can understand
• map LLM responses like CLICK [23] back to web elements
• give a text-only LLM awareness of a page's visual structure
• build browser automation agents with Playwright or Selenium
• tag visible links, buttons, and inputs for web agents

When to choose

• you are building an LLM web agent and need page perception
• you want to feed webpage structure to text-only models instead of vision models
• you use Playwright or Selenium and need element-to-ID mappings

When to avoid

• you need a general-purpose OCR tool unrelated to web agents
• you want a maintained product-backed solution (Reworkd is sunsetting its product)
• you need non-Python tooling

Facets

library · maturity maintenance

ocr computer-vision web-scraping llm-inference agent-framework artificial-intelligence web-development crawlers python cross-platform web-agents browser-automation playwright selenium gpt4v page-perception element-tagging ai-agents natural-language-processing

Member repositories

For agents

markdown · JSON · MCP: product_card(name="reworkd/tarsier")