ishan0102/vimGPT

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

2649 stars · 199 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

vimGPT is a Python application that lets GPT-4V browse and interact with the web visually using Playwright and the Vimium keyboard-navigation Chrome extension. It gives multimodal LLMs a keyboard-based interface to click and navigate pages without needing DOM text, and includes an optional voice mode.

Use cases

• browse the web with GPT-4V vision only
• let an AI agent click links and navigate pages without DOM access
• automate web tasks using a multimodal LLM
• control a browser with voice commands
• experiment with vision-based web agents
• prototype browser automation without DOM parsing

When to choose

• you want to experiment with vision-only web browsing agents
• you need a lightweight research prototype for multimodal browser control
• you want to avoid feeding page DOM text to the model
• you want voice-driven browser automation

When to avoid

• you need a production-grade, reliable web automation agent
• you require JSON mode or function calling support from the vision API
• you need to automate tasks on your own logged-in browser with credentials
• you need low-cost, high-volume automation since vision API calls are expensive

Facets

application · maturity experimental

agent-framework browser-extension llm-inference workflow-automation artificial-intelligence browser-extensions python browser gpt-4v vimium web-browsing-agent playwright multimodal voice-control ai-agents automation desktop

Member repositories

For agents

markdown · JSON · MCP: product_card(name="ishan0102/vimGPT")