elfvingralf/macOSpilot-ai-assistant
Voice + Vision powered AI assistant that answers questions about any application, in context and in audio. observed · 2026-08-28
Health v2 · maintenance only
26/100
- Activity 0
- Release rhythm 35
- Longevity 71
Flags: no_releases no_license
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-03. Adoption (stars, forks) is never an input.
- gap_med: n/a
- age_days: 1002
- days_rel: n/a
- days_push: 986
- n_releases_24m: 0
Adoption not part of the score
1157 stars · 48 forks observed · 2026-08-28
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded
macOSpilot is a macOS desktop AI assistant built with Electron that answers spoken or typed questions about whatever application is currently active. It screenshots the active window, transcribes your voice via OpenAI Whisper, queries GPT Vision with the screenshot, and replies as text overlay plus audio via OpenAI TTS.
Use cases
- ask questions about any app on screen without switching windows
- get voice answers about what's displayed in the current application
- trigger an AI assistant with a global keyboard shortcut
- get in-context help for unfamiliar software UIs
- hands-free AI assistant while working on macOS
- screenshot-based question answering with GPT Vision
When to choose
- you're on macOS and want a context-aware assistant for any active application
- you prefer speaking questions and hearing audio answers
- you want a self-hosted Electron app wired to your own OpenAI API key
When to avoid
- you need Windows or Linux support - it's macOS only
- you don't want to pay for OpenAI API usage or send screenshots to the cloud
- you need a polished, packaged product - it requires manual setup and has no license
Facets
application · maturity experimental
speech-recognition tts llm-inference ocr chatbot artificial-intelligence developer-tools desktop-applications large-language-models voice-assistant screen-context openai gpt-vision keyboard-shortcut audio-answers macos electron nodejs desktop
1 source
- readme: https://github.com/elfvingralf/macOSpilot-ai-assistant · fetched 2026-08-28 · 297f45e2ba9a
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| elfvingralf/macOSpilot-ai-assistant | main | 26 |
For agents
markdown · JSON · MCP: product_card(name="elfvingralf/macOSpilot-ai-assistant")
Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem