Screen Vision Server

Give Claude Code the ability to see your screen

Screen Vision lets Claude capture screenshots, watch your screen in real-time with audio transcription, analyze video files, and read text via OCR. It runs locally as an MCP server — Claude sees what you see, when you ask.

Privacy & Security

All capture is local and on-demand — no background recording, no persistent process, no external transmission.

• Screen Vision runs as a local MCP server (stdio transport). It only captures when Claude explicitly calls a tool in response to your request.
• Captured images and transcriptions are sent only to your existing Claude Code session — the same endpoint all Claude Code traffic uses. No third-party services, no cloud storage.
• The server does not run in the background between Claude Code sessions. It starts when Claude Code starts and stops when it stops.
• No data is written to disk unless you explicitly ask Claude to save a file.

Quick Start

pip install screen-vision[ocr]

Then add to your Claude Code MCP config (.mcp.json):

{
  "mcpServers": {
    "screen-vision": {
      "command": "screen-vision-mcp"
    }
  }
}

System deps for OCR and video:

brew install tesseract   # Required for OCR (read_screen_text)
brew install ffmpeg      # Required for video analysis (analyze_video)

What You Can Say

"Take a screenshot of my screen"          → capture_screen
"Capture the Chrome window"               → capture_window
"Watch my screen for 1 minute"            → watch_screen (with audio transcription)
"Analyze the video at ~/Downloads/demo.mp4" → analyze_video
"Read the text on my screen"              → read_screen_text
"What window am I in?"                    → get_active_context (no screenshot)
"What's on my screen right now?"          → understand_screen (AI analysis)
"Analyze this photo I AirDropped"         → analyze_image

Tools (14)

Tool	What it does	Needs
capture_screen	Full screen capture with delay + multi-monitor	—
capture_region	Capture a specific rectangular area	—
capture_window	Capture a window by title	—
list_monitors	List displays with resolutions	—
get_active_context	Window/cursor/monitor info (no image)	—
read_screen_text	OCR text extraction from screen	tesseract
understand_screen	AI-powered screen analysis	Anthropic API key
analyze_image	Analyze a dropped/AirDropped image file	—
watch_screen	Watch screen with frame sampling + audio	ffmpeg (audio)
analyze_video	Extract keyframes from video files	ffmpeg
capture_camera	Grab latest frame from phone camera	—
watch_camera	Stream phone camera with scene detection + audio	—
show_pairing_qr	Show QR code to connect phone camera	—
phone_status	Check phone camera connection status	—

Security

Screen Vision includes security controls for corporate environments:

• PII/PCI scanning — Detects credit card numbers, SSNs, phone numbers, email addresses in OCR text
• App deny-list — Blocks captures of Slack, Teams, Zoom, banking apps, password managers
• Call detection — Blocks captures during active audio calls
• Rate limits — 200 captures/session, 2s minimum interval, 5min max watch duration
• Audit logs — All captures logged to ~/.screen-vision/audit.log

Set SCREEN_VISION_MODE=work to enable all security controls. Default mode is personal (no restrictions).

Dependencies

Core (always installed): mcp[cli], mss, Pillow, numpy, httpx

Extras (mix and match):

Extra	Install	What you get
[ocr]	pip install screen-vision[ocr]	pytesseract — OCR via tesseract (~5MB, needs brew install tesseract)
[paddle]	pip install screen-vision[paddle]	paddleocr + opencv-python-headless — higher-accuracy OCR (~1GB, self-contained)
[audio]	pip install screen-vision[audio]	faster-whisper + sounddevice — audio transcription for watch_screen
[full]	pip install screen-vision[full]	All of the above

Python 3.11+ required.

Development

pip install -e ".[ocr,test]"
pytest tests/ -v
ruff check src/

Author

Alex Vicuna — github.com/avicuna

Contributing

Issues and PRs welcome: https://github.com/avicuna/screen-vision