Windows Computer Use
БесплатноНе проверенWindows Computer Use for AI Agents. Both a tool (22 MCP tools for click, type, screenshot, OCR, UI inspection) and an agent (autonomous mission engine, macro re
Описание
Windows Computer Use for AI Agents. Both a tool (22 MCP tools for click, type, screenshot, OCR, UI inspection) and an agent (autonomous mission engine, macro recorder, intent-based discovery, event watchers). Built with opencode (DeepSeek V4). Ships as MCP server, web UI, and Tauri desktop app.
README
Toolkit for building CUA agents on Windows - primitives an AI (or you) calls to see UI and click/type like a human, with a built-in mission agent included. Click buttons, type text, read windows, run whole missions autonomously. Built on pywinauto.
Dangerous by nature: every click and keystroke hits the live desktop and can change or delete real data. Keep HITL approval on; prefer dry-run or a VM sandbox (virtualization-mcp) for anything untrusted. Read docs/SAFETY.md before production use.
A tool for agents, and an agent itself.
| You | It |
|---|---|
| Use it as an MCP server | Claude, Cursor, DeepSeek call automation_windows, automation_elements, automation_mission — 20 tools |
| Use it as an autonomous agent | Give it a goal: automation_mission(run="install app, verify UI, screenshot result") — it plans, executes, retries, and reports |
| Use it as a webapp | start.ps1 opens a React dashboard at http://127.0.0.1:10788 with HITL, crawler, logging |
| Use it as a desktop app | The NSIS installer bundles everything into one binary — no Python, no uv, no git needed |
Exhibit A: 100 Tauri/NSIS installers, one unattended run, $2 in LLM costs. Install, screenshot, verify, report — zero human intervention. That is what agentic Windows automation looks like at scale.
Built on pywinauto. Read docs/SAFETY.md before production use.
Quick Start
Claude Desktop (one line): download
install.ps1
from the latest release, then run it — it installs the .mcpb bundle for you.
Other clients: uvx / manual config snippets are in INSTALL.md.
| Method | Command / Config |
|---|---|
| MCP stdio (Cursor, Claude Desktop) | { "mcpServers": { "windows-computer-use": { "command": "uv", "args": ["--directory", "<PATH>", "run", "windows-computer-use-mcp"] } } } |
| HTTP streamable (any MCP HTTP client) | { "mcpServers": { "windows-computer-use": { "url": "http://127.0.0.1:10789/mcp" } } } |
| Web operator UI | .\start.ps1 → http://127.0.0.1:10788 |
| Desktop app (NSIS installer) | Download from Releases — zero deps |
See INSTALL.md for detailed setup. Run just demo for examples.
Features
- Window Management — find, activate, maximize, minimize, position, close, tray icons
- Mouse & Keyboard — click, drag, type, hotkeys, app shortcuts, background PostMessage input (no cursor warp)
- UI Elements — inspect, click, read text, verify state via UIA / Win32
- Visual Intelligence — screenshots, OCR, template matching
- Tables & Virtual Lists — scroll-and-recrawl crawl, table-to-rows/CSV extraction
- Autonomous Missions — give it a goal, it plans and executes with retry + verification (preflight + UAC pause + app allowlist built in)
- Session Safety — preflight liveness check, UAC detection, per-app allowlist, HITL, kill switch
- Macro Recording — record any UI sequence, replay, verify outcomes
- Multi-App Workflows — chain actions across Notepad, Calc, Paint, or any Windows app
- Telemetry — every action logged to SQLite; query failure patterns by tool
- Adaptive Location — auto-cascades through title/auto_id/control_id/class/OCR to find elements
- Face Recognition — optional, off by default
Documentation
| Doc | Content |
|---|---|
| INSTALL.md | Setup: desktop app, uv, MCP config |
| docs/ONBOARDING.md | First-timer setup: what to install, pitfalls, sanity check |
| docs/README.md | Full documentation hub |
| docs/py-stack.md | Python dependency deep dive |
| docs/composing-with-playwright.md | Browser automation with Playwright MCP |
| docs/ocr.md | OCR system — Tesseract setup, limitations, competition |
| docs/cua-nsis-certification.md | Dogfooding: using the tool to test its own NSIS installer |
| docs/ROADMAP.md | Improvement roadmap short/medium/long term |
| docs/SAFETY.md | HITL, kill switch, opt-in features |
| docs/TOOLS.md | Portmanteau tool reference |
| tests/README.md | Test suite guide and e2e setup |
| examples/README.md | Runnable demos |
| mcpb/README.md | MCPB bundle packaging |
| web_sota/README.md | Operator UI build/dev guide |
| CHANGELOG.md | Release history |
Ports
| Port | Service |
|---|---|
| 10788 | Frontend — Vite operator UI |
| 10789 | Backend — FastAPI + FastMCP HTTP |
| stdio | MCP transport (port-free) |
Related
| Repo | What it does |
|---|---|
| autohotkey-mcp | Raw input recording/replay via AHK |
| browser-mcp | Playwright browser control — for webapps, HTML DOM, websites |
| virtualization-mcp | Sandbox / VM isolation |
| windows-operations-mcp | Registry, services, accounts |
Browser vs desktop: This server drives Win32 / UI Automation. For HTML/DOM and websites, pair with browser-mcp (Playwright). Both MCPs can run side by side — use one profile that loads both and let the LLM pick the right tool for the target.
Fleet standards: mcp-central-docs.
License
MIT — Copyright (c) 2026 Sandra Schipal.
Установка Windows Computer Use
У этого сервера нет опубликованного пакета — он собирается из исходников. Открой репозиторий и следуй инструкции в README.
▸ github.com/sandraschi/windows-computer-use-mcpFAQ
Windows Computer Use MCP бесплатный?
Да, Windows Computer Use MCP бесплатный — установка в пару кликов через Unyly без оплаты.
Нужен ли API-ключ для Windows Computer Use?
Нет, Windows Computer Use работает без API-ключей и переменных окружения.
Windows Computer Use — hosted или self-hosted?
Self-hosted: сервер запускается локально на твоей машине командой из раздела установки.
Как установить Windows Computer Use в Claude Desktop, Claude Code или Cursor?
Открой Windows Computer Use на unyly.org, выбери вкладку своего клиента (Claude Desktop, Claude Code, Cursor) и нажми Install — конфиг сгенерируется автоматически, без правки JSON.
Похожие MCP
LibreOffice Tools
Enables AI agents to read, write, and edit Office documents via LibreOffice with token-efficient design. Supports multiple formats including DOCX, XLSX, PPTX, a
автор: passerbyflutterFigma
Extract design specs and assets
автор: Figmadannote/figma-use
Figma control: create shapes, text and components, and set styles, auto-layout, variables and exports.
автор: dannoteLogo.dev
Search and retrieve company logos by brand or domain. Customize size, format, and theme to match your design needs. Accelerate design, prototyping, and content
автор: NOVA-3951Design Inspiration Server
Searches top design platforms like Dribbble and Behance to provide UI inspiration, color palettes, and layout patterns via the Serper API. It allows users to re
автор: YonasValentinPIX4Dmatic
Enables GUI automation for controlling PIX4Dmatic on Windows through MCP. Supports launching, focusing, capturing screenshots, sending hotkeys, clicking UI elem
автор: jangjo123mcp-dockmaster
An Open-Sourced UI to install and manage MCP servers for Windows, Linux and macOS.
ariekogan/ateam-mcp
Build, validate and deploy multi-agent AI solutions on the ADAS platform: design skills with tools and manage the solution lifecycle.
автор: ariekoganthinkchainai/mcpbundles
Create custom tool bundles, connect providers with OAuth or API keys, and use one MCP server across many integrations, with a UI for bundles and credentials.
автор: thinkchainaijau123/MeiGen-AI-Design-MCP
Image generation and editing with a curated prompt library, prompt enhancement and routing across local ComfyUI, MeiGen Cloud and OpenAI-compatible APIs.
автор: jau123Compare Windows Computer Use with
Не уверен что выбрать?
Найди свой стек за 60 секунд
Автор?
Embed-бейдж для README
Похожее
Все в категории design
