Command Palette

Search for a command to run...

UnylyUnyly
Весь каталог

Windows Computer Use

БесплатноНе проверен

Windows Computer Use for AI Agents. Both a tool (22 MCP tools for click, type, screenshot, OCR, UI inspection) and an agent (autonomous mission engine, macro re

GitHubEmbed

Описание

Windows Computer Use for AI Agents. Both a tool (22 MCP tools for click, type, screenshot, OCR, UI inspection) and an agent (autonomous mission engine, macro recorder, intent-based discovery, event watchers). Built with opencode (DeepSeek V4). Ships as MCP server, web UI, and Tauri desktop app.

README

Stars License Python FastMCP

Toolkit for building CUA agents on Windows - primitives an AI (or you) calls to see UI and click/type like a human, with a built-in mission agent included. Click buttons, type text, read windows, run whole missions autonomously. Built on pywinauto.

Dangerous by nature: every click and keystroke hits the live desktop and can change or delete real data. Keep HITL approval on; prefer dry-run or a VM sandbox (virtualization-mcp) for anything untrusted. Read docs/SAFETY.md before production use.

A tool for agents, and an agent itself.

You It
Use it as an MCP server Claude, Cursor, DeepSeek call automation_windows, automation_elements, automation_mission — 20 tools
Use it as an autonomous agent Give it a goal: automation_mission(run="install app, verify UI, screenshot result") — it plans, executes, retries, and reports
Use it as a webapp start.ps1 opens a React dashboard at http://127.0.0.1:10788 with HITL, crawler, logging
Use it as a desktop app The NSIS installer bundles everything into one binary — no Python, no uv, no git needed

Exhibit A: 100 Tauri/NSIS installers, one unattended run, $2 in LLM costs. Install, screenshot, verify, report — zero human intervention. That is what agentic Windows automation looks like at scale.

Built on pywinauto. Read docs/SAFETY.md before production use.


Quick Start

Claude Desktop (one line): download install.ps1 from the latest release, then run it — it installs the .mcpb bundle for you. Other clients: uvx / manual config snippets are in INSTALL.md.

Method Command / Config
MCP stdio (Cursor, Claude Desktop) { "mcpServers": { "windows-computer-use": { "command": "uv", "args": ["--directory", "<PATH>", "run", "windows-computer-use-mcp"] } } }
HTTP streamable (any MCP HTTP client) { "mcpServers": { "windows-computer-use": { "url": "http://127.0.0.1:10789/mcp" } } }
Web operator UI .\start.ps1 → http://127.0.0.1:10788
Desktop app (NSIS installer) Download from Releases — zero deps

See INSTALL.md for detailed setup. Run just demo for examples.


Features

  • Window Management — find, activate, maximize, minimize, position, close, tray icons
  • Mouse & Keyboard — click, drag, type, hotkeys, app shortcuts, background PostMessage input (no cursor warp)
  • UI Elements — inspect, click, read text, verify state via UIA / Win32
  • Visual Intelligence — screenshots, OCR, template matching
  • Tables & Virtual Lists — scroll-and-recrawl crawl, table-to-rows/CSV extraction
  • Autonomous Missions — give it a goal, it plans and executes with retry + verification (preflight + UAC pause + app allowlist built in)
  • Session Safety — preflight liveness check, UAC detection, per-app allowlist, HITL, kill switch
  • Macro Recording — record any UI sequence, replay, verify outcomes
  • Multi-App Workflows — chain actions across Notepad, Calc, Paint, or any Windows app
  • Telemetry — every action logged to SQLite; query failure patterns by tool
  • Adaptive Location — auto-cascades through title/auto_id/control_id/class/OCR to find elements
  • Face Recognition — optional, off by default

Documentation

Doc Content
INSTALL.md Setup: desktop app, uv, MCP config
docs/ONBOARDING.md First-timer setup: what to install, pitfalls, sanity check
docs/README.md Full documentation hub
docs/py-stack.md Python dependency deep dive
docs/composing-with-playwright.md Browser automation with Playwright MCP
docs/ocr.md OCR system — Tesseract setup, limitations, competition
docs/cua-nsis-certification.md Dogfooding: using the tool to test its own NSIS installer
docs/ROADMAP.md Improvement roadmap short/medium/long term
docs/SAFETY.md HITL, kill switch, opt-in features
docs/TOOLS.md Portmanteau tool reference
tests/README.md Test suite guide and e2e setup
examples/README.md Runnable demos
mcpb/README.md MCPB bundle packaging
web_sota/README.md Operator UI build/dev guide
CHANGELOG.md Release history

Ports

Port Service
10788 Frontend — Vite operator UI
10789 Backend — FastAPI + FastMCP HTTP
stdio MCP transport (port-free)

Related

Repo What it does
autohotkey-mcp Raw input recording/replay via AHK
browser-mcp Playwright browser control — for webapps, HTML DOM, websites
virtualization-mcp Sandbox / VM isolation
windows-operations-mcp Registry, services, accounts

Browser vs desktop: This server drives Win32 / UI Automation. For HTML/DOM and websites, pair with browser-mcp (Playwright). Both MCPs can run side by side — use one profile that loads both and let the LLM pick the right tool for the target.

Fleet standards: mcp-central-docs.


License

MIT — Copyright (c) 2026 Sandra Schipal.

from github.com/sandraschi/windows-computer-use-mcp

Установка Windows Computer Use

У этого сервера нет опубликованного пакета — он собирается из исходников. Открой репозиторий и следуй инструкции в README.

▸ github.com/sandraschi/windows-computer-use-mcp

FAQ

Windows Computer Use MCP бесплатный?

Да, Windows Computer Use MCP бесплатный — установка в пару кликов через Unyly без оплаты.

Нужен ли API-ключ для Windows Computer Use?

Нет, Windows Computer Use работает без API-ключей и переменных окружения.

Windows Computer Use — hosted или self-hosted?

Self-hosted: сервер запускается локально на твоей машине командой из раздела установки.

Как установить Windows Computer Use в Claude Desktop, Claude Code или Cursor?

Открой Windows Computer Use на unyly.org, выбери вкладку своего клиента (Claude Desktop, Claude Code, Cursor) и нажми Install — конфиг сгенерируется автоматически, без правки JSON.

Похожие MCP

LibreOffice Tools

Enables AI agents to read, write, and edit Office documents via LibreOffice with token-efficient design. Supports multiple formats including DOCX, XLSX, PPTX, a

passerbyflutterавтор: passerbyflutter

Figma

Extract design specs and assets

Figmaавтор: Figma

dannote/figma-use

Figma control: create shapes, text and components, and set styles, auto-layout, variables and exports.

dannoteавтор: dannote

Logo.dev

Search and retrieve company logos by brand or domain. Customize size, format, and theme to match your design needs. Accelerate design, prototyping, and content

NOVA-3951автор: NOVA-3951

Design Inspiration Server

Searches top design platforms like Dribbble and Behance to provide UI inspiration, color palettes, and layout patterns via the Serper API. It allows users to re

YonasValentinавтор: YonasValentin

PIX4Dmatic

Enables GUI automation for controlling PIX4Dmatic on Windows through MCP. Supports launching, focusing, capturing screenshots, sending hotkeys, clicking UI elem

jangjo123автор: jangjo123

mcp-dockmaster

An Open-Sourced UI to install and manage MCP servers for Windows, Linux and macOS.

автор: Community

ariekogan/ateam-mcp

Build, validate and deploy multi-agent AI solutions on the ADAS platform: design skills with tools and manage the solution lifecycle.

ariekoganавтор: ariekogan

thinkchainai/mcpbundles

Create custom tool bundles, connect providers with OAuth or API keys, and use one MCP server across many integrations, with a UI for bundles and credentials.

thinkchainaiавтор: thinkchainai

jau123/MeiGen-AI-Design-MCP

Image generation and editing with a curated prompt library, prompt enhancement and routing across local ComfyUI, MeiGen Cloud and OpenAI-compatible APIs.

jau123автор: jau123

Compare Windows Computer Use with

Не уверен что выбрать?

Найди свой стек за 60 секунд

Автор?

Embed-бейдж для README

Похожее

Все в категории design