Log inSubmit server
Computer Use logo

Computer Use

Local desktop automation over MCP for mouse, keyboard, screen, clipboard, and window control.

InstallRepositoryWebsite
Full README Compare alternatives Embed widget Claim this listing

Install Computer Use

Pick your client, then add it in one click or paste the config.

STDIONode.js
~/Library/Application Support/Claude/claude_desktop_config.json
claude_desktop_config.json
{
  "mcpServers": {
    "computer-use-2": {
      "command": "npx",
      "args": [
        "-y",
        "go-computer-use-mcp-server"
      ]
    }
  }
}

Settings → Developer → Edit Config, merge this into mcpServers, then fully quit and reopen Claude Desktop.

We couldn’t confirm it starts correctly

We ran the install command but it didn't respond within our test window — this can mean a slow first-time install rather than a real problem.

npx -y go-computer-use-mcp-server

Process exited before answering initialize.

This is an experimental automated check and can have false negatives — missing environment variables, a slow cold install, etc. It doesn’t necessarily mean something’s wrong. Last checked 8d ago.

Overview

Computer Use MCP server exposes local desktop automation to MCP-compatible AI clients through mouse, keyboard, screen, clipboard, and window tools. It uses the RobotGo library and can run over stdio or SSE, with npx or a locally built Go binary. Reach for it when an agent needs to interact with graphical applications using coordinates, keystrokes, screenshots, or window state. Because it provides broad unsandboxed local control, run it only as a trusted local tool.

Use cases

  • Automate desktop applications with mouse and keyboard actions
  • Capture screens and inspect display or pixel state
  • Read and paste clipboard content during an agent workflow
  • Activate, resize, minimize, maximize, or close windows
  • Run local GUI workflows from an MCP-compatible client

Key features

  • Absolute, relative, and smooth mouse control
  • Keyboard input, UTF-8 typing, and clipboard access
  • Screen capture, display information, and pixel colors
  • Active-window inspection and window management
  • Stdio and SSE transport options

Tools44

What Computer Use lets your agent do. Expand a tool for its parameters.

Self-reported~370 tokens of context

Security & health

What it can reach and how reliably it runs — from our own checks, not the maintainer’s claims.

ActiveLast checked 3d ago

Recent health check succeeded.

5/5 checks healthy over the last 37d

Supply-chain signal

No high-severity advisories surfaced by our automated scan.

Critical 0High 0Medium 0Low 0

Scanned 13h ago via OSV.dev · go-computer-use-mcp-server (npm)

Adoption & maintenance

Factual signals from GitHub, npm, and our automated checks — not a rating.

GitHub stars3Stargazers on the source repository.
npm downloads192Package downloads in the last 30 days.
Last commit5mo agoMost recent push to the default branch.
Install checkInconclusiveDidn't respond in our test window — often a slow first install.
Tools exposed44Callable tools this server registers over MCP.
Directory activity6 viewsConfig copies, upvotes, and views on AllMCPs.

How Computer Use works

What the Computer Use MCP server does

Computer Use MCP server connects an MCP client to the desktop session on the machine where it runs. Its tools cover pointer input, keyboard input, clipboard operations, display inspection, screenshots, pixel colors, and window state. Agents can move or click the mouse, drag and scroll, press keys, enter UTF-8 text, and read or write the clipboard.

Screen tools report dimensions, monitor counts, display bounds, screenshots, and pixel colors. A screenshot can be returned as MCP image content or saved to a file.

Use this Computer Use MCP server for workflows that must operate a graphical desktop rather than call a structured application API. Coordinate-based automation depends on the current display layout and application state, so it is best suited to a visible, controlled desktop session.

How it works

The server is written in Go and uses the RobotGo library for desktop automation. MCP clients communicate with it through either stdio or SSE. The npx package provides a direct launch path, while source builds require Go and native desktop dependencies.

Stdio is the default choice for a local client configuration. SSE can bind to a host and port, including the documented example of 0.0.0.0:8080. The server performs actions against the operating system session in which it is running; it does not describe a browser-only or application-specific abstraction.

Setup and configuration

With Node.js 18 or newer, launch the Computer Use MCP server through npx:

Terminal
npx -y go-computer-use-mcp-server -t stdio

For SSE, use -t sse together with -h and -p to select the host and port. Source installation requires Go 1.21+, GCC, and, on Linux, X11 libraries plus packages for clipboard, image, and keyboard-event support. The repository provides separate dependency commands for Ubuntu/Debian and Fedora, followed by make deps and make build.

The README includes configurations for Claude Desktop, Claude Code, Cursor, Windsurf, Cline, and Codex. On Linux, example Claude Code and Codex configurations pass DISPLAY and XAUTHORITY when those session variables are needed.

Tools and capabilities

  • Move, click, toggle, drag, and scroll the mouse, including smooth variants.
  • Press or toggle keys, type text immediately or with a delay, and use the clipboard.
  • Inspect display geometry, capture screens, save captures, and query pixel colors.
  • Read active-window information, titles, and bounds, then activate or manage windows.
  • Return screenshots as MCP ImageContent for clients that support image content.

Limitations and notes

This Computer Use MCP server is intended to run as a trusted local MCP tool. The README warns that it provides broad local desktop control and is not sandboxed by default. Do not expose it to untrusted networks, users, or agents without additional security controls.

The documented commands use either stdio or SSE; the default source-binary transport is SSE, while the npx quick-start example explicitly selects stdio. Linux deployments may need the listed X11 and related native packages before building or using desktop features.

Read the full README View source on GitHub

Reviews

No reviews yet — be the first to share how it worked for you.

Frequently Asked Questions about Computer Use

Computer Use is an MCP server that connects AI clients to a local desktop through RobotGo. Its main tools control the mouse and keyboard, read and write the clipboard, capture screens, inspect pixels and displays, and query or manage windows. It communicates over stdio or SSE.

Install Node.js 18 or newer and run `npx -y go-computer-use-mcp-server -t stdio`. Building from source requires Go 1.21+, GCC, and platform dependencies; Linux also needs the documented X11, clipboard, image, and keyboard-event packages.

Yes, Computer Use works with Cursor through Cursor Settings > Features > MCP Servers. Add a stdio server entry that runs `npx -y go-computer-use-mcp-server -t stdio`.

Run the binary or npx package with the SSE transport, then set the host and port with `-h` and `-p`. The documented source example is `./go_computer_use_mcp_server -t sse -h 0.0.0.0 -p 8080`.

No, it should be treated as a trusted local tool because it provides broad desktop control and is not sandboxed by default. The README advises against exposing it to untrusted networks, users, or agents without additional security controls.

Related MCP servers

All in OS Automation All alternatives
Add a badge to your READMEShow it’s listed — live SVG, Markdown or HTML.

AllMCPs Directory Badge

Full Badge Customizer

Showcase your server listing on GitHub or your project documentation. Embed this dynamic SVG badge to highlight official listing status and live engagement.

Badge Style:
Live Dynamic SVG PreviewComputer Use AllMCPs Directory Badge
Markdown (GitHub README)
[![AllMCPs](https://allmcps.com/api/badge/computer-use-2?style=directory)](https://allmcps.com/mcp/computer-use-2)
HTML Embed
<a href="https://allmcps.com/mcp/computer-use-2"><img src="https://allmcps.com/api/badge/computer-use-2?style=directory" alt="Computer Use on AllMCPs" /></a>