automation-mcp
installs/mo · npmstarsforks
How to install automation-mcp?
ashwwwin/automation-mcp
$git clone https://github.com/ashwwwin/automation-mcpAutomation MCP is a Model Context Protocol (MCP) server that provides AI models with complete desktop automation capabilities on macOS. It enables AI assistants to:
README.md
| 1 | # 🤖 Automation MCP |
| 2 | |
| 3 | Automation MCP is a Model Context Protocol (MCP) server that provides AI models with **complete desktop automation capabilities** on macOS. It enables AI assistants to: |
| 4 | |
| 5 | - 🖱️ **Control your mouse** (click, move, scroll, drag) |
| 6 | - ⌨️ **Type and send keyboard input** (including system shortcuts) |
| 7 | - 📸 **Take screenshots** and analyze screen content |
| 8 | - 🪟 **Manage windows** (focus, move, resize, minimize) |
| 9 | - 🎯 **Interact with UI elements** through coordinates |
| 10 | - 🎨 **Analyze screen colors** and highlight regions |
| 11 | - 🔍 **Wait for images** to appear on screen |
| 12 | |
| 13 | ## 🚀 Quick start |
| 14 | |
| 15 | Make sure you have [furi](https://github.com/ashwwwin/furi) installed, and then run the following command: |
| 16 | |
| 17 | ```bash |
| 18 | furi add ashwwwin/automation-mcp |
| 19 | ``` |
| 20 | |
| 21 | followed by: |
| 22 | |
| 23 | ```bash |
| 24 | furi start ashwwwin/automation-mcp |
| 25 | ``` |
| 26 | |
| 27 | and you're done! (or you can just use the furi desktop app for no cli). |
| 28 | |
| 29 | ## 🥲 Normal start (without furi) |
| 30 | |
| 31 | ### Prerequisites |
| 32 | |
| 33 | - **Bun** runtime - Install with: `curl -fsSL https://bun.sh/install | bash` |
| 34 | |
| 35 | ### 1. Clone and Install |
| 36 | |
| 37 | ```bash |
| 38 | git clone https://github.com/ashwwwin/automation-mcp.git |
| 39 | cd automation-mcp |
| 40 | bun install |
| 41 | ``` |
| 42 | |
| 43 | ### 2. Start the Server |
| 44 | |
| 45 | ```bash |
| 46 | # Start with HTTP transport (recommended for web apps) |
| 47 | bun run index.ts |
| 48 | |
| 49 | # Or start with stdio transport (for command line tools) |
| 50 | bun run index.ts --stdio |
| 51 | ``` |
| 52 | |
| 53 | ### 3. Grant Permissions |
| 54 | |
| 55 | On first run, macOS will ask for permissions. **You must grant these** for full functionality: |
| 56 | |
| 57 | 1. **Accessibility** - Allows keyboard/mouse control |
| 58 | 2. **Screen Recording** - Enables screenshots and screen analysis |
| 59 | |
| 60 | Or manually enable in: **System Settings** → **Privacy & Security** → **Accessibility/Screen Recording** |
| 61 | |
| 62 | ## 🛠️ Available Tools |
| 63 | |
| 64 | ### 🖱️ Mouse Control |
| 65 | |
| 66 | - `mouseClick` - Click at coordinates with left/right/middle button |
| 67 | - `mouseDoubleClick` - Double-click at coordinates |
| 68 | - `mouseMove` - Move cursor to position |
| 69 | - `mouseGetPosition` - Get current cursor location |
| 70 | - `mouseScroll` - Scroll in any direction |
| 71 | - `mouseDrag` - Drag from current position to target |
| 72 | - `mouseButtonControl` - Press/release mouse buttons |
| 73 | - `mouseMovePath` - Follow a smooth path with multiple points |
| 74 | |
| 75 | ### ⌨️ Keyboard Input |
| 76 | |
| 77 | - `type` - Type text or press key combinations |
| 78 | - `keyControl` - Advanced key press/release control |
| 79 | - `systemCommand` - Common shortcuts (copy, paste, undo, save, etc.) |
| 80 | |
| 81 | ### 📸 Screen Capture & Analysis |
| 82 | |
| 83 | - `screenshot` - Capture full screen, regions, or specific windows |
| 84 | - `screenInfo` - Get screen dimensions |
| 85 | - `screenHighlight` - Highlight screen regions visually |
| 86 | - `colorAt` - Get color of any pixel |
| 87 | - `waitForImage` - Wait for images to appear (template matching) |
| 88 | |
| 89 | ### 🪟 Window Management |
| 90 | |
| 91 | - `getWindows` - List all open windows |
| 92 | - `getActiveWindow` - Get current active window |
| 93 | - `windowControl` - Focus, move, resize, minimize windows |
| 94 | |
| 95 | ## 🔒 Security & Permissions |
| 96 | |
| 97 | 1. **Accessibility** - Required for: |
| 98 | |
| 99 | - Mouse clicks and movement |
| 100 | - Keyboard input simulation |
| 101 | - Window management |
| 102 | |
| 103 | 2. **Screen Recording** - Required for: |
| 104 | - Taking screenshots |
| 105 | - Screen analysis |
| 106 | - Color detection |
| 107 | |
| 108 | ## 🚀 Integration Examples |
| 109 | |
| 110 | ### With Claude Desktop + furi |
| 111 | |
| 112 | If you've already configured furi with Claude Desktop, you don't need to do anything. |
| 113 | |
| 114 | Add to your MCP configuration: |
| 115 | |
| 116 | ```json |
| 117 | { |
| 118 | "mcpServers": { |
| 119 | "furi": { |
| 120 | "command": "furi", |
| 121 | "args": ["connect"] |
| 122 | } |
| 123 | } |
| 124 | } |
| 125 | ``` |
| 126 | |
| 127 | ### With Claude Desktop |
| 128 | |
| 129 | Add to your MCP configuration: |
| 130 | |
| 131 | ```json |
| 132 | { |
| 133 | "mcpServers": { |
| 134 | "automation": { |
| 135 | "command": "bun", |
| 136 | "args": ["run", "/path/to/automation-mcp/index.ts", "--stdio"] |
| 137 | } |
| 138 | } |
| 139 | } |
| 140 | ``` |
| 141 | |
| 142 | ## 🐛 Troubleshooting |
| 143 | |
| 144 | ### Common Issues |
| 145 | |
| 146 | **Permission Denied Errors** |
| 147 | |
| 148 | - Ensure Accessibility and Screen Recording permissions are granted |
| 149 | - Ensure Xcode Command Line Tools: `xcode-select --install` |
| 150 | |
| 151 | ## 🙋♂️ Support |
| 152 | |
| 153 | Having issues? Check the troubleshooting section above or open an issue with: |
| 154 | |
| 155 | - Your operating system and version |
| 156 | - Error messages |
| 157 | - Steps to reproduce |
People who liked this also viewed
6 picksType
- Scrapling🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!MCP ServersJul 2026
- excel-mcp-serverA Model Context Protocol server for Excel file manipulationMCP ServersApr 2026
- Excel-MCP-Server-MasterExcel MCP Server - Manipulate Excel files without Microsoft Excel. Model Context Protocol for XLSX, XLSM with Claude AI integrationMCP ServersJun 2025
- agent-deviceCLI to control iOS and Android devices for AI agentsMCP ServersJul 2026
- n8n-mcpA MCP for Claude Desktop / Claude Code / Windsurf / Cursor to build n8n workflows for you MCP ServersJul 2026
- ha-mcpThe Unofficial and Awesome Home Assistant MCP ServerMCP ServersJul 2026
