RPA
Browser and desktop automation with an MCP server for AI assistants. Record macros or write JavaScript to automate websites, extract data, and control desktop apps with OCR and…
Install
npx uivision-mcp-bridge --setupclaude mcp add rpa -- npx uivision-mcp-bridge --setup{
"mcpServers": {
"rpa": {
"command": "npx",
"args": [
"uivision-mcp-bridge",
"--setup"
]
}
}
}Install command taken from the project's README or registry entry. Always review code before running it.
README excerpt
Read full README on GitHub →Ui.Vision - Browser and Desktop Automation
Automate websites and desktop applications with macros, JavaScript, or an AI assistant. Ui.Vision combines browser automation, OCR and image recognition, with an MCP server that lets AI agents create, edit and run reusable macros in your browser.
Install the extension · Connect an AI assistant with MCP · API reference · User forum
What can you automate?
- Browser tasks: fill forms, extract web data, download reports and repeat workflows in your existing browser session.
- Website testing: record and replay interactions, use Selenium IDE commands, and run checks with different input data.
- Visual tasks: find on-screen text with OCR and locate controls by image when HTML selectors are unavailable.
- Desktop workflows: automate applications and remote desktop interfaces using visual recognition and mouse and keyboard input. Desktop automation requires the additional Ui.Vision desktop components (XModules).
- AI-assisted automation: ask the built-in AI assistant or an external MCP client to write and run macros, then inspect the resulting script, logs and screenshots.
Use the macro recorder and command table, write JavaScript with the uiv.* API, or let an AI assistant author the macro. The resulting automation can be saved and run again.
Get started
Install the browser extension; you do not need to build this repository:
Open Ui.Vision and record a browser task, or start with a macro from the extension's demos. For desktop input and additional native capabilities, see the XModules installation guide.
The browser extension is open source and free for personal and commercial use. See the Ui.Vision website for desktop components and available editions.
Connect an AI assistant with MCP
Ui.Vision provides a Model Context Protocol (MCP) server through the uivision-mcp-bridge package. It connects MCP clients such as Claude Code, Claude Desktop and Cursor to the Ui.Vision browser extension.
An agent can inspect a page, create or edit a macro, run it, and use logs and screenshots to check the result. The automation executes through Ui.Vision in your browser.
Start with the MCP setup guide. The installer command is:
npx uivision-mcp-bridge --setup
The installer registers Ui.Vision with supported MCP clients found on your machine. Then enable the MCP bridge in Ui.Vision → Settings → AI, complete the connection steps in the guide, and restart your MCP client. Node.js and npm are required to run the installer.
For a first task, ask your connected assistant:
Use Ui.Vision to open https://example.com, read the page heading, and save a reusable macro for this task.
See mcp/README.md for bridge source, configuration and troubleshooting.
JavaScript automation and documentation for AI assistants
Similar plugs
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
A cross-platform desktop All-in-One assistant for Claude Code, Codex, OpenCode, OpenClaw, Grok Build & Hermes Agent. Only official website: ccswitch.io
Open-source Python library for AI browser agents, plus Browser Use Cloud: stealth browsers and a hosted agent API.
An open-source AI agent that brings the power of Gemini directly into your terminal.
An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here…