Open-source Python library for AI browser agents, plus Browser Use Cloud: stealth browsers and a hosted agent API.
Web Scraping MCP Server
Generic URL crawl + HTML extraction — fallback for sites without dedicated MCPs.
Install
$
claude mcp add --transport http web-scraping-mcp-server https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcpInstall command taken from the project's README or registry entry. Always review code before running it.
Similar plugs
An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here…
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.
The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra