Open-source Python library for AI browser agents, plus Browser Use Cloud: stealth browsers and a hosted agent API.
crw
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl,…
Install
npx -y crw-mcp@latest installclaude mcp add crw -- npx -y crw-mcp@latest install{
"mcpServers": {
"crw": {
"command": "npx",
"args": [
"-y",
"crw-mcp@latest",
"install"
]
}
}
}Install command taken from the project's README or registry entry. Always review code before running it.
README excerpt
Read full README on GitHub →fastCRW
Turn URLs into clean markdown or structured JSON with one engine for search, scrape, map, crawl, and extract.
Run it locally as a small Rust binary or use the managed API.
Get 1000 free credits → · Install · Docs
No credit card. Continue with GitHub.
One-command install
curl -fsSL https://fastcrw.com/install | sh
Runs local and free, no account needed. To use the Cloud, paste your key into the same command and it installs the binary, connects the key, and registers the MCP server with the AI coding tools you already have:
curl -fsSL https://fastcrw.com/install | CRW_API_KEY=crw_live_... sh
crw search "rust tutorials"
Claude Code, Cursor, Codex, Gemini CLI, OpenCode and Windsurf are picked up
automatically when they are already set up; nothing else is touched, and your
key stays in ~/.config/crw/config.toml rather than being copied into each
tool. Add CRW_NO_AGENTS=1 to skip that step, or run crw setup on its own to
choose interactively.
1000 free credits, no credit card. Managed proxies, JS rendering and search, with nothing to run or keep up to date. Get my free key →
macOS and Linux, Intel and ARM. More install options →
What it does
| Operation | Outcome |
|---|---|
| Scrape | One URL to markdown, HTML, links, screenshots, or schema JSON |
| Crawl | Follow a bounded site crawl and collect its pages |
| Map | Discover URLs without scraping every page |
| Search | Search the web and optionally scrape selected results |
| Extract | Produce structured fields from one or many URLs |
Why fastCRW
On Firecrawl's own public 1,000-URL dataset, fastCRW recovered more truth than Crawl4AI and Firecrawl, matched the fastest median latency, and idled at ~14 MB RAM.
Methodology, full numbers, and how to reproduce it
On a different benchmark entirely, answer accuracy rather than scrape recall, fastCRW answers 90.0% of the 600 AA-Omniscience questions correctly. Every product listed on the Artificial Analysis Search Index sits below it.
The full 14-product comparison, the control run, and how to reproduce it
Choose how you use it
CLI
crw https://example.com # scrape, works right after install
crw search "rust async runtime" # search, after `crw setup`
Python SDK
Using Cloud? Get an API key, then export it once:
export CRW_API_KEY="crw_live_..."
pip install crw
from crw import CrwClient
client = CrwClient()
page = client.scrape("https://example.com", formats=["markdown"])
print(page["markdown"])
Node.js
npm install crw-sdk
import { CrwClient } from "crw-sdk";
const client = new CrwClient();
const page = await client.scrape("https://example.com", {
formats: ["markdown"],
});
console.log(page.markdown);
Local mode and more SDK examples → · REST API →
MCP for AI agents
npx -y crw-mcp@latest install
Similar plugs
An open-source AI agent that brings the power of Gemini directly into your terminal.
Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here…
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.
The fastest path to AI-powered full stack observability, even for lean teams.