Brightdata MCP vs Crw

A side-by-side look at the Brightdata MCP and Crw MCP servers: transport, auth, tools, quality signals, and the config to install either one in Claude, Cursor, Windsurf or VS Code.

Brightdata MCP logoBrightdata MCPSearch & Data Extraction · Local subprocess (stdio)Bright Data's Web MCP server enabling AI agents to search, extract & navigate the web73GreatAuth: api key requiredCrw logoCrwSearch & Data Extraction · Local subprocess (stdio)fastCRW — open-source (AGPL-3.0), self-hostable Rust web crawler & search API for AI agents. Tools: scrape, crawl, map, and SearXNG-backed search. Single 6MB static binary; reproducible 1K-URL benchmarks faster than hosted alternatives. Hosted MCP at fastcrw.com/mcp (Streamable HTTP, OAuth) or self-host.72GreatAuth: oauth 2.0

Verdict: choose Brightdata MCP for search & data extraction work as a local process; choose Crw for search & data extraction as a local process. You can also run both side by side in one mcpServers block.

Which MCP server should you choose?

Brightdata MCP logoChoose Brightdata MCP when

  • You need dedicated capabilities in the Search & Data Extraction domain.
  • You prefer a local stdio subprocess transport.
  • Its auth model fits you: API key required.
  • You have the keys it needs: API_TOKEN.
  • You want tools like search_engine, scrape_as_markdown, search_engine_batch.
Explore Brightdata MCP

Crw logoChoose Crw when

  • You need dedicated capabilities in the Search & Data Extraction domain.
  • You prefer a local stdio subprocess transport.
  • Its auth model fits you: OAuth 2.0.
  • You have the keys it needs: CRW_API_KEY.
  • You want tools like crw_scrape, crw_crawl, crw_check_crawl_status.
Explore Crw

Feature & specification comparison

Rows where the two servers differ are marked.

SpecBrightdata MCP logoBrightdata MCPCrw logoCrw
CategorySearch & Data ExtractionSearch & Data Extraction
Quality signal73/100 · Great72/100 · Great
Install commandConfirmedConfirmed
TransportLocal subprocess (stdio)Local subprocess (stdio)
AuthAPI key requiredOAuth 2.0
PricingFreemiumFreemium
Required env varsAPI_TOKENCRW_API_KEY
Verified ownerCommunity listingCommunity listing
GitHub stars2,6841,161
Directory activity 4 views 0 installs 0 upvotes 5 views 0 installs 0 upvotes
Tools118

Tools & capabilities

Brightdata MCP tools 11

  • search_engineScrape search results from Google, Bing or Yandex. Returns SERP results in JSON or Markdown (URL, title, description),Ideal forgathering current information, news, and detailed search results.
  • scrape_as_markdownScrape a single webpage URL with advanced options for content extraction and get back the results in MarkDown language. This tool can unlock any webpage even if it uses bot detection or CAPTCHA.
  • search_engine_batchRun multiple search queries simultaneously. Returns JSON for Google, Markdown for Bing/Yandex.
  • scrape_batchScrape multiple webpages URLs with advanced options for content extraction and get back the results in MarkDown language. This tool can unlock any webpage even if it uses bot detection or CAPTCHA.
  • discoverSearch the web and rank results by AI-driven relevance. Returns scored results with title, description, and URL. Supports intent-based ranking, geo-targeting, date filtering, and keyword filtering.
  • search_scrapersFind a Bright Data pre-built scraper (Web Scraper API, 1,200+ sites) for a site or data type, e.g. "amazon reviews" or "linkedin.com". Returns dataset_id, name, domain and collection_methods. Next: call get_scraper_details with a dataset_id and one method.
  • get_scraper_detailsShow the scraper description, input fields, example input and main output fields for one method. Call before run_scraper and build the input from sample_input or input_fields. Records may contain more fields than output_fields lists.
  • run_scraperRun a scraper method. input is a list of objects shaped like sample_input from get_scraper_details, one per URL or query. collect_by_url returns one record per input; discover_by_* methods return up to limit_per_input records per input, and every record is billed. Waits up to 45 seconds; if still running it returns snapshot_id with status "running": then poll get_scraper_progress and call get_scraper_results when ready. Records with an "error" field explain failed inputs.
  • get_scraper_progressStatus of a run: starting, running, ready, failed or canceled.
  • get_scraper_resultsRecords of a finished run. Returns status "running" if not ready yet.
  • refresh_scrapersReload the scraper list now instead of waiting for the daily refresh.

Crw tools 8

  • crw_scrapeScrape one URL to markdown, HTML, or links.
  • crw_crawlStart an async site crawl; returns a job id to poll with crw_check_crawl_status.
  • crw_check_crawl_statusPoll an async crawl job and retrieve its pages.
  • crw_mapDiscover URLs on a site via sitemap and/or a short crawl. Returns a URL list only, no page content.
  • crw_extractExtract structured JSON from URLs via a prompt and/or JSON schema. Async job — poll crw_check_extract_status with the returned id. Needs an LLM.
  • crw_check_extract_statusPoll an extract job; returns status and, when complete, a per-URL results array.
  • crw_cancel_extractRequest cancellation of an extract job. Returns the canonical status; cancelling remains non-terminal until the claimed URL settles.
  • crw_parse_fileParse a local PDF (base64 in contentBase64) to markdown. No OCR: scanned PDFs return empty markdown with a warning.

Ready-to-paste client configs

Paste either block (or both) into your client config, e.g. claude_desktop_config.json or ~/.cursor/mcp.json. We only show a config when the install command is confirmed.

Brightdata MCP

mcpServers (Claude Desktop / Cursor)
{
  "mcpServers": {
    "brightdata-mcp": {
      "command": "npx",
      "args": [
        "@brightdata/mcp"
      ],
      "env": {
        "API_TOKEN": "YOUR_API_TOKEN_HERE"
      }
    }
  }
}

Crw

mcpServers (Claude Desktop / Cursor)
{
  "mcpServers": {
    "us-crw": {
      "command": "npx",
      "args": [
        "-y",
        "crw-mcp@latest"
      ],
      "env": {
        "CRW_API_KEY": "YOUR_CRW_API_KEY_HERE"
      }
    }
  }
}

Frequently asked questions

Brightdata MCP is categorized under Search & Data Extraction and uses a local stdio subprocess. Crw belongs to Search & Data Extraction and uses a local stdio subprocess. Pick Brightdata MCP for search & data extraction work and Crw for search & data extraction.

Copy the mcpServers block from the config section on this page into your client's config (for example claude_desktop_config.json or ~/.cursor/mcp.json), then fully restart the client.

Brightdata MCP is listed as freemium — a free tier with paid plans. Auth: api key required. Crw is listed as freemium — a free tier with paid plans. Auth: oauth 2.0. If a server needs environment variables such as API keys, define them under the env key in your client's MCP config.

Yes. MCP clients support multiple servers: add brightdata-mcp and us-crw as separate keys in the same mcpServers object, and your assistant will call tools from either one.

On AllMCPs, Brightdata MCP has a quality signal of 73/100 (Great) with 4 views, 0 installs and 2,684 GitHub stars. Crw has 72/100 (Great) with 5 views, 0 installs and 1,161 GitHub stars.