Markcrawl vs CRW Web Scraper

A side-by-side look at the Markcrawl and CRW Web Scraper MCP servers: transport, auth, tools, quality signals, and the config to install either one in Claude, Cursor, Windsurf or VS Code.

Markcrawl logoMarkcrawlSearch & Data Extraction · Local subprocess (stdio)Crawl websites into clean Markdown, search pages, and extract structured data with LLMs. Built-in MCP server for web research and RAG pipelines.51GoodAuth: no auth requiredCRW Web Scraper logoCRW Web ScraperSearch & Data Extraction · Local subprocess (stdio)Open-source web scraper for AI agents with scrape, crawl, and map tools53GoodAuth: api key required

Verdict: choose Markcrawl for search & data extraction work as a local process; choose CRW Web Scraper for search & data extraction as a local process. You can also run both side by side in one mcpServers block.

Which MCP server should you choose?

Markcrawl logoChoose Markcrawl when

  • You need dedicated capabilities in the Search & Data Extraction domain.
  • You prefer a local stdio subprocess transport.
  • Its auth model fits you: No auth required.
Explore Markcrawl

CRW Web Scraper logoChoose CRW Web Scraper when

  • You need dedicated capabilities in the Search & Data Extraction domain.
  • You prefer a local stdio subprocess transport.
  • Its auth model fits you: API key required.
  • You have the keys it needs: CRW_API_KEY, CRW_NO_AGENTS.
Explore CRW Web Scraper

Feature & specification comparison

Rows where the two servers differ are marked.

SpecMarkcrawl logoMarkcrawlCRW Web Scraper logoCRW Web Scraper
CategorySearch & Data ExtractionSearch & Data Extraction
Quality signal51/100 · Good53/100 · Good
Install commandConfirmedConfirmed
TransportLocal subprocess (stdio)Local subprocess (stdio)
AuthNo auth requiredAPI key required
PricingFreeNot declared
Required env varsNone listedCRW_API_KEYCRW_NO_AGENTS
Verified ownerCommunity listingCommunity listing
GitHub stars51,172
Directory activity 6 views 0 installs 1 upvotes 1 views 0 installs 0 upvotes
ToolsNot listedNot listed

Tools & capabilities

Markcrawl tools

No tool names declared yet. Check the project README from the listing page.

CRW Web Scraper tools

No tool names declared yet. Check the project README from the listing page.

Ready-to-paste client configs

Paste either block (or both) into your client config, e.g. claude_desktop_config.json or ~/.cursor/mcp.json. We only show a config when the install command is confirmed.

Markcrawl

mcpServers (Claude Desktop / Cursor)
{
  "mcpServers": {
    "aimlpm-markcrawl": {
      "command": "npx",
      "args": [
        "-y",
        "clawhub"
      ]
    }
  }
}

CRW Web Scraper

mcpServers (Claude Desktop / Cursor)
{
  "mcpServers": {
    "crw-web-scraper": {
      "command": "npx",
      "args": [
        "-y",
        "crw-mcp@latest"
      ],
      "env": {
        "CRW_API_KEY": "YOUR_CRW_API_KEY_HERE",
        "CRW_NO_AGENTS": "YOUR_CRW_NO_AGENTS_HERE"
      }
    }
  }
}

Frequently asked questions

Markcrawl is categorized under Search & Data Extraction and uses a local stdio subprocess. CRW Web Scraper belongs to Search & Data Extraction and uses a local stdio subprocess. Pick Markcrawl for search & data extraction work and CRW Web Scraper for search & data extraction.

Copy the mcpServers block from the config section on this page into your client's config (for example claude_desktop_config.json or ~/.cursor/mcp.json), then fully restart the client.

Markcrawl is listed as free. Auth: no auth required. CRW Web Scraper has no declared pricing — check the project's own site. Auth: api key required. If a server needs environment variables such as API keys, define them under the env key in your client's MCP config.

Yes. MCP clients support multiple servers: add aimlpm-markcrawl and crw-web-scraper as separate keys in the same mcpServers object, and your assistant will call tools from either one.

On AllMCPs, Markcrawl has a quality signal of 51/100 (Good) with 6 views, 0 installs and 5 GitHub stars. CRW Web Scraper has 53/100 (Good) with 1 views, 0 installs and 1,172 GitHub stars.