CRW Web Scraper vs Lookacrawler

A side-by-side look at the CRW Web Scraper and Lookacrawler MCP servers: transport, auth, tools, quality signals, and the config to install either one in Claude, Cursor, Windsurf or VS Code.

CRW Web Scraper logoCRW Web ScraperSearch & Data Extraction · Local subprocess (stdio)Open-source web scraper for AI agents with scrape, crawl, and map tools53GoodAuth: api key requiredLookacrawler logoLookacrawlerSearch & Data ExtractionFree, open-source, token-efficient local alternative to Firecrawl with native MCP Server for LLMs (>73% token reduction, Playwright stealth anti-bot bypass).45FairAuth: no auth required

Verdict: choose CRW Web Scraper for search & data extraction work as a local process; choose Lookacrawler for search & data extraction. You can also run both side by side in one mcpServers block.

Which MCP server should you choose?

CRW Web Scraper logoChoose CRW Web Scraper when

  • You need dedicated capabilities in the Search & Data Extraction domain.
  • You prefer a local stdio subprocess transport.
  • Its auth model fits you: API key required.
  • You have the keys it needs: CRW_API_KEY, CRW_NO_AGENTS.
Explore CRW Web Scraper

Lookacrawler logoChoose Lookacrawler when

  • You need dedicated capabilities in the Search & Data Extraction domain.
  • Its auth model fits you: No auth required.
Explore Lookacrawler

Feature & specification comparison

Rows where the two servers differ are marked.

SpecCRW Web Scraper logoCRW Web ScraperLookacrawler logoLookacrawler
CategorySearch & Data ExtractionSearch & Data Extraction
Quality signal53/100 · Good45/100 · Fair
Install commandConfirmedNot confirmed yet
TransportLocal subprocess (stdio)—
AuthAPI key requiredNo auth required
PricingNot declaredFree
Required env varsCRW_API_KEYCRW_NO_AGENTSNone listed
Verified ownerCommunity listingCommunity listing
GitHub stars1,1723
Directory activity 1 views 0 installs 0 upvotes 1 views 0 installs 0 upvotes
ToolsNot listedNot listed

Tools & capabilities

CRW Web Scraper tools

No tool names declared yet. Check the project README from the listing page.

Lookacrawler tools

No tool names declared yet. Check the project README from the listing page.

Ready-to-paste client configs

Paste either block (or both) into your client config, e.g. claude_desktop_config.json or ~/.cursor/mcp.json. We only show a config when the install command is confirmed.

CRW Web Scraper

mcpServers (Claude Desktop / Cursor)
{
  "mcpServers": {
    "crw-web-scraper": {
      "command": "npx",
      "args": [
        "-y",
        "crw-mcp@latest"
      ],
      "env": {
        "CRW_API_KEY": "YOUR_CRW_API_KEY_HERE",
        "CRW_NO_AGENTS": "YOUR_CRW_NO_AGENTS_HERE"
      }
    }
  }
}

Lookacrawler

No confirmed install command for Lookacrawler yet — follow the setup steps linked from its listing page rather than a guessed package name.

Frequently asked questions

CRW Web Scraper is categorized under Search & Data Extraction and uses a local stdio subprocess. Lookacrawler belongs to Search & Data Extraction and uses an install path we have not confirmed yet. Pick CRW Web Scraper for search & data extraction work and Lookacrawler for search & data extraction.

Copy the mcpServers block from the config section on this page into your client's config (for example claude_desktop_config.json or ~/.cursor/mcp.json), then fully restart the client. Lookacrawler has no confirmed install command yet — follow its own setup instructions.

CRW Web Scraper has no declared pricing — check the project's own site. Auth: api key required. Lookacrawler is listed as free. Auth: no auth required. If a server needs environment variables such as API keys, define them under the env key in your client's MCP config.

Yes. MCP clients support multiple servers: add crw-web-scraper and lucasmartins-ai-lookacrawler as separate keys in the same mcpServers object, and your assistant will call tools from either one.

On AllMCPs, CRW Web Scraper has a quality signal of 53/100 (Good) with 1 views, 0 installs and 1,172 GitHub stars. Lookacrawler has 45/100 (Fair) with 1 views, 0 installs and 3 GitHub stars.