The full upstream README, mirrored here for reference. Install config, tool schemas, adoption signals, and an original overview live on the Smart Crawler listing page.
E-commerce competitor intelligence, VOC review sentiment, Amazon ASIN analysis, Google Shopping landscape, on-demand URL scraping, and Reddit subreddit growth playbooks — exposed to AI agents as a hosted Model Context Protocol server.
https://smartcrawler.io/mcp/ (streamable-http)Authorization: Bearer sck_... — generate a key in the smart-crawler consoleio.github.shulex-voc/smart-crawlerThis repository hosts the public MCP manifest for the smart-crawler service. It is the discovery/connection entry point — the service itself is hosted.
--scope user makes the server visible in every project. Without it,
claude mcp add defaults to local scope (only the current directory), a common
"I added it but /mcp is empty" pitfall. Verify with claude mcp list or /mcp.
~/.codex/config.toml)Point your client at https://smartcrawler.io/mcp/ over streamable-http and send
your API key as a Bearer token. See mcp.json for the full tool list
and server.json for the registry manifest.
| Tool | What it does |
|---|---|
reddit_subreddit_playbook | Full growth playbook for a subreddit's top contributors |
search_competitor_products | Search competitor catalog by brand / country / keyword / price |
get_voc_reviews | Consumer VOC reviews from Trustpilot / Reviews.io / Google Maps |
amazon_voc_report | Amazon ASIN reviews + AI VOC analysis (pain points, listing tips) |
competitor_landscape | Google Shopping merchant-share ranking for a keyword |
scrape_url | One-URL scrape with short-lived agent memory |
query_warehouse | Warehouse-first natural-language query (0 credits) |
Full list in mcp.json.
MIT