E-commerce competitor intelligence, VOC sentiment, Amazon ASIN analysis, Reddit growth playbooks.
Quick Install
Automated & IDE SetupCopy the AI prompt to install this server into Claude Code, Cursor, or another agent — or use 1-click editor setup below.
Manual Client & Custom JSON ConfigExpand JSON ▾
Client Config & Setup
Choose your client or environment
Target File:
💡 Paste the JSON block into your client's configuration file under mcpServers, then restart the application.
Documentation Overview
smart-crawler MCP
E-commerce competitor intelligence, VOC review sentiment, Amazon ASIN analysis, Google Shopping landscape, on-demand URL scraping, and Reddit subreddit growth playbooks — exposed to AI agents as a hosted Model Context Protocol server.
- Endpoint:
https://smartcrawler.io/mcp/(streamable-http) - Auth:
Authorization: Bearer sck_...— generate a key in the smart-crawler console - Registry:
io.github.shulex-voc/smart-crawler
This repository hosts the public MCP manifest for the smart-crawler service. It is the discovery/connection entry point — the service itself is hosted.
Connect
Claude Code
--scope user makes the server visible in every project. Without it,
claude mcp add defaults to local scope (only the current directory), a common
"I added it but /mcp is empty" pitfall. Verify with claude mcp list or /mcp.
Codex (~/.codex/config.toml)
Any MCP client
Point your client at https://smartcrawler.io/mcp/ over streamable-http and send
your API key as a Bearer token. See mcp.json for the full tool list
and server.json for the registry manifest.
Tools (highlights)
| Tool | What it does |
|---|---|
reddit_subreddit_playbook | Full growth playbook for a subreddit's top contributors |
search_competitor_products | Search competitor catalog by brand / country / keyword / price |
get_voc_reviews | Consumer VOC reviews from Trustpilot / Reviews.io / Google Maps |
amazon_voc_report | Amazon ASIN reviews + AI VOC analysis (pain points, listing tips) |
competitor_landscape | Google Shopping merchant-share ranking for a keyword |
scrape_url | One-URL scrape with short-lived agent memory |
query_warehouse | Warehouse-first natural-language query (0 credits) |
Full list in mcp.json.
License
MIT
Related MCP Servers
Reviews
No reviews yet — be the first to share how this listing worked for you.
Frequently Asked Questions about Smart Crawler
AllMCPs Directory Badge
Showcase your server listing on GitHub or your project documentation. Embed this dynamic SVG badge to highlight official listing status and live engagement.
Badge Style:
Live Dynamic SVG Preview
Markdown (GitHub README)
[](https://allmcps.com/mcp/smart-crawler)HTML Embed
<a href="https://allmcps.com/mcp/smart-crawler"><img src="https://allmcps.com/api/badge/smart-crawler?style=directory" alt="Smart Crawler on AllMCPs" /></a>Technical Specs & Signals
CategoryE-Commerce
27Quality signal: Emerging · 27/100How this signal is calculated ▾
Server availabilityNot measured
Not scored for repo-hosted servers — we can't reach the running server, only its GitHub page. Hosted MCP endpoints are health-checked live.
Verified ownership8/20
Documentation & tools11/30
Adoption & activity1/15
Community engagement0/10
A guidance signal from public completeness & health data — not a user rating. New listings start lower and rise as they add docs, get verified, and grow adoption. Signals we can't observe for a listing are skipped, not counted against it.
Own this project?
This directory is pre-filled from public sources. Claim via GitHub README, site badge, or DNS TXT to unlock edit access and the Official badge and attach your website — proof is checked automatically, then reviewed by our team.
Free dofollow backlink: add your website and place the AllMCPs badge on it — no claim needed. We detect it automatically and keep it verified as long as the badge stays live.
Claim & get free dofollowShare & Embed
Add our SVG badge (dark/light directory styles) or embeddable widget to your site.