web-scrapingdata-extractionsearchcrawlingmcp
Connects MCP-compatible AI clients to ScrapeGraph AI for web scraping, extraction, search, crawling, schemas, and account data.
Quick Install
Automated & IDE SetupCopy the AI prompt to install this server into Claude Code, Cursor, or another agent — or use 1-click editor setup below.
Not yet automatically verified
We haven't yet run this listing's install command through our automated sandbox check. This isn't a red flag — we're steadily working through the catalog.
Manual Client & Custom JSON ConfigExpand JSON ▾
Client Config & Setup
Configure Environment Variables (API Keys, Tokens, Options):
Add required secrets below — values are included directly in the generated snippet so you can copy and paste with confidence.
Quick Add:
Choose your client or environment
Target File:
💡 Paste the JSON block into your client's configuration file under mcpServers, then restart the application.
Overview
Use cases
Scrape web pages into markdown, HTML, screenshots, or summaries
Extract product or page data with prompts and optional schemas
Search the web with country and time-range filters
Crawl multiple pages and poll for completion
Generate JSON Schemas for structured extraction
Key features
Multi-format web scraping
Prompt-based structured extraction
Web search with filters
Asynchronous crawling
JSON Schema generation
Paginated history and activity data
Capabilities & Tool Schemas (9)
Inspect callable tools, capabilities, and parameters exposed to AI agents by ScrapeGraphAI Scrapegraph MCP.
scrapePOST /scrape (`output_format`: markdown, html, screenshot, branding, links, images, summary)
extractPOST /extract (requires `website_url` + `user_prompt`; optional `output_schema`)
searchPOST /search (`num_results` 1–20; supports `country_search`, `time_range`, `output_schema`)
crawl_startPOST /crawl — `extraction_mode` markdown / html / links / images / summary / branding / screenshot
crawl_get_statusGET /crawl/:id (poll until `status: completed`)
schemaPOST /schema (generate or augment a JSON Schema from a prompt)
How ScrapeGraphAI Scrapegraph MCP works
What ScrapeGraphAI-scrapegraph-mcp does
ScrapeGraphAI-scrapegraph-mcp exposes ScrapeGraph AI API v2 through the Model Context Protocol. It is intended for agents that need to retrieve and transform web content without implementing direct HTTP calls to the ScrapeGraph service themselves.
The server supports single-page scraping, prompt-based extraction, web search, asynchronous multi-page crawling, JSON Schema generation, and account-related queries. Scraping can return markdown, HTML, screenshots, branding information, links, images, or summaries. Extraction takes a website URL and a user prompt, with an optional output schema for structured results.
How it works
Requests are forwarded to the ScrapeGraph API v2 base URL, which defaults to https://v2-api.scrapegraphai.com/api. Authentication uses the SGAI-APIKEY header. An API key can be supplied through the environment or through the MCP configuration mechanisms described by the project.
The search tool accepts a result count from 1 to 20 and can use country, time-range, and schema options. For larger jobs, crawl_start begins an asynchronous crawl and returns an identifier. Call crawl_get_status with that identifier and continue polling until the response reports status: completed.
The schema tool can create or extend a JSON Schema from a prompt. history provides paginated request history with an optional service filter, while monitor_activity returns paginated activity records containing fields such as status, change information, elapsed time, and diffs.
Setup and configuration
ScrapeGraphAI-scrapegraph-mcp requires a ScrapeGraph API key, available from the ScrapeGraph Dashboard. The repository supports Python 3.13 or later and installation with either pip or uv. After installing the package, run scrapegraph-mcp or python -m scrapegraph_mcp.server; local communication uses standard input and output.
The primary environment variables are:
SGAI_API_KEY: API key used to authenticate with ScrapeGraph.SGAI_API_URL: optional replacement for the default API base URL.SGAI_TIMEOUT: optional request timeout in seconds; the documented default is 120.
The older names SCRAPEGRAPH_API_BASE_URL and SGAI_TIMEOUT_S remain supported as aliases. Smithery installation is documented for Claude Desktop, and the repository also provides local and remote configuration examples for Claude Desktop and Cursor. The hosted endpoint documented for new integrations is https://sgai-mcp-main.onrender.com; the older mcp.scrapegraphai.com/mcp endpoint is marked for deprecation.
Tools and capabilities
scrape: retrieves a page in a selected output format.extract: extracts information from a URL using a user prompt and optional schema.search: searches for web results with filtering and schema options.crawl_start: starts a crawl with a selected extraction mode.crawl_get_status: checks the status of a crawl by ID.schema: generates or augments a JSON Schema.credits: retrieves account credit information.history: lists paginated service history.monitor_activity: lists paginated activity ticks for a monitor.
Limitations and notes
The server targets ScrapeGraph API v2, so requests depend on that service, its API key, and available account credits. Crawl operations are asynchronous and require status polling. The repository documents the removal of older names and features, including markdownify, sitemap, and agentic_scrapper; markdown output should be requested through scrape instead. ScrapeGraphAI-scrapegraph-mcp does not replace the underlying API's access, rate, or service requirements.
Related MCP Servers
Adoption & maintenance
Factual signals from GitHub, npm, and our automated checks — not a rating.
GitHub stars
115
Stargazers on the source repository.
Last commit
2mo ago
Most recent push to the default branch.
Tools exposed
9
Callable tools this server registers over MCP.
Reviews
No reviews yet — be the first to share how this listing worked for you.
Frequently Asked Questions about ScrapeGraphAI Scrapegraph MCP
AllMCPs Directory Badge
Showcase your server listing on GitHub or your project documentation. Embed this dynamic SVG badge to highlight official listing status and live engagement.
Badge Style:
Live Dynamic SVG Preview
Markdown (GitHub README)
[](https://allmcps.com/mcp/scrapegraphai-scrapegraph-mcp)HTML Embed
<a href="https://allmcps.com/mcp/scrapegraphai-scrapegraph-mcp"><img src="https://allmcps.com/api/badge/scrapegraphai-scrapegraph-mcp?style=directory" alt="ScrapeGraphAI Scrapegraph MCP on AllMCPs" /></a>Technical Specs & Signals
CategorySearch & Data Extraction
15/15 checks healthy over the last 59d
51Quality signal: Good · 51/100How this signal is calculated ▾
Server availabilityNot measured
Not scored for repo-hosted servers — we can't reach the running server, only its GitHub page. Hosted MCP endpoints are health-checked live.
Verified ownership7/20
Documentation & tools25/30
Adoption & activity6/15
Community engagement0/10
A guidance signal from public completeness & health data — not a user rating. New listings start lower and rise as they add docs, get verified, and grow adoption. Signals we can't observe for a listing are skipped, not counted against it.
Supply-chain signal
1 high-severity advisory on record for this package. Most advisories affect transitive dependencies and may not be exploitable in this server's actual usage — this is a directional signal, not a security audit.
Critical 1High 0Medium 0Low 1
Scanned 3d ago via OSV.dev · google-adk (PyPI)
Own this project?
This directory is pre-filled from public sources. Claim via GitHub README, site badge, or DNS TXT to unlock edit access and the Official badge — proof is checked automatically, then reviewed by our team.
Free dofollow backlink: add your website and place the AllMCPs badge on it — no claim needed. We detect it automatically and keep it verified as long as the badge stays live.
Claim & get free dofollowShare & Embed
Add our SVG badge (dark/light directory styles) or embeddable widget to your site.