Log inSubmit server
Scrapling MCP Server logo

Scrapling MCP Server

MCP access to Scrapling for fetching, rendering, parsing, and extracting data from websites.

InstallRepositoryWebsite
Full README Compare alternatives Embed widget Claim this listing

Install Scrapling MCP Server

Pick your client, then add it in one click or paste the config.

STDIOPython
~/Library/Application Support/Claude/claude_desktop_config.json
claude_desktop_config.json
{
  "mcpServers": {
    "scrapling-mcp-server": {
      "command": "uvx",
      "args": [
        "scrapling"
      ]
    }
  }
}

Settings → Developer → Edit Config, merge this into mcpServers, then fully quit and reopen Claude Desktop.

Install not yet sandbox-tested— we haven't run this command through our automated sandbox yet. Not a red flag; we're working through the catalog.

Overview

Scrapling MCP Server exposes Scrapling's web-scraping workflow to AI agents, connecting them with websites for browsing and data extraction. It combines fast HTTP fetching, stealth browsers, JavaScript rendering, page interaction, and CSS-based parsing, with support for XPath, text, and regular-expression searches. Reach for it when an agent needs to inspect a web page, extract structured fields, render dynamic content, or collect clean Markdown from sites. Scrapling also supports Cloudflare Turnstile and interstitial handling, concurrent crawling, proxy rotation, retries, and export-oriented scraping workflows.

Use cases

  • Extract fields from static web pages with CSS selectors
  • Render JavaScript-driven sites before collecting content
  • Collect page content as clean Markdown
  • Crawl multiple pages with retries and proxy rotation
  • Capture data from browser-triggered API calls

Key features

  • HTTP and stealth-browser fetching
  • JavaScript rendering and page interaction
  • CSS, XPath, text, and regex extraction
  • Cloudflare Turnstile and interstitial handling
  • Concurrent crawling with proxy rotation
  • JSON, JSONL, CSV, and XML exports

Security & health

What it can reach and how reliably it runs — from our own checks, not the maintainer’s claims.

ActiveLast checked Today

Recent health check succeeded.

52/53 checks healthy over the last 91d

Supply-chain signal

No high-severity advisories surfaced by our automated scan.

Critical 0High 0Medium 0Low 0

Scanned 5d ago via OSV.dev · scrapling (PyPI)

Adoption & maintenance

Factual signals from GitHub, npm, and our automated checks — not a rating.

GitHub stars100kStargazers on the source repository.
Last commitTodayMost recent push to the default branch.
Directory activity8 viewsConfig copies, upvotes, and views on AllMCPs.

How Scrapling MCP Server works

What Scrapling MCP Server does

Scrapling MCP Server brings Scrapling's Python web-scraping framework into an MCP workflow for AI agents. It allows an agent to browse pages and extract information from websites rather than limiting scraping to manually written Python programs or terminal commands.

The underlying framework covers both simple page retrieval and larger crawling jobs. It can fetch static HTML with HTTP requests, use stealth browsers for JavaScript-heavy sites, interact with pages, and capture data from API calls made in the background. The server is suited to one-page extraction as well as workflows that need to traverse and collect content across a site.

How it works

An agent uses the MCP interface to request web content and extraction operations through Scrapling. Retrieved pages can be queried with CSS selectors, XPath, text searches, or regular expressions. Scrapling also provides adaptive element tracking and matching for similar elements, which can help identify repeated structures in a page. Extracted content can be returned as clean Markdown when that format is more useful than raw page markup.

For broader collection tasks, Scrapling provides concurrent spiders with reusable sessions, proxy rotation, automatic retries, AutoThrottle, pause and resume support, and streaming. These capabilities make the same framework applicable to both targeted lookups and multi-page crawls.

Tools and capabilities

  • Fetch pages through fast HTTP requests or stealth browsers.
  • Render JavaScript and interact with websites.
  • Handle Cloudflare Turnstile and interstitial challenges.
  • Capture API calls made in the background by pages.
  • Select content with CSS, XPath, text, and regular expressions.
  • Track adaptive elements and find similar page elements.
  • Produce clean Markdown from scraped content.
  • Run concurrent crawlers with proxy rotation, retries, throttling, and pause/resume support.
  • Export crawl results as JSON, JSONL, CSV, or XML.

Limitations and notes

Scrapling is intended for web scraping and extraction, so the quality of an agent's result depends on the target site's structure, accessibility, and behavior. Static pages can use ordinary HTTP fetching, while JavaScript-driven or interactive pages may require a browser-based fetcher. Proxy rotation, crawling controls, and export features are part of Scrapling's wider framework and are relevant when an MCP task expands beyond a single page.

The project can also be used directly from Python, through its command-line interface, or with an interactive shell. The MCP server is one access path alongside those interfaces, allowing an AI agent to use the same scraping framework.

Read the full README View source on GitHub

Reviews

No reviews yet — be the first to share how it worked for you.

Frequently Asked Questions about Scrapling MCP Server

Scrapling MCP Server is an MCP server that connects AI agents to websites through Scrapling's web-scraping framework. Its main capabilities include fetching pages over HTTP or stealth browsers, rendering JavaScript, interacting with sites, searching content with CSS and other selectors, and extracting page data or clean Markdown.

Scrapling MCP Server can extract content using CSS selectors, XPath, text searches, and regular expressions. It also supports adaptive element tracking, similar-element matching, and clean Markdown output for pages where an agent needs readable content rather than raw markup.

Yes, Scrapling MCP Server supports JavaScript rendering through stealth browsers. It can also interact with websites, handle Cloudflare Turnstile and interstitials, and capture API calls made in the background by a page.

Yes, Scrapling MCP Server can use Scrapling's concurrent spider features for multi-page collection. The framework includes reusable sessions, proxy rotation, automatic retries, AutoThrottle, pause and resume, streaming, and exports to JSON, JSONL, CSV, or XML.

Related MCP servers

All in Search & Data Extraction All alternatives
Add a badge to your READMEShow it’s listed — live SVG, Markdown or HTML.

AllMCPs Directory Badge

Full Badge Customizer

Showcase your server listing on GitHub or your project documentation. Embed this dynamic SVG badge to highlight official listing status and live engagement.

Badge Style:
Live Dynamic SVG PreviewScrapling MCP Server AllMCPs Directory Badge
Markdown (GitHub README)
[![AllMCPs](https://allmcps.com/api/badge/scrapling-mcp-server?style=directory)](https://allmcps.com/mcp/scrapling-mcp-server)
HTML Embed
<a href="https://allmcps.com/mcp/scrapling-mcp-server"><img src="https://allmcps.com/api/badge/scrapling-mcp-server?style=directory" alt="Scrapling MCP Server on AllMCPs" /></a>