Agent Scrape

What hshintelligence/agent-scrape MCP server does

The hshintelligence/agent-scrape MCP server gives agents access to web retrieval and browser-oriented operations through six MCP tools. It can return a webpage as markdown, HTML, text, or JSON; extract fields from a page using a natural-language request and JSON schema; capture PNG screenshots; and collect common page metadata such as titles, descriptions, Open Graph fields, Twitter cards, JSON-LD, and canonical URLs.

The service also supports stateful browser sessions with cookie and localStorage persistence. Its workflow tool groups browser actions into a single execution, including navigation, clicking, typing, waiting, scrolling, screenshots, extraction, and evaluation. These capabilities fit agents that need more than a one-shot HTTP fetch, such as inspecting dynamic pages or carrying state between browser operations.

How it works

The hosted service is available through a Streamable HTTP MCP endpoint and through separate HTTP routes. MCP clients initialize against the service, discover the tools, and invoke them through tools/call. Payment information is exposed in the MCP tool listing, allowing an x402-capable client to complete the payment flow when it calls a paid tool.

Payments use USDC on Base mainnet. A request that lacks payment receives an x402 response containing payment requirements; the agent signs the transfer with its wallet, and the facilitator settles it before the service returns the result. The HTTP API also exposes free discovery endpoints for the service profile, x402 manifest, OpenAPI document, and agent-oriented text description.

At the time described in the repository, tool calls cost $0.001 during the mainnet validation window. The listed production prices vary by operation, from $0.001 for browser sessions to $0.008 for workflows. The HTTP API provides ten free calls per wallet address every 30 days when the wallet is supplied in the X-402-Payer header. That free tier does not apply to MCP calls.

Setup and configuration

Configure hshintelligence/agent-scrape MCP server in a compatible client with the hosted endpoint:

{
  "mcpServers": {
    "agent-scrape": {
      "url": "https://agent-scrape.healingsunhaven.workers.dev/mcp",
      "transport": "streamable-http"
    }
  }
}

The README specifically identifies Claude Desktop and Cursor as supported MCP clients. A client must be configured with an x402-compatible wallet to complete paid MCP calls. No signup or API key is required, but using the paid operations requires USDC on Base and the ability to sign the payment. The service itself runs remotely, so this configuration does not require installing a local package or setting server environment variables.

Tools and capabilities

• scrape_webpage: Retrieve a URL in markdown, HTML, text, or JSON formats.
• extract_structured_data: Produce structured results from a page using a prompt and optional JSON schema. The implementation uses Groq and Llama 4 Scout for this extraction path.
• screenshot_webpage: Capture a PNG with desktop, mobile, or tablet viewport settings and optional full-page output.
• extract_metadata: Read page metadata, social card fields, JSON-LD, and canonical URLs.
• create_browser_session: Create a browser session that preserves cookies and localStorage.
• run_workflow: Execute navigation and browser actions such as click, type, wait, scroll, screenshot, extract, and evaluate.

Limitations and notes

hshintelligence/agent-scrape MCP server is a paid remote service rather than a local scraper package. The payment model depends on an x402-compatible wallet and USDC on Base, so it is not suitable for a client that cannot sign blockchain payments. MCP calls do not receive the HTTP API's ten-call free allowance.

Pricing is described in terms of a launch validation window and later production rates; the repository also says bulk discounts are planned, not necessarily available. The service depends on its hosted Cloudflare Workers deployment and connected browser, extraction, storage, and payment infrastructure. The repository identifies the project license as MIT.