Log inSubmit server
Olostep MCP Server logo

Olostep MCP Server

by olostep

Searches, extracts, crawls, and structures web data through Olostep, with citations, URL discovery, and batch jobs.

InstallRepositoryWebsite
Full README Compare alternatives Embed widget Claim this listing

Install Olostep MCP Server

Pick your client, then add it in one click or paste the config.

STDIONode.js
~/Library/Application Support/Claude/claude_desktop_config.json
claude_desktop_config.json
{
  "mcpServers": {
    "olostep-olostep-mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "olostep-mcp"
      ],
      "env": {
        "OLOSTEP_API_KEY": "YOUR_VALUE_HERE"
      }
    }
  }
}

Settings → Developer → Edit Config, merge this into mcpServers, then fully quit and reopen Claude Desktop.

Values are written into the snippet above so you can paste it as is. They never leave your browser.

Install not yet sandbox-tested— the server itself is confirmed live (we called its tools/list endpoint). The stdio install command is a separate, ongoing check.

Overview

olostep/olostep-mcp-server connects MCP clients to Olostep for web search, page extraction, URL discovery, autonomous crawling, and AI-generated answers with citations. It supports single-page scraping in HTML, Markdown, JSON, or plain text, plus JavaScript rendering, parsers, country-specific routing, and configurable wait times. Use create_crawl for asynchronous whole-site scraping, batch_scrape_urls for a known set of URLs, and answers for bounded factual questions. The server is available through a hosted MCP endpoint or local npx and Docker deployments.

Use cases

  • Scrape a JavaScript-rendered product page into Markdown or JSON
  • Crawl a website and collect discovered page content
  • Search the web for structured, parser-based results
  • Answer bounded factual questions with sources and citations
  • Process a known list of URLs in a batch

Key features

  • Single-page extraction in HTML, Markdown, JSON, or plain text
  • Parser-based web search and AI answers with citations
  • Autonomous asynchronous site crawling
  • Batch scraping for up to 10,000 URLs
  • URL discovery with filtering support
  • Country routing and configurable JavaScript wait times

Tools10

What Olostep MCP Server lets your agent do. Expand a tool for its parameters.

Verified live~2.8k tokens of context

Security & health

What it can reach and how reliably it runs — from our own checks, not the maintainer’s claims.

ActiveLast checked 2d ago

Recent health check succeeded.

17/18 checks healthy over the last 79d

Supply-chain signal

No high-severity advisories surfaced by our automated scan.

Critical 0High 0Medium 0Low 0

Scanned 8d ago via OSV.dev · olostep-mcp (npm)

Adoption & maintenance

Factual signals from GitHub, npm, and our automated checks — not a rating.

GitHub stars25Stargazers on the source repository.
npm downloads869Package downloads in the last 30 days.
Last commit2d agoMost recent push to the default branch.
Tools exposed10Callable tools this server registers over MCP.
Directory activity2 viewsConfig copies, upvotes, and views on AllMCPs.

How Olostep MCP Server works

What olostep/olostep-mcp-server does

Olostep exposes web search and data extraction capabilities through MCP. It can retrieve one webpage, return structured search results, discover URLs on a site, crawl a site from a starting URL, scrape a known list of URLs, or answer factual questions using web research. AI answers include sources and citations and can be shaped into a flat JSON object.

Single-page extraction supports HTML, Markdown, JSON, and plain text output. Optional parsers can specialize extraction for supported use cases. Requests can also specify a country for localized content and a delay before scraping JavaScript-heavy pages.

How it works

The server can be consumed through the hosted endpoint at https://mcp.olostep.com/mcp, authenticated with an Olostep API key in a Bearer token. It can also run locally through the olostep-mcp npm package or the published Docker image.

Whole-site crawling is asynchronous. Call create_crawl with a starting URL; it follows links, discovers pages, and scrapes them in the background. Use the returned crawl_id with get_crawl_results to check progress and retrieve the pages. Poll again while the job is still running, roughly every 10 seconds.

Known URL lists use a separate workflow. batch_scrape_urls starts a batch and returns a batch_id; get_batch_results retrieves its status and content. Batch jobs can take approximately five to eight minutes, and the batch tool is intended for explicit URLs, including URLs from unrelated domains, rather than whole-site crawling.

Setup and configuration

An Olostep account and API key are required. Set the key as OLOSTEP_API_KEY when running the local package or Docker image. The optional ORBIT_KEY supports routing requests through Orbit.

Run the package without a global installation with:

bash
env OLOSTEP_API_KEY=your-api-key npx -y olostep-mcp

The Docker option uses the olostep/mcp-server image and passes the same environment variable. Client configurations are documented for Claude Desktop, Cursor, Claude Code, Windsurf, Cline, VS Code, and Gemini CLI. These clients can use either the hosted endpoint or a local stdio process, depending on the configuration. Gemini CLI stores the API key in its sensitive extension settings.

Tools and capabilities

  • scrape_website extracts one URL with selectable output format, JavaScript wait time, country routing, and an optional parser.
  • search_web returns structured, parser-based web search results without an AI-generated answer.
  • answers researches a factual question and returns citations, with optional JSON-shaped output.
  • get_webpage_content retrieves webpage content as Markdown.
  • create_map lists URLs discovered on a website without scraping their content.
  • get_website_urls finds relevant URLs matching a website search query, also without scraping.
  • create_crawl and get_crawl_results handle autonomous, multi-page site crawling.
  • batch_scrape_urls and get_batch_results process a specific list of URLs, with support for batches of up to 10,000 URLs.

Limitations and notes

URL discovery tools return links rather than page content. Use create_crawl when the objective is to scrape an entire site, and reserve batch_scrape_urls for an already-known URL list. answers is intended for bounded factual questions; it is not suited to reliably enumerating a live list from a page, such as the newest posts and their dates. Crawl and batch jobs return asynchronously, so their companion result tools are required to obtain completed content.

Read the full README View source on GitHub

Reviews

No reviews yet — be the first to share how it worked for you.

Frequently Asked Questions about Olostep MCP Server

olostep/olostep-mcp-server is an MCP server that connects AI clients to Olostep for web search and extraction. Its main tools scrape individual pages, discover URLs, crawl sites, process known URL batches, retrieve Markdown, and generate cited answers or structured search results.

Install it by running the `olostep-mcp` package with npx, launching the official Docker image, or connecting to the hosted MCP endpoint. Set `OLOSTEP_API_KEY` for local or Docker use, or send the key as a Bearer token to the remote endpoint.

Use `create_crawl` with a starting URL, then pass its returned `crawl_id` to `get_crawl_results`. The crawl runs asynchronously, discovers pages by following links, and returns scraped content after completion; poll the results tool while the job remains in progress.

Yes. Use `batch_scrape_urls` when you already have a specific list, including URLs from different domains, and then call `get_batch_results` with the returned `batch_id`. Batch processing supports up to 10,000 URLs and may take roughly five to eight minutes.

Yes. Cursor can connect through the hosted MCP endpoint with an Authorization Bearer header or run the server locally with npx and `OLOSTEP_API_KEY`. The remote configuration belongs in the project’s `.cursor/mcp.json` file.

Related MCP servers

All in Search & Data Extraction All alternatives
Add a badge to your READMEShow it’s listed — live SVG, Markdown or HTML.

AllMCPs Directory Badge

Full Badge Customizer

Showcase your server listing on GitHub or your project documentation. Embed this dynamic SVG badge to highlight official listing status and live engagement.

Badge Style:
Live Dynamic SVG PreviewOlostep MCP Server AllMCPs Directory Badge
Markdown (GitHub README)
[![AllMCPs](https://allmcps.com/api/badge/olostep-olostep-mcp-server?style=directory)](https://allmcps.com/mcp/olostep-olostep-mcp-server)
HTML Embed
<a href="https://allmcps.com/mcp/olostep-olostep-mcp-server"><img src="https://allmcps.com/api/badge/olostep-olostep-mcp-server?style=directory" alt="Olostep MCP Server on AllMCPs" /></a>