Skip to main content
AllMCPs
BrowseBestCategoriesStackCompareToolsGuidesBlog
Log in Submit MCP

Stay in the loop

Get new MCP servers and top picks in your inbox.

AllMCPs

The open directory for discovering and installing Model Context Protocol servers.

AllMCPs on GitHub (opens in a new tab)
Launched onTiny Startupstinystartups.com
Explore
  • Browse servers
  • Best MCP servers
  • Categories
  • MCP clients
  • Agent prompts
  • Stack Builder
  • Compare servers
  • Random discovery New
  • Submit a server
  • Pricing & Boost Boost
Learn
  • Guides hub
  • What is MCP?
  • Install guide
  • Build an MCP server
  • Deploy an MCP server
  • Security guide
  • Troubleshooting
  • MCP for SEO & AEO
  • Protocol versioning
  • Transports: stdio vs HTTP
  • State of MCP (stats)
  • Blog & updates
Tools
  • All developer tools
  • Config generator
  • Config validator
  • Config auditor
  • MCP playground
  • Token calculator
  • OpenAPI β†’ MCP
  • Badge generator
For agents
  • REST API docs
  • Trust & traffic Live
  • Remote MCP server SSE β†— (opens in a new tab)
  • llms.txt β†— (opens in a new tab)
  • Catalog JSON β†— (opens in a new tab)
Company
  • About
  • Advertise Sponsor
  • Contact
  • GitHub β†— (opens in a new tab)
  • Terms
  • Privacy
AllMCPs VerifiedAllMCPs VerifiedFeatured on Nick LaunchesFeatured on Nick LaunchesLaunch Llama NewsletterLaunch Llama NewsletterVerified DR - allmcps.comVerified DR - allmcps.comFeatured on SaaSGrowFeatured on SaaSGrowFeatured on Twelve ToolsFeatured on Twelve ToolsFeatured on Saaspa.geFeatured on Saaspa.geFeatured on Findly.toolsFeatured on Findly.toolsFeatured on Startup FameFeatured on Startup FameFeatured on LaunchKiwiFeatured on LaunchKiwiFeatured on ScrollLaunchFeatured on ScrollLaunchFeatured on DailyPingsFeatured on DailyPingsFazier badgeFazier badgeFeatured on NewTool.siteFeatured on NewTool.siteFeatured on saasfame.comFeatured on saasfame.comDR Checker - Domain RatingDR Checker - Domain RatingListed on Turbo0Listed on Turbo0Launched on LaunchBoard - Product Launch PlatformLaunched on LaunchBoard - Product Launch PlatformList on SimilarlabsList on Similarlabshttps://codetrendy.comhttps://codetrendy.comListed on DevTool.ioFeatured on BuildlistFeatured on BuildlistLaunched on Tiny StartupsFeatured on ShowMeBestAIFeatured on ShowMeBestAIFind us on LaunchZoneFind us on LaunchZoneAllMCPs VerifiedAllMCPs VerifiedFeatured on Nick LaunchesFeatured on Nick LaunchesLaunch Llama NewsletterLaunch Llama NewsletterVerified DR - allmcps.comVerified DR - allmcps.comFeatured on SaaSGrowFeatured on SaaSGrowFeatured on Twelve ToolsFeatured on Twelve ToolsFeatured on Saaspa.geFeatured on Saaspa.geFeatured on Findly.toolsFeatured on Findly.toolsFeatured on Startup FameFeatured on Startup FameFeatured on LaunchKiwiFeatured on LaunchKiwiFeatured on ScrollLaunchFeatured on ScrollLaunchFeatured on DailyPingsFeatured on DailyPingsFazier badgeFazier badgeFeatured on NewTool.siteFeatured on NewTool.siteFeatured on saasfame.comFeatured on saasfame.comDR Checker - Domain RatingDR Checker - Domain RatingListed on Turbo0Listed on Turbo0Launched on LaunchBoard - Product Launch PlatformLaunched on LaunchBoard - Product Launch PlatformList on SimilarlabsList on Similarlabshttps://codetrendy.comhttps://codetrendy.comListed on DevTool.ioFeatured on BuildlistFeatured on BuildlistLaunched on Tiny StartupsFeatured on ShowMeBestAIFeatured on ShowMeBestAIFind us on LaunchZoneFind us on LaunchZone
Β© 2026 Jackalope Digital LLC. All rights reserved.
  1. Home
  2. πŸ”Ž Search & Data Extraction
  3. ActableSite AI Crawler Monitor
ActableSite AI Crawler Monitor logo
Health: ActiveRecent health check succeeded.Last checked 9/21/2026, 7:32:01 PM

ActableSite AI Crawler Monitor

User RatingsBe the first to rate and review this MCP server! Enrichment pendingWe haven’t run our AI enrichment pass on this listing yet, so the overview, use cases, and FAQ below may be sparse or missing. We work through the catalog over time β€” check back soon.
View RepositoryVisit Website

Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.

Quick Install

Automated & IDE Setup

Copy the AI prompt to install this server into Claude Code, Cursor, or another agent β€” or use 1-click editor setup below.

Add to CursorAdd to VS Code
Manual Client & Custom JSON ConfigExpand JSON β–Ύ

Client Config & Setup

Remote HTTP
Choose your client or environment
Target File:~/Library/Application Support/Claude/claude_desktop_config.json
claude_desktop_config.json
{
  "mcpServers": {
    "actablesite-ai-crawler-monitor": {
      "url": "https://actablesite.com/mcp/"
    }
  }
}

πŸ’‘ Paste the JSON block into your client's configuration file under mcpServers, then restart the application.

Install Tool Schemas (5) Directory Badge Claim listing AlternativesπŸ”Ž More in Search & Data Extraction

Capabilities & Tool Schemas (5) ~28 tokensApproximate context cost of this server’s tool schemas (~4 chars/token), before any tool is called. Actual usage depends on your client and model.Self-reported Self-reportedParsed from the repository README, not verified against a live server β€” may be incomplete or out of date.

Inspect callable tools, capabilities, and parameters exposed to AI agents by ActableSite AI Crawler Monitor.

audit_public_website

Callable MCP tool function

check_ai_crawler_policy

Callable MCP tool function

get_crawler_watch_offer

Callable MCP tool function

get_full_report_offer

Callable MCP tool function

get_practice_radar_offer

Callable MCP tool function

Documentation Overview

ActableSite MCP

A remote, read-only MCP server for public website evidence, AI crawler policy, and explicit Crawler Watch, report, and Practice Radar offer metadata.

Tools

It exposes five tools over Streamable HTTP:

  • audit_public_website checks public identity, offer evidence, action paths, discovery files, metadata, and structured data.
  • check_ai_crawler_policy evaluates eight OpenAI, Anthropic, Perplexity, and Google crawler tokens.
  • get_crawler_watch_offer returns the $9 monthly price, one-site scope, 15-minute cadence, confirmation rule, delivery, cancellation, and synthetic-check limitations. It cannot open checkout or purchase anything.
  • get_full_report_offer returns explicit metadata for an optional $19 one-time report. It cannot open checkout or purchase anything.
  • get_practice_radar_offer returns the current weekly-edition receipt, public sample, $39 monthly price, delivery, cancellation, and material NPI limitations. It cannot open checkout or purchase anything.

Connect

Claude Code:

Terminal
claude mcp add --transport http actablesite https://actablesite.com/mcp/

For another MCP client, add a remote server named actablesite with:

  • URL: https://actablesite.com/mcp/
  • Transport: Streamable HTTP
  • Authentication: none

For clients that require a local stdio command, clone this repository and run the dependency-free bridge:

bash
git clone https://github.com/unitedideas/actablesite-mcp.git
cd actablesite-mcp
npm run start:stdio

The bridge contains the visible MCP implementation source in src/stdio.mjs. Distribution version 1.4.2 exposes the same five read-only tools and sends requests only to ActableSite's bounded public JSON APIs. It has no file, shell, browser, account, or write capability.

The same stdio process is available as a public, non-root container:

Terminal
docker run --rm -i ghcr.io/unitedideas/actablesite-mcp:1.4.2

The hosted server implements MCP protocol version 2025-06-18 and is published in the official registry as com.actablesite/ai-crawler-robots-monitor version 1.4.2.

Discovery metadata

Directory scanners can read either machine-readable discovery surface:

  • /.well-known/mcp.json identifies the official registry name, repository, remote endpoint, transport, authentication mode, and tool names.
  • /.well-known/mcp/server-card.json provides static tool descriptions and JSON input schemas for scanners that cannot complete a live MCP handshake.

Both files describe the same unauthenticated endpoint and five-tool inventory verified by this repository.

Ongoing crawler monitoring

The MCP tools report current public evidence and do not create background jobs. Crawler Watch is the separate $9/month service for one public website: it checks crawler policy, synthetic homepage responses, sitemap.xml, and llms.txt every 15 minutes and emails after a changed state appears twice.

Its synthetic requests do not authenticate provider IP ranges or prove crawling, indexing, citation, ranking, or traffic.

Safety contract

  • Public HTTP and HTTPS websites only; private, local, loopback, and reserved network destinations are rejected.
  • No browser control, file access, account access, write, or mutation tools.
  • No authentication header or API key is requested.
  • Tool calls are limited to 60 per caller per hour.
  • All three offer tools are informational and require explicit user confirmation before any separate checkout or purchase action.
  • Practice Radar records do not prove licensure, active operation, demand, or buying intent and must be verified before contact.
  • Results do not guarantee crawling, indexing, citation, ranking, recommendation, traffic, legal compliance, or revenue.

Verify the live server

Node.js 20 or newer is required.

Terminal
npm test
npm run verify:live

The verifier initializes the live server, checks its protocol and version, and confirms the exact read-only tool inventory. It does not call an audit tool or create a funnel event.

Repository scope

This repository contains a runnable stdio implementation, public registry manifest, connection contract, live verifier, and security policy for the hosted ActableSite MCP server. The production runtime is operated at https://actablesite.com/mcp/.

License

MIT

Read the full README β†’View source on GitHub β†’

Related MCP Servers

View all in Search & Data Extraction View all alternatives
  • PyreCrawl logoPyreCrawl

    One tool for AI agents to scrape, crawl, extract, map, and search the web. Self-hosted, no API keys.

    πŸ”Ž Search & Data Extraction1 views
    Compare vs PyreCrawl β†’
  • Firecrawl MCP Server logoFirecrawl MCP Server
    Verified

    Official Firecrawl server to search the web and scrape, crawl, map, and extract structured data from any site for LLMs. Handles JS-rendered pages, PDFs, and batch jobs; hosted remote MCP with OAuth or self-host.

    πŸ”Ž Search & Data Extraction5 views
    Compare vs Firecrawl MCP Server β†’
  • Tavily MCP logoTavily MCP

    MCP server for advanced web search using Tavily

    πŸ”Ž Search & Data Extraction1 views
    Compare vs Tavily MCP β†’
  • My Websearch logoMy Websearch

    MyWebSearch - multi-engine web search MCP server, CLI and local daemon. No API keys required.

    πŸ”Ž Search & Data Extraction1 views
    Compare vs My Websearch β†’

Adoption & maintenance

Factual signals from GitHub, npm, and our automated checks β€” not a rating.

Last commit
2mo ago
Most recent push to the default branch.
Tools exposed
5
Callable tools this server registers over MCP.

Reviews

No reviews yet β€” be the first to share how this listing worked for you.

Frequently Asked Questions about ActableSite AI Crawler Monitor

ActableSite AI Crawler Monitor is a hosted MCP server. Add it as a remote server in your client's config: "mcpServers": { "actablesite-ai-crawler-monitor": { "url": "https://actablesite.com/mcp/" } }

AllMCPs Directory Badge

Full Badge Customizer

Showcase your server listing on GitHub or your project documentation. Embed this dynamic SVG badge to highlight official listing status and live engagement.

Badge Style:
Live Dynamic SVG PreviewActableSite AI Crawler Monitor AllMCPs Directory Badge
Markdown (GitHub README)
[![AllMCPs](https://allmcps.com/api/badge/actablesite-ai-crawler-monitor?style=directory)](https://allmcps.com/mcp/actablesite-ai-crawler-monitor)
HTML Embed
<a href="https://allmcps.com/mcp/actablesite-ai-crawler-monitor"><img src="https://allmcps.com/api/badge/actablesite-ai-crawler-monitor?style=directory" alt="ActableSite AI Crawler Monitor on AllMCPs" /></a>

Technical Specs & Signals

CategoryπŸ”ŽSearch & Data Extraction
More technical detailsExpand β–Ύ
TransportSSE (Remote)
Last updatedJul 17, 2026
9/9 checks healthy over the last 45d
Views0
Unique ViewsTotal visits recorded for this listing page on AllMCPs.
Installs0
Installs & Copy ActionsTotal times users copied install commands or configuration snippets for this server.
GitHub stars0
GitHub Star CountTotal stargazers on GitHub representing community popularity (0 stars).
Last commit2mo ago
Last Repository CommitThe most recent commit or push recorded for this server's GitHub repository.Last commit on Jul 17, 2026
49Quality signal: Fair Β· 49/100How this signal is calculated β–Ύ
Server availabilityNot measured

Not scored for repo-hosted servers β€” we can't reach the running server, only its GitHub page. Hosted MCP endpoints are health-checked live.

Verified ownership10/20
Documentation & tools25/30
Adoption & activity2/15
Community engagement0/10

A guidance signal from public completeness & health data β€” not a user rating. New listings start lower and rise as they add docs, get verified, and grow adoption. Signals we can't observe for a listing are skipped, not counted against it.

β˜… FeaturedAllMCPs Server logo

AllMCPs Server

The official MCP server for AllMCPs.com - submit and manage tools directly from your AI. The open directory for MCP servers. Connect Claude, Cursor, Windsurf, and AI agents to databases, tools, files, and APIs. Explore 10,000+ servers. AllMCPs is the premier, open directory for discovering, evaluating, and installing Model Context Protocol (MCP) servers to equip AI agents and LLMs with real-world superpowers.

Explore Server β†’

Own this project?

This directory is pre-filled from public sources. Claim via GitHub README, site badge, or DNS TXT to unlock edit access and the Official badge β€” proof is checked automatically, then reviewed by our team.

Free dofollow backlink: add your website and place the AllMCPs badge on it β€” no claim needed. We detect it automatically and keep it verified as long as the badge stays live.

Claim & get free dofollow

Share & Embed

Add our SVG badge (dark/light directory styles) or embeddable widget to your site.

Explore more

More in πŸ”Ž Search & Data Extraction β†’Best MCP servers for Web Search & Scraping β†’Alternatives to ActableSite AI Crawler Monitor β†’Install in Claude DesktopInstall in CursorInstall in VS CodeSetup guides for all 13 MCP clients