Live web checks for AI agents, from real HTTP requests at call time: site_overview (robots.txt, llms.txt, sitemaps, feeds), list_site_urls, check_url, check_links (404s, redirects, SSL, slow pages), discover_feeds, read_feed (RSS/Atom/JSON Feed), and verify_citations (does the cited page exist and really carry the quote, title, date? Internet Archive copy for dead links). Remote Streamable HTTP server hosted on Apify; pay per event via your own Apify account, nothing runs locally. Claude Code plugin with verify-sources and site-preflight skills available.
Copy the AI prompt to install this server into Claude Code, Cursor, or another agent β or use 1-click editor setup below.
π‘ Paste the JSON block into your client's configuration file under mcpServers, then restart the application.
Β· Official MCP Registry:
io.github.Luca-003/web-hygiene-mcp
Remote MCP server (Streamable HTTP) that gives AI agents seven tools answering from the live web β never from a cache or the model's memory:
| Tool | What it does |
|---|---|
site_overview(site) | robots.txt (sitemaps declared, AI crawlers addressed, blanket disallow), llms.txt, sitemaps with URL count sample, feeds |
list_site_urls(site_or_sitemap, max_urls, include_regex, exclude_regex) | URLs a site publishes in its sitemaps, with lastmod (β€ 2,000) |
check_url(url) | HTTP status, full redirect chain, final URL, response time, content type |
check_links(urls | site_or_sitemap, max_urls, problems_only) | Bulk check: 404s, 5xx, timeouts, SSL errors, redirect chains, slow pages (β€ 300) |
discover_feeds(site) | RSS / Atom / JSON feeds of a website |
read_feed(feed_or_site, max_items, include_content) | Normalised feed items: title, link, date in UTC, author, summary, enclosures (β€ 100) |
verify_citations(text | urls | citations, check_archive, max_citations) | Per cited URL: verified / mismatch / not-found / redirected-home / paywalled / blocked β¦, real title/date/author, quote match evidence, Internet Archive copy for dead links (β€ 50) |
Claude Desktop / Cursor / any Streamable HTTP client:
A free Apify account gives you an API token and $5 of monthly credits. Tool calls are billed pay-per-event to your Apify account: a check_url costs a fraction of a cent; verifying the 10 sources of an answer about two cents. No subscription, nothing to run.
verify_citationssite_overviewcheck_linksClaude Code: ready-made plugin with two skills β /plugin marketplace add Luca-003/web-hygiene-claude-plugin then /plugin install web-hygiene@luca-003 (repo).
Language models are confident about links and sources they have never fetched. These tools let an agent look before it claims: verify a URL exists and where it leads, check robots.txt and llms.txt before quoting a site, read what a site really publishes, confirm a cited page carries the quoted passage.
Full documentation, pricing table and issue tracker: https://apify.com/bruco3/web-hygiene-mcp
Related Actors for whole-site / whole-document jobs: Sitemap URL Extractor Β· Broken Link Checker Β· Feed Monitor Β· Citation & Link Verifier
The tools request only public files sites publish for automated readers (sitemaps, feeds, robots.txt, llms.txt) and public pages you name, with a clear User-Agent. No personal data is collected or stored.
This repository holds the registry metadata (server.json) and documentation; the server runs on Apify.
Factual signals from GitHub, npm, and our automated checks β not a rating.
No reviews yet β be the first to share how this listing worked for you.
Showcase your server listing on GitHub or your project documentation. Embed this dynamic SVG badge to highlight official listing status and live engagement.
[](https://allmcps.com/mcp/web-hygiene-mcp)<a href="https://allmcps.com/mcp/web-hygiene-mcp"><img src="https://allmcps.com/api/badge/web-hygiene-mcp?style=directory" alt="Web Hygiene MCP on AllMCPs" /></a>