Web Hygiene MCP

· Official MCP Registry: io.github.Luca-003/web-hygiene-mcp

Remote MCP server (Streamable HTTP) that gives AI agents seven tools answering from the live web — never from a cache or the model's memory:

Tool	What it does
`site_overview(site)`	robots.txt (sitemaps declared, AI crawlers addressed, blanket disallow), `llms.txt`, sitemaps with URL count sample, feeds
`list_site_urls(site_or_sitemap, max_urls, include_regex, exclude_regex)`	URLs a site publishes in its sitemaps, with `lastmod` (≤ 2,000)
`check_url(url)`	HTTP status, full redirect chain, final URL, response time, content type
`check_links(urls \| site_or_sitemap, max_urls, problems_only)`	Bulk check: 404s, 5xx, timeouts, SSL errors, redirect chains, slow pages (≤ 300)
`discover_feeds(site)`	RSS / Atom / JSON feeds of a website
`read_feed(feed_or_site, max_items, include_content)`	Normalised feed items: title, link, date in UTC, author, summary, enclosures (≤ 100)
`verify_citations(text \| urls \| citations, check_archive, max_citations)`	Per cited URL: `verified` / `mismatch` / `not-found` / `redirected-home` / `paywalled` / `blocked` …, real title/date/author, quote match evidence, Internet Archive copy for dead links (≤ 50)

Connect

Code

URL:    https://bruco3--web-hygiene-mcp.apify.actor/mcp
Header: Authorization: Bearer <YOUR_APIFY_API_TOKEN>

Claude Desktop / Cursor / any Streamable HTTP client:

config.json

{
  "mcpServers": {
    "web-hygiene": {
      "url": "https://bruco3--web-hygiene-mcp.apify.actor/mcp",
      "headers": { "Authorization": "Bearer YOUR_APIFY_API_TOKEN" }
    }
  }
}

A free Apify account gives you an API token and $5 of monthly credits. Tool calls are billed pay-per-event to your Apify account: a check_url costs a fraction of a cent; verifying the 10 sources of an answer about two cents. No subscription, nothing to run.

Try it — three prompts

"Check the sources in the answer you just gave me: does each link exist, and is the quote really on the page?" → verify_citations
"Before we cite anything from example.com, what does the site publish and allow?" → site_overview
"Check every link in this README and tell me which are broken or redirected." → check_links

Claude Code: ready-made plugin with two skills — /plugin marketplace add Luca-003/web-hygiene-claude-plugin then /plugin install web-hygiene@luca-003 (repo).

Why

Language models are confident about links and sources they have never fetched. These tools let an agent look before it claims: verify a URL exists and where it leads, check robots.txt and llms.txt before quoting a site, read what a site really publishes, confirm a cited page carries the quoted passage.

Details, pricing, issues

Full documentation, pricing table and issue tracker: https://apify.com/bruco3/web-hygiene-mcp

Related Actors for whole-site / whole-document jobs: Sitemap URL Extractor · Broken Link Checker · Feed Monitor · Citation & Link Verifier

Legal

The tools request only public files sites publish for automated readers (sitemaps, feeds, robots.txt, llms.txt) and public pages you name, with a clear User-Agent. No personal data is collected or stored.

This repository holds the registry metadata (server.json) and documentation; the server runs on Apify.