Documentation Extractor

Extract llms.txt from any docs site - Mintlify Docusaurus GitBook parser

Quick Install

Automated & IDE Setup

Copy the AI prompt to install this server into Claude Code, Cursor, or another agent — or use 1-click editor setup below.

Add to Cursor Add to VS Code

Manual Client & Custom JSON ConfigExpand JSON ▾

Client Config & Setup

Choose your client or environment

Target File:~/Library/Application Support/Claude/claude_desktop_config.json

claude_desktop_config.json

{
  "mcpServers": {
    "documentation-extractor": {
      "command": "npx",
      "args": [
        "-y",
        "documentation-extractor"
      ]
    }
  }
}

💡 Paste the JSON block into your client's configuration file under mcpServers, then restart the application.

Documentation Overview

llm.energy

Extract llms.txt documentation and install.md instructions from any website for AI agents, LLMs, and automation workflows.

llm.energy

llms-full-txt.vercel.app

📖 Overview

llm.energy is a web application and MCP server that fetches, parses, and organizes documentation from websites implementing the llms.txt and install.md standards. It transforms raw documentation into structured, agent-ready formats optimized for large language models, AI assistants, and developer tooling.

Standard	Description	Learn More
llms.txt	Machine-readable documentation for AI systems	llmstxt.org
install.md	LLM-executable installation instructions	installmd.org

✨ Key Features

Feature	Description
🔍 Smart Detection	Automatically finds `llms.txt`, `llms-full.txt`, and `install.md`
📄 Organized Output	Splits content into individual markdown files by section
🤖 Agent-Ready	Includes `AGENT-GUIDE.md` optimized for AI assistants
📦 Multiple Formats	Export as Markdown, JSON, YAML, or ZIP archive
🔌 MCP Server	Integrate with Claude Desktop, Cursor, and more
⚡ Batch Processing	Process multiple URLs simultaneously
📚 Site Directory	Browse 19+ curated llms.txt-enabled websites
✏️ llms.txt Generator	Create your own llms.txt files with a guided wizard
🚀 install.md Generator	AI-powered: generate from GitHub repos, docs URLs, or manually

🎯 Use Cases

Code

─────────────────────────────────────────────────────────────────
                                                                 
   📝 Feed docs to AI coding assistants (Cursor, Windsurf)       
   🤖 Build context-aware AI agents with up-to-date docs         
   🔄 Create documentation pipelines for RAG systems            
   📦 Aggregate docs from multiple sources automatically        
   ✏️  Generate llms.txt/install.md for your own projects       
   🚀 Auto-generate install.md from any GitHub repo             
                                                                 
─────────────────────────────────────────────────────────────────

🚀 install.md Generator

Generate LLM-executable installation instructions from any source:

Mode	Description	Use Case
From GitHub	Analyze any public GitHub repo and generate install.md	Perfect for creating install.md for existing projects
From URL	Extract from any documentation page	Convert existing docs to install.md format
Manual	Build from scratch with guided wizard	Full control over every detail

How It Works

GitHub Mode: Analyzes README, package.json/pyproject.toml/Cargo.toml, GitHub Actions, and releases
URL Mode: Scrapes documentation pages, detects platforms (Mintlify, Docusaurus, GitBook, etc.)
AI Synthesis: Uses Claude to generate a properly formatted install.md

Quick Example

bash

# Generate install.md for any GitHub project
curl -X POST https://llm-energy-lp642k3kpa-uc.a.run.app/api/generate-install \
  -H "Content-Type: application/json" \
  -d '{"url": "https://github.com/anthropics/anthropic-sdk-python", "type": "github"}'

Visit llm.energy/install-generator to use the web interface.

📚 Documentation

Full documentation is available at llm.energy/docs

🚀 Installation

Web Application

Visit llm.energy to use the hosted version.

Local Development

bash

# Clone the repository
git clone https://github.com/nirholas/extract-llms-docs.git
cd extract-llms-docs

# Install dependencies
pnpm install

# Start development server
pnpm dev

🌐 The application runs on http://localhost:3001

MCP Server

📦 Click to expand MCP Server setup

Add to your MCP client configuration (Claude Desktop, Cursor, etc.):

config.json

{
  "mcpServers": {
    "llm-energy": {
      "command": "npx",
      "args": ["-y", "@llm-energy/mcp-server"]
    }
  }
}

See MCP Server Documentation for detailed setup.

🔌 API Reference

POST /api/extract - Extract documentation from a URL

Terminal

curl -X POST https://llm-energy-lp642k3kpa-uc.a.run.app/api/extract \
  -H "Content-Type: application/json" \
  -d '{"url": "docs.anthropic.com"}'

Response includes parsed sections, metadata, and download URLs.

POST /api/validate - Check if URL has llms.txt support

Terminal

curl -X POST https://llm-energy-lp642k3kpa-uc.a.run.app/api/validate \
  -H "Content-Type: application/json" \
  -d '{"url": "docs.example.com"}'

POST /api/batch - Process multiple URLs

Terminal

curl -X POST https://llm-energy-lp642k3kpa-uc.a.run.app/api/batch \
  -H "Content-Type: application/json" \
  -d '{"urls": ["docs.anthropic.com", "docs.stripe.com"]}'

GET /api/download - Download in various formats

bash

# Formats: markdown, json, yaml, zip
curl "https://llm-energy-lp642k3kpa-uc.a.run.app/api/download?url=docs.anthropic.com&format=zip"

POST /api/generate-install - AI-generate install.md from GitHub or docs URL

bash

# Generate from a GitHub repository
curl -X POST https://llm-energy-lp642k3kpa-uc.a.run.app/api/generate-install \
  -H "Content-Type: application/json" \
  -d '{"url": "https://github.com/anthropics/anthropic-sdk-python", "type": "github"}'

# Generate from a documentation URL
curl -X POST https://llm-energy-lp642k3kpa-uc.a.run.app/api/generate-install \
  -H "Content-Type: application/json" \
  -d '{"url": "https://docs.anthropic.com/en/docs/quickstart", "type": "docs"}'

# Analyze only (preview mode)
curl "https://llm-energy-lp642k3kpa-uc.a.run.app/api/generate-install?url=https://github.com/anthropics/anthropic-sdk-python&type=github"

📖 Full API Reference →

🤖 MCP Server Tools

The MCP server exposes the following tools for AI agents:

Tool	Description
`extract_docs`	Extract documentation from a URL with llms.txt support
`validate_url`	Check if a URL has llms.txt available
`verify_llms_txt`	Verify llms.txt exists and get file info
`discover_documentation_urls`	Find documentation URLs for a domain
`list_sites`	Get directory of known llms.txt-enabled sites
`search_sites`	Search the site directory by category or keyword

🏗️ Architecture

Read the full README →View source on GitHub →

Related MCP Servers

View all in Developer Tools View all alternatives

Reviews

No reviews yet — be the first to share how this listing worked for you.

Frequently Asked Questions about Documentation Extractor

Add the following block to your claude_desktop_config.json under mcpServers: "mcpServers": { "documentation-extractor": { "command": "npx", "args": ["-y", "Documentation Extractor"] } }

AllMCPs Directory Badge

Full Badge Customizer

Showcase your server listing on GitHub or your project documentation. Embed this dynamic SVG badge to highlight official listing status and live engagement.

Badge Style:

Live Dynamic SVG Preview

Documentation Extractor AllMCPs Directory Badge

Markdown (GitHub README)

[![AllMCPs](https://allmcps.com/api/badge/documentation-extractor?style=directory)](https://allmcps.com/mcp/documentation-extractor)

HTML Embed

<a href="https://allmcps.com/mcp/documentation-extractor"><img src="https://allmcps.com/api/badge/documentation-extractor?style=directory" alt="Documentation Extractor on AllMCPs" /></a>

Technical Specs & Signals

CategoryDeveloper Tools

27Quality signal: Emerging · 27/100How this signal is calculated ▾

Server availabilityNot measured

Not scored for repo-hosted servers — we can't reach the running server, only its GitHub page. Hosted MCP endpoints are health-checked live.

Verified ownership8/20

Documentation & tools11/30

Adoption & activity1/15

Community engagement0/10

A guidance signal from public completeness & health data — not a user rating. New listings start lower and rise as they add docs, get verified, and grow adoption. Signals we can't observe for a listing are skipped, not counted against it.

★ Spotlight Slot

Feature Your MCP Server

Get maximum visibility for your server across our directory, search results, and detail pages.

Spotlight Your Server

Own this project?

This directory is pre-filled from public sources. Claim via GitHub README, site badge, or DNS TXT to unlock edit access and the Official badge and attach your website — proof is checked automatically, then reviewed by our team.

Free dofollow backlink: add your website and place the AllMCPs badge on it — no claim needed. We detect it automatically and keep it verified as long as the badge stays live.

Claim & get free dofollow

Share & Embed

Add our SVG badge (dark/light directory styles) or embeddable widget to your site.

Explore more

More in 💻 Developer Tools →Best MCP servers for Developers →Alternatives to Documentation Extractor →Install in Claude Desktop Install in Cursor Install in VS Code

Documentation Extractor

Extract llms.txt from any docs site - Mintlify Docusaurus GitBook parser

Quick Install

Automated & IDE Setup

Copy the AI prompt to install this server into Claude Code, Cursor, or another agent — or use 1-click editor setup below.

Add to Cursor Add to VS Code

Manual Client & Custom JSON ConfigExpand JSON ▾

Client Config & Setup

Choose your client or environment

Target File:~/Library/Application Support/Claude/claude_desktop_config.json

claude_desktop_config.json

{
  "mcpServers": {
    "documentation-extractor": {
      "command": "npx",
      "args": [
        "-y",
        "documentation-extractor"
      ]
    }
  }
}

💡 Paste the JSON block into your client's configuration file under mcpServers, then restart the application.

Documentation Overview

llm.energy

Extract llms.txt documentation and install.md instructions from any website for AI agents, LLMs, and automation workflows.

llm.energy

llms-full-txt.vercel.app

📖 Overview

Standard	Description	Learn More
llms.txt	Machine-readable documentation for AI systems	llmstxt.org
install.md	LLM-executable installation instructions	installmd.org

✨ Key Features

Feature	Description
🔍 Smart Detection	Automatically finds `llms.txt`, `llms-full.txt`, and `install.md`
📄 Organized Output	Splits content into individual markdown files by section
🤖 Agent-Ready	Includes `AGENT-GUIDE.md` optimized for AI assistants
📦 Multiple Formats	Export as Markdown, JSON, YAML, or ZIP archive
🔌 MCP Server	Integrate with Claude Desktop, Cursor, and more
⚡ Batch Processing	Process multiple URLs simultaneously
📚 Site Directory	Browse 19+ curated llms.txt-enabled websites
✏️ llms.txt Generator	Create your own llms.txt files with a guided wizard
🚀 install.md Generator	AI-powered: generate from GitHub repos, docs URLs, or manually

🎯 Use Cases

Code

─────────────────────────────────────────────────────────────────
                                                                 
   📝 Feed docs to AI coding assistants (Cursor, Windsurf)       
   🤖 Build context-aware AI agents with up-to-date docs         
   🔄 Create documentation pipelines for RAG systems            
   📦 Aggregate docs from multiple sources automatically        
   ✏️  Generate llms.txt/install.md for your own projects       
   🚀 Auto-generate install.md from any GitHub repo             
                                                                 
─────────────────────────────────────────────────────────────────

🚀 install.md Generator

Generate LLM-executable installation instructions from any source:

Mode	Description	Use Case
From GitHub	Analyze any public GitHub repo and generate install.md	Perfect for creating install.md for existing projects
From URL	Extract from any documentation page	Convert existing docs to install.md format
Manual	Build from scratch with guided wizard	Full control over every detail

How It Works

GitHub Mode: Analyzes README, package.json/pyproject.toml/Cargo.toml, GitHub Actions, and releases
URL Mode: Scrapes documentation pages, detects platforms (Mintlify, Docusaurus, GitBook, etc.)
AI Synthesis: Uses Claude to generate a properly formatted install.md

Quick Example

bash

# Generate install.md for any GitHub project
curl -X POST https://llm-energy-lp642k3kpa-uc.a.run.app/api/generate-install \
  -H "Content-Type: application/json" \
  -d '{"url": "https://github.com/anthropics/anthropic-sdk-python", "type": "github"}'

Visit llm.energy/install-generator to use the web interface.

📚 Documentation

Full documentation is available at llm.energy/docs

🚀 Installation

Web Application

Visit llm.energy to use the hosted version.

Local Development

bash

# Clone the repository
git clone https://github.com/nirholas/extract-llms-docs.git
cd extract-llms-docs

# Install dependencies
pnpm install

# Start development server
pnpm dev

🌐 The application runs on http://localhost:3001

MCP Server

📦 Click to expand MCP Server setup

Add to your MCP client configuration (Claude Desktop, Cursor, etc.):

config.json

{
  "mcpServers": {
    "llm-energy": {
      "command": "npx",
      "args": ["-y", "@llm-energy/mcp-server"]
    }
  }
}

See MCP Server Documentation for detailed setup.

🔌 API Reference

POST /api/extract - Extract documentation from a URL

Terminal

curl -X POST https://llm-energy-lp642k3kpa-uc.a.run.app/api/extract \
  -H "Content-Type: application/json" \
  -d '{"url": "docs.anthropic.com"}'

Response includes parsed sections, metadata, and download URLs.

POST /api/validate - Check if URL has llms.txt support

Terminal

curl -X POST https://llm-energy-lp642k3kpa-uc.a.run.app/api/validate \
  -H "Content-Type: application/json" \
  -d '{"url": "docs.example.com"}'

POST /api/batch - Process multiple URLs

Terminal

curl -X POST https://llm-energy-lp642k3kpa-uc.a.run.app/api/batch \
  -H "Content-Type: application/json" \
  -d '{"urls": ["docs.anthropic.com", "docs.stripe.com"]}'

GET /api/download - Download in various formats

bash

# Formats: markdown, json, yaml, zip
curl "https://llm-energy-lp642k3kpa-uc.a.run.app/api/download?url=docs.anthropic.com&format=zip"

POST /api/generate-install - AI-generate install.md from GitHub or docs URL

bash

# Generate from a GitHub repository
curl -X POST https://llm-energy-lp642k3kpa-uc.a.run.app/api/generate-install \
  -H "Content-Type: application/json" \
  -d '{"url": "https://github.com/anthropics/anthropic-sdk-python", "type": "github"}'

# Generate from a documentation URL
curl -X POST https://llm-energy-lp642k3kpa-uc.a.run.app/api/generate-install \
  -H "Content-Type: application/json" \
  -d '{"url": "https://docs.anthropic.com/en/docs/quickstart", "type": "docs"}'

# Analyze only (preview mode)
curl "https://llm-energy-lp642k3kpa-uc.a.run.app/api/generate-install?url=https://github.com/anthropics/anthropic-sdk-python&type=github"

📖 Full API Reference →

🤖 MCP Server Tools

The MCP server exposes the following tools for AI agents:

Tool	Description
`extract_docs`	Extract documentation from a URL with llms.txt support
`validate_url`	Check if a URL has llms.txt available
`verify_llms_txt`	Verify llms.txt exists and get file info
`discover_documentation_urls`	Find documentation URLs for a domain
`list_sites`	Get directory of known llms.txt-enabled sites
`search_sites`	Search the site directory by category or keyword

🏗️ Architecture

Read the full README →View source on GitHub →

Related MCP Servers

View all in Developer Tools View all alternatives

Reviews

No reviews yet — be the first to share how this listing worked for you.

Frequently Asked Questions about Documentation Extractor

Add the following block to your claude_desktop_config.json under mcpServers: "mcpServers": { "documentation-extractor": { "command": "npx", "args": ["-y", "Documentation Extractor"] } }

AllMCPs Directory Badge

Full Badge Customizer

Showcase your server listing on GitHub or your project documentation. Embed this dynamic SVG badge to highlight official listing status and live engagement.

Badge Style:

Live Dynamic SVG Preview

Markdown (GitHub README)

[![AllMCPs](https://allmcps.com/api/badge/documentation-extractor?style=directory)](https://allmcps.com/mcp/documentation-extractor)

HTML Embed

<a href="https://allmcps.com/mcp/documentation-extractor"><img src="https://allmcps.com/api/badge/documentation-extractor?style=directory" alt="Documentation Extractor on AllMCPs" /></a>

Technical Specs & Signals

CategoryDeveloper Tools

27Quality signal: Emerging · 27/100How this signal is calculated ▾

Server availabilityNot measured

Not scored for repo-hosted servers — we can't reach the running server, only its GitHub page. Hosted MCP endpoints are health-checked live.

Verified ownership8/20

Documentation & tools11/30

Adoption & activity1/15

Community engagement0/10

★ Spotlight Slot

Feature Your MCP Server

Get maximum visibility for your server across our directory, search results, and detail pages.

Spotlight Your Server

Own this project?

Free dofollow backlink: add your website and place the AllMCPs badge on it — no claim needed. We detect it automatically and keep it verified as long as the badge stays live.

Claim & get free dofollow

Share & Embed

Add our SVG badge (dark/light directory styles) or embeddable widget to your site.

Explore more

More in 💻 Developer Tools →Best MCP servers for Developers →Alternatives to Documentation Extractor →Install in Claude Desktop Install in Cursor Install in VS Code