# Mingye-Lu/AgenticCrawler [Health: Active] **Category:** ๐Ÿ“‚ Browser Automation **Repository:** https://github.com/Mingye-Lu/AgenticCrawler **GitHub Stars:** 12 **Views:** 2 **Installs:** 0 **Upvotes:** 0 **Directory Page:** https://allmcps.com/mcp/mingye-lu-agenticcrawler ## Description Autonomous LLM-powered web crawler with 17 browser tools and goal-driven agent. Single binary, stealth browsing, 25 LLM providers. ## Claude Desktop Quick Installation Heuristic fallback โ€” verify the package name and runner against the repository README before running it. Uses `npx` (confidence: low): ```json "mcpServers": { "agenticcrawler": { "command": "npx", "args": ["-y","mingye-lu-agenticcrawler"], "env": { "ACRAWL_OPENAI_API_KEY": "", "ACRAWL_ANTHROPIC_API_KEY": "", "ACRAWL_GOOGLE_API_KEY": "", "ACRAWL_AZURE_OPENAI_API_KEY": "", "ACRAWL_AWS_BEDROCK_API_KEY": "", "ACRAWL_GITHUB_COPILOT_API_KEY": "" } } } ``` **Requires environment variables:** `ACRAWL_OPENAI_API_KEY`, `ACRAWL_ANTHROPIC_API_KEY`, `ACRAWL_GOOGLE_API_KEY`, `ACRAWL_AZURE_OPENAI_API_KEY`, `ACRAWL_AWS_BEDROCK_API_KEY`, `ACRAWL_GITHUB_COPILOT_API_KEY` โ€” the values above are empty placeholders; fill in real credentials before running (see the repository for what each one is for). ## Documentation & README 

  โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ•—  โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ•—โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ•—  โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ•— โ–ˆโ–ˆโ•—    โ–ˆโ–ˆโ•—โ–ˆโ–ˆโ•—     
 โ–ˆโ–ˆโ•”โ•โ•โ–ˆโ–ˆโ•—โ–ˆโ–ˆโ•”โ•โ•โ•โ•โ•โ–ˆโ–ˆโ•”โ•โ•โ–ˆโ–ˆโ•—โ–ˆโ–ˆโ•”โ•โ•โ–ˆโ–ˆโ•—โ–ˆโ–ˆโ•‘    โ–ˆโ–ˆโ•‘โ–ˆโ–ˆโ•‘     
 โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ•‘โ–ˆโ–ˆโ•‘     โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ•”โ•โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ•‘โ–ˆโ–ˆโ•‘ โ–ˆโ•— โ–ˆโ–ˆโ•‘โ–ˆโ–ˆโ•‘     
 โ–ˆโ–ˆโ•”โ•โ•โ–ˆโ–ˆโ•‘โ–ˆโ–ˆโ•‘     โ–ˆโ–ˆโ•”โ•โ•โ–ˆโ–ˆโ•—โ–ˆโ–ˆโ•”โ•โ•โ–ˆโ–ˆโ•‘โ–ˆโ–ˆโ•‘โ–ˆโ–ˆโ–ˆโ•—โ–ˆโ–ˆโ•‘โ–ˆโ–ˆโ•‘     
 โ–ˆโ–ˆโ•‘  โ–ˆโ–ˆโ•‘โ•šโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ•—โ–ˆโ–ˆโ•‘  โ–ˆโ–ˆโ•‘โ–ˆโ–ˆโ•‘  โ–ˆโ–ˆโ•‘โ•šโ–ˆโ–ˆโ–ˆโ•”โ–ˆโ–ˆโ–ˆโ•”โ•โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ•—
 โ•šโ•โ•  โ•šโ•โ• โ•šโ•โ•โ•โ•โ•โ•โ•šโ•โ•  โ•šโ•โ•โ•šโ•โ•  โ•šโ•โ• โ•šโ•โ•โ•โ•šโ•โ•โ• โ•šโ•โ•โ•โ•โ•โ•โ•

Browser automation agent that acts and observes. Navigate, click, and extract โ€” or inspect network traffic, debug console errors, profile performance, and audit accessibility. One Rust binary.

CI License: MIT Rust

Single Rust binary. Full DevTools observability. 42 tools. 25 LLM providers. MCP server built-in.

--- ## Why acrawl? Most browser agents stop at navigate and click. acrawl goes further: the agent can also inspect network requests, analyze console errors, measure page performance, audit accessibility, and intercept network calls โ€” the full DevTools surface, available as first-class agent tools. It ships as a single Rust binary. No Python runtime, no Node runtime, no Docker. Drop it into any server or CI pipeline and describe a goal; the agent figures out what to visit, what to click, what to inspect, and when it's done. - **One binary, zero runtimes.** `cargo build --release` produces a self-contained executable. No Python, no Node runtime โ€” just Rust and a Chromium download for browser automation. - **Acts and observes.** The agent has the full DevTools surface as first-class tools: inspect network requests with timing, analyze and deduplicate console logs, stream WebSocket messages, measure page performance (TTFB, resource breakdown), audit cookies and browser storage, measure JS/CSS coverage, run axe-core WCAG accessibility audits, and intercept or mock network calls. No other agent framework exposes this. - **Deterministic where you can, AI where you must.** Define loops, conditionals, and parallel branches as JSON scripts โ€” executed without any LLM calls. Fall back to the agent when pages behave unexpectedly. Best of both worlds. - **No code required.** Describe the goal in plain English. The agent plans, navigates, and extracts. - **Smart fetching.** Static pages are served over HTTP (fast). When JavaScript or interaction is needed, acrawl detects JS framework markers (`__next_data__`, `__nuxt`, `__vue`, `ng-app`, React roots), auth redirects, and short `