agent-evaluationtestingsimulationsdeveloper-tools
Connect MCP clients to VerifyAX for agent registration, scenario generation, simulations, and evaluation results.
Quick Install
Automated & IDE SetupCopy the AI prompt to install this server into Claude Code, Cursor, or another agent ā or use 1-click editor setup below.
We couldnāt automatically confirm this listing starts correctly
We ran the install command below but it didn't respond within our test window ā this can mean a slow first-time install rather than a real problem.
npx -y -p @verifyax/mcp-server verifyax-mcp-serverNo response to initialize.
This is an experimental automated check and can have false negatives ā missing environment variables, a slow cold install, etc. It doesnāt necessarily mean somethingās wrong. Last checked 11d ago.
Manual Client & Custom JSON ConfigExpand JSON ā¾
Client Config & Setup
Choose your client or environment
Target File:
š” Paste the JSON block into your client's configuration file under mcpServers, then restart the application.
Overview
Use cases
Register A2A or API agents
Confirm agent connectivity before evaluation
Generate scenarios from skill tags
Run simulations and evaluations
Read scores, transcripts, and credit usage
Key features
Agent registration and connectivity testing
Scenario generation from skill tags
Simulation and evaluation execution
Blocking tools that wait for completion
Evaluation scores and transcript access
Streamable HTTP and stdio support
Capabilities & Tool Schemas
Inspect callable tools, capabilities, and parameters exposed to AI agents by Verifyax MCP.
Extracted Tool Capabilities
Agent registration and connectivity testing
Scenario generation from skill tags
Simulation and evaluation execution
Blocking tools that wait for completion
Evaluation scores and transcript access
Streamable HTTP and stdio support
Documentation Overview
VerifyAX MCP Server
The official Model Context Protocol (MCP) server for VerifyAX: a cloud-hosted bridge that gives your AI tools secure, real-time access to register agents, generate scenarios, run simulations, and read evaluations on the VerifyAX platform.
Getting started Ā· Supported tools Ā· Security Ā· Deploy your own Ā· Report an issue
The official VerifyAX MCP Server is a bridge between your MCP-compatible AI client and the VerifyAX agent-evaluation platform. Once configured, it lets you register agents, generate scenarios, run simulations, and read evaluations in natural language ā without writing API scripts.
With the VerifyAX MCP Server, you can:
- Register and test agents (A2A or API) and confirm connectivity before evaluation.
- Generate scenarios from skill tags and wait for completion in one tool call.
- Run evaluations and read scores, transcripts, and credit usage without manual polling.
It complements (does not replace) the verifyax-api skill:
the skill is for developers writing code; the MCP server is for conversational workflows.
Contents
- Supported clients
- Supported tools
- Before you start
- Install the MCP server
- How it works
- Example workflows
- Tips and tricks
- Data and security
- Troubleshooting
- Support and feedback
- Disclaimer
- For developers
- License
Supported clients
The VerifyAX MCP Server works with MCP-compatible clients that support Streamable HTTP or stdio:
| Client | Setup reference |
|---|---|
| OpenAI ChatGPT | Connectors / MCP guide |
| Claude (Claude.ai, Code, Desktop) | Claude MCP docs |
| Cursor | Cursor MCP docs |
| Visual Studio Code (GitHub Copilot) | VS Code MCP docs |
| GitHub Copilot CLI | About Copilot CLI |
| Google Gemini CLI | Gemini CLI MCP docs |
| Amazon Quick Suite | MCP integration guide |
Any client that can connect via mcp-remote can also
use the hosted endpoint at https://mcp.verifyax.com/mcp.
[!IMPORTANT] Claude.ai custom connectors: use No sign-in and an
Authorizationheader. This server authenticates with a VerifyAX API key, not OAuth, so in Settings ā Connectors ā Add custom connector:
- URL:
https://mcp.verifyax.com/mcp- Authentication: No sign-in ā described in the dialog as "for servers that use an API key instead of OAuth". Leave Sign in now unselected; this server publishes no OAuth metadata, so an OAuth attempt fails.
- Under Request headers, add
Authorizationwith the valueBearer sk-ver-api-....All 17 tools then appear, and Claude.ai lets you set approval per tool (it groups them as 12 read-only and 5 write/delete ā worth setting the write/delete group to require approval, since
generate_scenarioandevaluate_agentspend credits).Requires server 0.3.5 or later: earlier builds matched the
Bearerscheme case-sensitively and rejected clients that normalise it, which surfaced only as "Couldn't connect to the server." TheX-VerifyAX-API-Keyheader works with the server but Claude.ai's header field rejects that name, so useAuthorization.
[!TIP] For step-by-step Claude setup and how this compares to the VerifyAX skill and SDK, see
docs/using-verifyax-with-claude.md.
Supported tools
Seventeen tools mapped to user intents. Blocking tools poll internally and return only when work completes (typically 30sā5min).
| Area | Tools | Blocking |
|---|---|---|
| Agents | register_agent Ā· list_agents Ā· delete_agent | ā |
| Scenarios | list_compatible_tags Ā· recommend_scenario_tags Ā· search_scenario_tags Ā· generate_scenario Ā· list_scenarios Ā· get_scenario Ā· delete_scenario | yes (generate_scenario) |
| Evaluation | evaluate_agent Ā· list_recent_runs Ā· get_run_details Ā· get_evaluation_report Ā· get_run_output | yes (evaluate_agent) |
| Usage | get_usage_summary Ā· preview_run_cost | ā |
[!NOTE] For tool descriptions (what Claude reads to pick a tool) and rationale, see
docs/tool-descriptions.md. Package-level reference:packages/mcp-server/README.md.
Before you start
Requirements depend on how you connect.
Remote HTTP (hosted at mcp.verifyax.com)
- A VerifyAX API key (Settings ā API Keys in the console)
- An MCP client with Streamable HTTP support, or Node.js 18+ to run the
mcp-remoteproxy
Local stdio (verifyax-mcp-server via npx)
- Node.js ā„ 20
- A VerifyAX API key in your client config (
VERIFYAX_API_KEY)
The npm package exposes two binaries (verifyax-mcp-server and verifyax-mcp-server-http); pass
the stdio binary name explicitly when using npx.
Install the MCP server
Remote HTTP (recommended)
Hosted endpoint:
Send your VerifyAX API key on the initialize request. The hosted server does not store keys ā each client session brings its own.
Cursor (native URL ā v0.48+):
Do not add a transport field ā Cursor detects Streamable HTTP from the URL. You can also use
"X-VerifyAX-API-Key": "sk-ver-api-..." instead of Authorization.
Claude Desktop / clients without native HTTP (mcp-remote):
Add to claude_desktop_config.json (Settings ā Developer ā Edit Config):
Related MCP Servers
Adoption & maintenance
Factual signals from GitHub, npm, and our automated checks ā not a rating.
GitHub stars
1
Stargazers on the source repository.
npm downloads
674
Package downloads in the last 30 days.
Last commit
6d ago
Most recent push to the default branch.
Install check
Inconclusive
Didn't respond in our test window ā often a slow first install.
Directory activity
1 views
Config copies, upvotes, and views on AllMCPs.
Reviews
No reviews yet ā be the first to share how this listing worked for you.
Frequently Asked Questions about Verifyax MCP
AllMCPs Directory Badge
Showcase your server listing on GitHub or your project documentation. Embed this dynamic SVG badge to highlight official listing status and live engagement.
Badge Style:
Live Dynamic SVG Preview
Markdown (GitHub README)
[](https://allmcps.com/mcp/verifyax-verifyax-mcp)HTML Embed
<a href="https://allmcps.com/mcp/verifyax-verifyax-mcp"><img src="https://allmcps.com/api/badge/verifyax-verifyax-mcp?style=directory" alt="Verifyax MCP on AllMCPs" /></a>Technical Specs & Signals
CategoryDeveloper Tools
12/13 checks healthy over the last 56d
53Quality signal: Good Ā· 53/100How this signal is calculated ā¾
Server availabilityNot measured
Not scored for repo-hosted servers ā we can't reach the running server, only its GitHub page. Hosted MCP endpoints are health-checked live.
Verified ownership10/20
Documentation & tools23/30
Adoption & activity7/15
Community engagement0/10
A guidance signal from public completeness & health data ā not a user rating. New listings start lower and rise as they add docs, get verified, and grow adoption. Signals we can't observe for a listing are skipped, not counted against it.
Supply-chain signal
No high-severity advisories surfaced by our automated scan.
Critical 0High 0Medium 0Low 0
Scanned 13d ago via OSV.dev Ā· @verifyax/mcp-server (npm)
Own this project?
This directory is pre-filled from public sources. Claim via GitHub README, site badge, or DNS TXT to unlock edit access and the Official badge ā proof is checked automatically, then reviewed by our team.
Free dofollow backlink: add your website and place the AllMCPs badge on it ā no claim needed. We detect it automatically and keep it verified as long as the badge stays live.
Claim & get free dofollowShare & Embed
Add our SVG badge (dark/light directory styles) or embeddable widget to your site.