A side-by-side look at the Freellmpool and Llmtest MCP MCP servers: transport, auth, tools, quality signals, and the config to install either one in Claude, Cursor, Windsurf or VS Code.
Verdict: choose Freellmpool for conversational ai work as a local process; choose Llmtest MCP for conversational ai as a local process. You can also run both side by side in one mcpServers block.
LLMTEST_API_KEY, LLMTEST_BASE_URL.status, list_flows, get_suggestions.Rows where the two servers differ are marked.
| Spec | ||
|---|---|---|
| Category | Conversational AI | Conversational AI |
| Quality signal | 45/100 · Fair | 51/100 · Good |
| Install command | Confirmed | Confirmed |
| Transport | Local subprocess (stdio) | Local subprocess (stdio) |
| Auth | Not declared | Not declared |
| Pricing | Not declared | Not declared |
| Required env vars | None listed | LLMTEST_API_KEYLLMTEST_BASE_URL |
| Verified owner | Community listing | Community listing |
| GitHub stars | 128 | 0 |
| Directory activity | 0 views 0 installs 0 upvotes | 0 views 0 installs 0 upvotes |
| Tools | Not listed | 15 |
| Full listing | View Freellmpool | View Llmtest MCP |
No tool names declared yet. Check the project README from the listing page.
statusShow proxy status and activity summarylist_flowsList all AI flows with cost and latency statsget_suggestionsGet pending model-switch recommendationsupdate_suggestionAccept or dismiss a suggestionrun_benchmarkBenchmark a flow against challenger modelsoptimize_promptRewrite a flow's prompt and find a cheaper model that still worksseed_samplesAdd test prompts for pre-launch benchmarkinglist_samplesShow stored test samples per flowlist_new_modelsShow new and trending modelsget_accountCheck credit balance and usageget_autopilot_statusCheck whether autopilot is on and whether the account is eligibleenable_autopilotTurn on weekly auto-optimization with safety gates + drift-based auto-revertPaste either block (or both) into your client config, e.g. claude_desktop_config.json or ~/.cursor/mcp.json. We only show a config when the install command is confirmed.
{
"mcpServers": {
"freellmpool": {
"command": "uvx",
"args": [
"freellmpool"
]
}
}
}
{
"mcpServers": {
"llmtest-mcp": {
"command": "npx",
"args": [
"-y",
"llmtest-mcp"
],
"env": {
"LLMTEST_API_KEY": "YOUR_LLMTEST_API_KEY_HERE",
"LLMTEST_BASE_URL": "YOUR_LLMTEST_BASE_URL_HERE"
}
}
}
}