Codabench MCP vs Jacobian

A side-by-side look at the Codabench MCP and Jacobian MCP servers: transport, auth, tools, quality signals, and the config to install either one in Claude, Cursor, Windsurf or VS Code.

Codabench MCP logoCodabench MCPData Science Tools · Local subprocess (stdio)MCP server for the Codabench REST API — drives a full ML-benchmark participant workflow.36FairAuth: not declaredJacobian logoJacobianData Science Tools · Local subprocess (stdio)Executable mathematics and independent verification for AI agents.49FairAuth: not declared

Verdict: choose Codabench MCP for data science tools work as a local process; choose Jacobian for data science tools as a local process. You can also run both side by side in one mcpServers block.

Which MCP server should you choose?

Codabench MCP logoChoose Codabench MCP when

  • You need dedicated capabilities in the Data Science Tools domain.
  • You prefer a local stdio subprocess transport.
  • You have the keys it needs: CODABENCH_API_TOKEN, CODABENCH_BASE_URL, CODABENCH_ALLOW_WRITE_RAW, CODABENCH_MAX_DOWNLOAD_BYTES.
Explore Codabench MCP

Jacobian logoChoose Jacobian when

  • You need dedicated capabilities in the Data Science Tools domain.
  • You prefer a local stdio subprocess transport.
Explore Jacobian

Feature & specification comparison

Rows where the two servers differ are marked.

SpecCodabench MCP logoCodabench MCPJacobian logoJacobian
CategoryData Science ToolsData Science Tools
Quality signal36/100 · Fair49/100 · Fair
Install commandConfirmedConfirmed
TransportLocal subprocess (stdio)Local subprocess (stdio)
AuthNot declaredNot declared
PricingNot declaredNot declared
Required env varsCODABENCH_API_TOKENCODABENCH_BASE_URLCODABENCH_ALLOW_WRITE_RAWCODABENCH_MAX_DOWNLOAD_BYTESNone listed
Verified ownerCommunity listingCommunity listing
GitHub stars0318
Directory activity 2 views 0 installs 0 upvotes 1 views 0 installs 0 upvotes
ToolsNot listedNot listed

Tools & capabilities

Codabench MCP tools

No tool names declared yet. Check the project README from the listing page.

Jacobian tools

No tool names declared yet. Check the project README from the listing page.

Ready-to-paste client configs

Paste either block (or both) into your client config, e.g. claude_desktop_config.json or ~/.cursor/mcp.json. We only show a config when the install command is confirmed.

Codabench MCP

mcpServers (Claude Desktop / Cursor)
{
  "mcpServers": {
    "codabench-mcp": {
      "command": "uvx",
      "args": [
        "codabench-mcp"
      ],
      "env": {
        "CODABENCH_API_TOKEN": "YOUR_CODABENCH_API_TOKEN_HERE",
        "CODABENCH_BASE_URL": "YOUR_CODABENCH_BASE_URL_HERE",
        "CODABENCH_ALLOW_WRITE_RAW": "YOUR_CODABENCH_ALLOW_WRITE_RAW_HERE",
        "CODABENCH_MAX_DOWNLOAD_BYTES": "YOUR_CODABENCH_MAX_DOWNLOAD_BYTES_HERE"
      }
    }
  }
}

Jacobian

mcpServers (Claude Desktop / Cursor)
{
  "mcpServers": {
    "jacobian": {
      "command": "npx",
      "args": [
        "-y",
        "jacobian@latest"
      ]
    }
  }
}

Frequently asked questions

Codabench MCP is categorized under Data Science Tools and uses a local stdio subprocess. Jacobian belongs to Data Science Tools and uses a local stdio subprocess. Pick Codabench MCP for data science tools work and Jacobian for data science tools.

Copy the mcpServers block from the config section on this page into your client's config (for example claude_desktop_config.json or ~/.cursor/mcp.json), then fully restart the client.

Codabench MCP has no declared pricing — check the project's own site. Jacobian has no declared pricing — check the project's own site. If a server needs environment variables such as API keys, define them under the env key in your client's MCP config.

Yes. MCP clients support multiple servers: add codabench-mcp and jacobian as separate keys in the same mcpServers object, and your assistant will call tools from either one.

On AllMCPs, Codabench MCP has a quality signal of 36/100 (Fair) with 2 views, 0 installs and 0 GitHub stars. Jacobian has 49/100 (Fair) with 1 views, 0 installs and 318 GitHub stars.