Skip to main content
Glama
evergreen-ci

evergreen-mcp-server

Official
by evergreen-ci

Evergreen MCP Server

A Model Context Protocol (MCP) server that provides access to the Evergreen CI/CD platform API. This server enables AI assistants and other MCP clients to interact with Evergreen projects, builds, tasks, and other CI/CD resources.

Overview

Evergreen is MongoDB's continuous integration platform. This MCP server exposes Evergreen's functionality through the Model Context Protocol, allowing AI assistants to help with CI/CD operations, project management, and build analysis.

Related MCP server: MongoDB MCP Server

Features

  • Project Resources: Access and list Evergreen projects and build statuses

  • Failed Jobs Analysis: Fetch failed jobs and logs for specific commits to help identify CI/CD failures

  • Unit Test Failure Analysis: Detailed analysis of individual unit test failures with test-specific logs and metadata

  • Task Log Retrieval: Get detailed logs for failed tasks with error filtering

  • REST API Log Analysis: Full untruncated task and test logs via REST API with automatic error pattern scanning

  • Stepback Analysis: Find failed mainline tasks that have undergone stepback bisection

  • Authentication: Secure OIDC-based authentication via evergreen login

  • Async Operations: Built on asyncio for efficient concurrent operations

  • GraphQL + REST Integration: Uses Evergreen's GraphQL API for metadata and REST API for full log content

Quick Start

Step 1: Authenticate with Evergreen

First, authenticate with Evergreen using the CLI. This creates the necessary credentials that the MCP server will use:

evergreen login

This will:

  • Open your browser for OIDC authentication

  • Create ~/.evergreen.yml with your credentials

  • Create ~/.kanopy/token-oidclogin.json with your OIDC token

Note: If you don't have the Evergreen CLI installed, see Evergreen CLI Installation.

Step 2: Configure Your MCP Client

Add the Evergreen MCP server to your AI assistant's MCP configuration. You can use either uv (lightweight, no Docker needed) or Docker.

uv is a fast Python package manager that can run the MCP server directly — no cloning, no virtual environments, no Docker required.

Install uv (if you don't have it):

curl -LsSf https://astral.sh/uv/install.sh | sh

Then add the server to your MCP client config:

Cursor IDE (.cursor/mcp.json or Settings → MCP):

{
  "mcpServers": {
    "evergreen": {
      "command": "uvx",
      "args": [
        "--from=git+https://github.com/evergreen-ci/evergreen-mcp-server",
        "evergreen-mcp-server"
      ]
    }
  }
}

Claude Desktop (~/Library/Application Support/Claude/claude_desktop_config.json on macOS):

{
  "mcpServers": {
    "evergreen": {
      "command": "uvx",
      "args": [
        "--from=git+https://github.com/evergreen-ci/evergreen-mcp-server",
        "evergreen-mcp-server"
      ]
    }
  }
}

VS Code with MCP Extension (settings.json):

{
  "mcp.servers": {
    "evergreen": {
      "command": "uvx",
      "args": [
        "--from=git+https://github.com/evergreen-ci/evergreen-mcp-server",
        "evergreen-mcp-server"
      ]
    }
  }
}

Note: uvx automatically downloads, caches, and runs the server in an isolated environment. No manual setup needed.

Option B: Using Docker

Cursor IDE (.cursor/mcp.json or Settings → MCP):

{
  "mcpServers": {
    "evergreen": {
      "command": "docker",
      "args": [
        "run", "--rm", "-i",
        "-v", "${HOME}/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro",
        "-v", "${HOME}/.evergreen.yml:/home/evergreen/.evergreen.yml:ro",
        "-e", "SENTRY_ENABLED=true",
        "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
      ]
    }
  }
}

Claude Desktop (~/Library/Application Support/Claude/claude_desktop_config.json on macOS):

{
  "mcpServers": {
    "evergreen": {
      "command": "docker",
      "args": [
        "run", "--rm", "-i",
        "-v", "${HOME}/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro",
        "-v", "${HOME}/.evergreen.yml:/home/evergreen/.evergreen.yml:ro",
        "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
      ]
    }
  }
}

VS Code with MCP Extension (settings.json):

{
  "mcp.servers": {
    "evergreen": {
      "command": "docker",
      "args": [
        "run", "--rm", "-i",
        "-v", "${userHome}/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro",
        "-v", "${userHome}/.evergreen.yml:/home/evergreen/.evergreen.yml:ro",
        "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
      ]
    }
  }
}

Step 3: Start Using It

Once configured, you can ask your AI assistant questions like:

  • "Show me my recent Evergreen patches"

  • "What failed in my last patch?"

  • "Get the logs for this failing task"

  • "Find stepback failures in the mms project"

That's it! The server will use your evergreen login credentials automatically.

Note: Telemetry is enabled by default to help improve reliability. To disable it, change the arg SENTRY_ENABLED from true to false i.e. -e SENTRY_ENABLED=false. See Telemetry for details.


Alternative Setup Methods

Using API Keys (Legacy)

If you can't use OIDC authentication, you can use API keys instead:

  1. Get your API key from Evergreen (User Settings → API Key)

  2. Configure your MCP client:

{
  "mcpServers": {
    "evergreen": {
      "command": "docker",
      "args": [
        "run", "--rm", "-i",
        "-e", "EVERGREEN_USER=your_username",
        "-e", "EVERGREEN_API_KEY=your_api_key",
        "-e", "SENTRY_ENABLED=true",
        "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
      ]
    }
  }
}

Local Development Setup

For development or if you prefer not to use Docker:

  1. Clone and install:

    git clone https://github.com/evergreen-ci/evergreen-mcp-server.git
    cd evergreen-mcp-server
    python -m venv .venv
    source .venv/bin/activate  # On Windows: .venv\Scripts\activate
    pip install -e .
  2. Configure your MCP client to use the local installation:

    {
      "mcpServers": {
        "evergreen": {
          "command": "/path/to/evergreen-mcp-server/.venv/bin/evergreen-mcp-server",
          "args": []
        }
      }
    }

Running the Server (Detailed)

The Evergreen MCP server is designed to be used with MCP clients and communicates via stdio by default. This section covers all the ways you can run the server.

Understanding MCP Server Architecture

The MCP server operates as a subprocess spawned by your AI assistant (like Cursor, Claude Desktop, etc.). The assistant communicates with the server through standard input/output (stdio), sending JSON-RPC messages back and forth.

Key concepts:

  • stdio transport: The server reads from stdin and writes to stdout (default)

  • HTTP transports: Alternative transports (SSE, streamable-http) for when stdio isn't available

  • Lifespan management: The client (your AI assistant) manages starting/stopping the server

The fastest way to get started — no Docker, no cloning, no virtual environments. uv downloads and runs the server in an isolated environment automatically.

Prerequisites:

  • Evergreen CLI installed (evergreen login completed)

Install uv (if you don't have it):

curl -LsSf https://astral.sh/uv/install.sh | sh

Configuration:

{
  "mcpServers": {
    "evergreen": {
      "command": "uvx",
      "args": [
        "--from=git+https://github.com/evergreen-ci/evergreen-mcp-server",
        "evergreen-mcp-server"
      ]
    }
  }
}

How it works:

  • uvx fetches the package from GitHub, installs it in an isolated cache, and runs the evergreen-mcp-server entry point

  • Subsequent runs use the cached version (fast startup)

  • The server reads credentials from ~/.evergreen.yml and ~/.kanopy/token-oidclogin.json directly (no volume mounts needed)

  • To force a refresh: uv cache clean

With project configuration:

{
  "mcpServers": {
    "evergreen": {
      "command": "uvx",
      "args": [
        "--from=git+https://github.com/evergreen-ci/evergreen-mcp-server",
        "evergreen-mcp-server",
        "--project-id", "mongodb-mongo-master"
      ]
    }
  }
}

With custom endpoint URLs (optional):

Override the default Evergreen API endpoint URLs via environment variables. This is useful for Kanopy deployments or other environments where the server needs to reach Evergreen over a service mesh instead of the public ingress.

{
  "mcpServers": {
    "evergreen": {
      "command": "uvx",
      "args": [
        "--from=git+https://github.com/evergreen-ci/evergreen-mcp-server",
        "evergreen-mcp-server"
      ],
      "env": {
        "EVERGREEN_OIDC_REST_URL": "https://custom-evergreen.example.com/rest/v2/",
        "EVERGREEN_OIDC_GRAPHQL_URL": "https://custom-evergreen.example.com/graphql/query"
      }
    }
  }
}

Four env vars are available, one per auth-method/endpoint combination:

Variable

Auth Method

Default

EVERGREEN_OIDC_REST_URL

OIDC

https://evergreen.corp.mongodb.com/rest/v2/

EVERGREEN_OIDC_GRAPHQL_URL

OIDC

https://evergreen.corp.mongodb.com/graphql/query

EVERGREEN_API_KEY_REST_URL

API key

https://evergreen.mongodb.com/rest/v2/

EVERGREEN_API_KEY_GRAPHQL_URL

API key

https://evergreen.mongodb.com/graphql/query

Tip: If your IDE can't find uvx, use the full path (e.g., ~/.local/bin/uvx on macOS/Linux). Run which uvx to find it.

Method 2: Docker with OIDC

This is the most secure and easiest approach for most users.

Prerequisites:

  • Docker installed and running

  • Evergreen CLI installed (evergreen login completed)

Configuration:

{
  "mcpServers": {
    "evergreen": {
      "command": "docker",
      "args": [
        "run", "--rm", "-i",
        "-v", "${HOME}/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro",
        "-v", "${HOME}/.evergreen.yml:/home/evergreen/.evergreen.yml:ro",
        "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
      ]
    }
  }
}

With project configuration:

{
  "mcpServers": {
    "evergreen": {
      "command": "docker",
      "args": [
        "run", "--rm", "-i",
        "-v", "${HOME}/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro",
        "-v", "${HOME}/.evergreen.yml:/home/evergreen/.evergreen.yml:ro",
        "-e", "EVERGREEN_PROJECT=mongodb-mongo-master",
        "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
      ]
    }
  }
}

Method 3: Docker with API Keys

For environments where OIDC isn't available or when using service accounts.

When to use:

  • Kubernetes/cloud deployments

  • CI/CD pipelines

  • Service accounts

  • Environments where file mounting is difficult

Configuration:

{
  "mcpServers": {
    "evergreen": {
      "command": "docker",
      "args": [
        "run", "--rm", "-i",
        "-e", "EVERGREEN_USER=your_username",
        "-e", "EVERGREEN_API_KEY=your_api_key",
        "-e", "EVERGREEN_PROJECT=mongodb-mongo-master",
        "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
      ]
    }
  }
}

⚠️ Security considerations:

  • API keys in environment variables are visible in process lists

  • Consider using credential management systems in production

  • Rotate API keys regularly

Method 4: Local Installation (Development)

Running the server directly from source code for development or customization.

When to use:

  • Developing the MCP server itself

  • Testing local changes

  • Environments without Docker

  • Maximum control over dependencies

Setup:

# Clone and set up
git clone https://github.com/evergreen-ci/evergreen-mcp-server.git
cd evergreen-mcp-server
python -m venv .venv
source .venv/bin/activate  # Windows: .venv\Scripts\activate
pip install -e .

# Verify installation
evergreen-mcp-server --help

Configuration:

{
  "mcpServers": {
    "evergreen": {
      "command": "/absolute/path/to/evergreen-mcp-server/.venv/bin/evergreen-mcp-server",
      "args": []
    }
  }
}

With workspace auto-detection:

{
  "mcpServers": {
    "evergreen": {
      "command": "/path/to/.venv/bin/evergreen-mcp-server",
      "args": ["--workspace-dir", "${workspaceFolder}"]
    }
  }
}

Development workflow:

# Activate environment
source .venv/bin/activate

# Run tests
pytest tests/ -v

# Test with MCP Inspector
npx @modelcontextprotocol/inspector .venv/bin/evergreen-mcp-server

# Make changes to code
# Changes are immediately available due to editable install (pip install -e .)

Method 5: HTTP/SSE Transport

For scenarios where stdio isn't practical, run the server as a standalone HTTP service.

When to use:

  • Debugging with network inspection tools

  • Shared server instances

  • Non-stdio MCP clients

  • Browser-based AI assistants

Start the server:

# Using Docker
docker run --rm -p 8000:8000 \
  -e EVERGREEN_MCP_TRANSPORT=sse \
  -e EVERGREEN_MCP_HOST=0.0.0.0 \
  -v ~/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro \
  -v ~/.evergreen.yml:/home/evergreen/.evergreen.yml:ro \
  ghcr.io/evergreen-ci/evergreen-mcp-server:latest

# Using local installation
EVERGREEN_MCP_TRANSPORT=sse \
EVERGREEN_MCP_HOST=0.0.0.0 \
EVERGREEN_MCP_PORT=8000 \
evergreen-mcp-server

Client configuration:

{
  "mcpServers": {
    "evergreen": {
      "url": "http://localhost:8000/sse"
    }
  }
}

Transport options:

  • sse (Server-Sent Events): Best for most HTTP scenarios

  • streamable-http: Alternative streaming protocol

  • stdio: Default, for subprocess communication

Building Custom Docker Images

If you need to customize the Docker image:

# Clone the repository
git clone https://github.com/evergreen-ci/evergreen-mcp-server.git
cd evergreen-mcp-server

# Build custom image
docker build -t evergreen-mcp-server:custom .

# Test the custom image
docker run --rm -it \
  -e EVERGREEN_USER=your_username \
  -e EVERGREEN_API_KEY=your_api_key \
  evergreen-mcp-server:custom --help

# Use in MCP configuration
{
  "command": "docker",
  "args": [
    "run", "--rm", "-i",
    "-v", "${HOME}/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro",
    "-v", "${HOME}/.evergreen.yml:/home/evergreen/.evergreen.yml:ro",
    "evergreen-mcp-server:custom"
  ]
}

MCP Client Configuration (Detailed)

Comprehensive setup guides for various MCP clients and AI assistants.

Cursor IDE

Location: .cursor/mcp.json in your workspace, or Settings → Features → MCP

Basic configuration:

{
  "mcpServers": {
    "evergreen": {
      "command": "docker",
      "args": [
        "run", "--rm", "-i",
        "-v", "${HOME}/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro",
        "-v", "${HOME}/.evergreen.yml:/home/evergreen/.evergreen.yml:ro",
        "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
      ]
    }
  }
}

With environment variables:

{
  "mcpServers": {
    "evergreen": {
      "command": "docker",
      "args": [
        "run", "--rm", "-i",
        "-v", "${HOME}/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro",
        "-v", "${HOME}/.evergreen.yml:/home/evergreen/.evergreen.yml:ro",
        "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
      ],
      "env": {
        "EVERGREEN_PROJECT": "mongodb-mongo-master"
      }
    }
  }
}

Local installation:

{
  "mcpServers": {
    "evergreen": {
      "command": "/Users/yourname/projects/evergreen-mcp-server/.venv/bin/evergreen-mcp-server",
      "args": ["--workspace-dir", "${workspaceFolder}"]
    }
  }
}

Testing the configuration:

  1. Save your .cursor/mcp.json file

  2. Restart Cursor (or reload the window)

  3. Open the MCP panel (View → MCP or Cmd+Shift+P → "MCP")

  4. Verify the Evergreen server shows as "Connected"

  5. Try a test query: "Show me my recent Evergreen patches"

Claude Desktop

Location:

  • macOS: ~/Library/Application Support/Claude/claude_desktop_config.json

  • Windows: %APPDATA%\Claude\claude_desktop_config.json

  • Linux: ~/.config/Claude/claude_desktop_config.json

Configuration:

{
  "mcpServers": {
    "evergreen": {
      "command": "docker",
      "args": [
        "run", "--rm", "-i",
        "-v", "${HOME}/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro",
        "-v", "${HOME}/.evergreen.yml:/home/evergreen/.evergreen.yml:ro",
        "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
      ]
    }
  }
}

Testing:

  1. Save the config file

  2. Quit Claude Desktop completely

  3. Restart Claude Desktop

  4. Look for the 🔌 icon in the bottom-right corner

  5. Click it to see connected MCP servers

  6. Test with: "List my recent Evergreen patches"

Troubleshooting Claude Desktop:

  • Server not connecting: Check Docker is running (docker ps)

  • No 🔌 icon: Verify config file syntax (use a JSON validator)

  • Permission errors: Ensure credential files exist and are readable

  • Logs: View logs in Settings → Advanced → View Logs

VS Code with MCP Extension

Prerequisites:

  • Install the MCP extension from VS Code marketplace

Location: VS Code Settings (JSON) - settings.json

Configuration:

{
  "mcp.servers": {
    "evergreen": {
      "command": "docker",
      "args": [
        "run", "--rm", "-i",
        "-v", "${userHome}/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro",
        "-v", "${userHome}/.evergreen.yml:/home/evergreen/.evergreen.yml:ro",
        "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
      ],
      "env": {}
    }
  }
}

Note: VS Code uses ${userHome} instead of ${HOME} for path expansion.

Per-workspace configuration: Create .vscode/settings.json in your workspace:

{
  "mcp.servers": {
    "evergreen": {
      "command": "/path/to/.venv/bin/evergreen-mcp-server",
      "args": ["--workspace-dir", "${workspaceFolder}"],
      "env": {
        "EVERGREEN_PROJECT": "mongodb-mongo-master"
      }
    }
  }
}

Augment Code Assistant

For VS Code:

{
  "augment.mcpServers": {
    "evergreen": {
      "command": "docker",
      "args": [
        "run", "--rm", "-i",
        "-v", "${HOME}/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro",
        "-v", "${HOME}/.evergreen.yml:/home/evergreen/.evergreen.yml:ro",
        "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
      ],
      "env": {}
    }
  }
}

For JetBrains IDEs: Add to Augment plugin settings:

{
  "mcpServers": {
    "evergreen": {
      "command": "docker",
      "args": [
        "run", "--rm", "-i",
        "-v", "${HOME}/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro",
        "-v", "${HOME}/.evergreen.yml:/home/evergreen/.evergreen.yml:ro",
        "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
      ]
    }
  }
}

Using HTTP transport with Augment:

{
  "augment.mcpServers": {
    "evergreen": {
      "url": "http://localhost:8000/sse"
    }
  }
}

GitHub Copilot Chat

Configuration:

{
  "github.copilot.chat.mcp": {
    "servers": {
      "evergreen": {
        "command": "docker",
        "args": [
          "run", "--rm", "-i",
          "-v", "${HOME}/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro",
          "-v", "${HOME}/.evergreen.yml:/home/evergreen/.evergreen.yml:ro",
          "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
        ]
      }
    }
  }
}

Universal Configuration Pattern

For any MCP-compatible client, follow this pattern:

uv (simplest):

{
  "command": "uvx",
  "args": [
    "--from=git+https://github.com/evergreen-ci/evergreen-mcp-server",
    "evergreen-mcp-server"
  ]
}

Docker with OIDC:

{
  "command": "docker",
  "args": [
    "run", "--rm", "-i",
    "-v", "<path-to-token>:/home/evergreen/.kanopy/token-oidclogin.json:ro",
    "-v", "<path-to-config>:/home/evergreen/.evergreen.yml:ro",
    "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
  ]
}

Local installation:

{
  "command": "<absolute-path-to-venv>/bin/evergreen-mcp-server",
  "args": []
}

Path variables by platform:

  • macOS/Linux: ${HOME} or ~

  • Windows: ${USERPROFILE} or %USERPROFILE%

  • VS Code: ${userHome}

  • Cursor: ${HOME}


Tool Reference

list_user_recent_patches_evergreen

Lists recent patches for the authenticated user.

Parameters:

  • limit (optional): Number of patches to return (default: 10, max: 50)

  • project_id (optional): Filter by project identifier

Example Usage:

{
  "tool": "list_user_recent_patches_evergreen",
  "arguments": {
    "limit": 10
  }
}

Response Format:

{
  "user_id": "developer@example.com",
  "patches": [
    {
      "patch_id": "507f1f77bcf86cd799439011",
      "description": "Fix authentication bug",
      "status": "failed",
      "create_time": "2025-09-23T10:30:00Z",
      "project_identifier": "mms"
    }
  ]
}

get_patch_failed_jobs_evergreen

Retrieves failed jobs for a specific patch with test failure counts.

Parameters:

  • patch_id (required): Patch identifier

  • project_id (optional): Evergreen project identifier

  • max_results (optional): Maximum failed tasks to return (default: 50)

Example Usage:

{
  "tool": "get_patch_failed_jobs_evergreen",
  "arguments": {
    "patch_id": "507f1f77bcf86cd799439011"
  }
}

Response Format:

{
  "patch_info": { "status": "failed" },
  "failed_tasks": [
    {
      "task_id": "task_456",
      "status": "failed",
      "test_info": {
        "failed_test_count": 5
      }
    }
  ]
}

get_task_logs_evergreen

Retrieves detailed logs for a specific task with error filtering.

Parameters:

  • task_id (required): Task identifier

  • execution (optional): Task execution number (default: 0)

  • max_lines (optional): Maximum log lines (default: 1000)

  • filter_errors (optional): Filter for errors only (default: true)

Example Usage:

{
  "tool": "get_task_logs_evergreen",
  "arguments": {
    "task_id": "task_456",
    "filter_errors": true
  }
}

get_task_test_results_evergreen

Retrieves detailed unit test results for a task.

Parameters:

  • task_id (required): Task identifier

  • execution (optional): Task execution number (default: 0)

  • failed_only (optional): Only failed tests (default: true)

  • limit (optional): Maximum test results (default: 100)

Example Usage:

{
  "tool": "get_task_test_results_evergreen",
  "arguments": {
    "task_id": "task_456",
    "failed_only": true
  }
}

get_task_log_detailed

Fetches the complete, untruncated task logs via REST API. Returns the full task execution log including timeout handler output, process dumps, and stdout/stderr — content not accessible via the GraphQL get_task_logs_evergreen tool. Automatically scans for error patterns and returns a structured summary with top error terms and example lines when errors are found; returns raw text when no errors are detected.

Parameters:

  • task_id (required): Task identifier from get_patch_failed_jobs results

  • execution_retries (optional): Execution number, 0 for first run, 1+ for retries (default: 0)

Example Usage:

{
  "tool": "get_task_log_detailed",
  "arguments": {
    "task_id": "task_456",
    "execution_retries": 0
  }
}

get_test_results_detailed

Fetches raw test log content via REST API (stored in S3, not accessible via GraphQL). Automatically scans for error patterns and returns a structured summary. Use this to understand WHY a test failed, not just that it failed.

Parameters:

  • test_name (required): Test name for S3 log path (e.g., Job0, Job1)

  • task_id (required): Task identifier from get_patch_failed_jobs results

  • execution_retries (optional): Execution number (default: 0)

  • tail_limit (optional): Lines from end of log (default: 100000)

Example Usage:

{
  "tool": "get_test_results_detailed",
  "arguments": {
    "test_name": "Job0",
    "task_id": "task_456",
    "execution_retries": 0
  }
}

get_stepback_tasks_evergreen

Finds failed mainline tasks that have undergone stepback bisection.

Parameters:

  • project_id (required): Evergreen project identifier

  • limit (optional): Versions to analyze (default: 20)

  • requesters (optional): Filter by requester type (e.g. ['gitter_request'])

  • variants (optional): Filter to specific build variants

  • exclude_variants (optional): Exclude specific build variants

Example Usage:

{
  "tool": "get_stepback_tasks_evergreen",
  "arguments": {
    "project_id": "mongodb-mongo-master",
    "limit": 10,
    "variants": ["enterprise-rhel-80-64-bit"]
  }
}

get_inferred_project_ids_evergreen

Discovers which Evergreen projects you've been working on based on recent patches.

Parameters:

  • max_patches (optional): Patches to scan (default: 50)


Complete Workflow Examples

Workflow 1: Debugging a Failed Patch

Scenario: Your patch failed in CI, and you want to understand why.

Step 1: List Your Recent Patches

Ask your AI assistant: "Show me my recent Evergreen patches"

The assistant calls:

{
  "tool": "list_user_recent_patches_evergreen",
  "arguments": { "limit": 10, "project_id": "mms" }
}

Response shows:

{
  "patches": [
    {
      "patch_id": "abc123",
      "description": "CLOUDP-12345: Fix auth bug",
      "status": "failed",
      "create_time": "2025-01-12T10:30:00Z"
    }
  ]
}

Step 2: Analyze Failed Jobs

Ask: "What failed in patch abc123?"

The assistant calls:

{
  "tool": "get_patch_failed_jobs_evergreen",
  "arguments": { "patch_id": "abc123" }
}

Response shows:

{
  "failed_tasks": [
    {
      "task_id": "task_auth_tests_123",
      "task_name": "auth_unit_tests",
      "build_variant": "ubuntu2004",
      "status": "failed",
      "test_info": {
        "failed_test_count": 3,
        "total_test_count": 150
      }
    }
  ]
}

Step 3: Get Specific Test Failures

Ask: "Show me the failing tests in that task"

The assistant calls:

{
  "tool": "get_task_test_results_evergreen",
  "arguments": {
    "task_id": "task_auth_tests_123",
    "failed_only": true
  }
}

Response shows specific test names, files, and log URLs.

Step 4: Examine Error Logs

Ask: "Get the error logs for that task"

The assistant calls:

{
  "tool": "get_task_logs_evergreen",
  "arguments": {
    "task_id": "task_auth_tests_123",
    "filter_errors": true,
    "max_lines": 100
  }
}

Step 5: AI Analysis

The assistant synthesizes all this information and provides:

  • Root cause analysis

  • Suggested fixes

  • Links to relevant logs

  • Similar past failures

Workflow 2: Investigating Mainline Failures

Scenario: You want to find recent mainline commit failures that have been bisected via stepback.

Ask: "Find recent stepback failures in the mongodb-mongo-master project for the compile task"

{
  "tool": "get_stepback_tasks_evergreen",
  "arguments": {
    "project_id": "mongodb-mongo-master",
    "limit": 20,
    "variants": ["enterprise-rhel-80-64-bit-compile"]
  }
}

The response shows:

  • Versions with failures

  • Tasks that failed

  • Stepback information (which commits were tested)

  • Links to investigate further

Workflow 3: Monitoring Team's Patch Status

Scenario: You're on-call and want to check if team members have failing patches.

Ask: "Are there any recent failing patches I should know about?"

The assistant:

  1. Calls list_user_recent_patches_evergreen to get your patches

  2. Checks status of each

  3. For failed patches, calls get_patch_failed_jobs_evergreen

  4. Summarizes failures with severity and urgency

Workflow 4: Comparative Analysis

Scenario: Your test is flaky, and you want to compare multiple failures.

Ask: "Compare the failures in my last 3 patches"

The assistant:

  1. Lists your recent patches

  2. Gets failed jobs for each

  3. Analyzes common patterns

  4. Identifies if it's the same test failing

  5. Suggests if it's a flaky test vs. a real issue


Advanced Configuration

Understanding Evergreen Configuration File

The ~/.evergreen.yml file is your central configuration for Evergreen authentication and project settings.

Basic structure:

user: your.email@example.com
api_key: your_api_key_here
api_server_host: https://evergreen.mongodb.com
ui_server_host: https://spruce.mongodb.com

With OIDC (managed by evergreen login):

user: your.email@example.com
api_server_host: https://evergreen.mongodb.com
ui_server_host: https://spruce.mongodb.com

The OIDC token is stored separately in ~/.kanopy/token-oidclogin.json.

Project Auto-Detection

Configure automatic project detection based on your workspace directory:

user: your.email@example.com
api_key: your_api_key
projects_for_directory:
  /Users/yourname/mongodb: mongodb-mongo-master
  /Users/yourname/mms: mms
  /Users/yourname/atlas-proxy: atlasproxy

How it works:

  1. The MCP server checks your current workspace directory

  2. Matches it against the configured paths

  3. Automatically sets the project context for tool calls

  4. The AI assistant receives this as part of its context

Priority order:

  1. Explicit project_id argument in tool calls

  2. EVERGREEN_PROJECT environment variable

  3. Auto-detected from workspace directory

  4. Project specified in ~/.evergreen.yml (if single project)

Environment Variables Reference

Variable

Type

Description

Example

EVERGREEN_USER

string

Username for API key auth

john.doe@example.com

EVERGREEN_API_KEY

string

API key for authentication

abc123def456...

EVERGREEN_PROJECT

string

Default project identifier

mongodb-mongo-master

EVERGREEN_API_SERVER

string

API server URL (advanced)

https://evergreen.mongodb.com

EVERGREEN_OIDC_REST_URL

string

Override REST base URL for OIDC auth

https://evergreen.corp.mongodb.com/rest/v2/

EVERGREEN_OIDC_GRAPHQL_URL

string

Override GraphQL endpoint URL for OIDC auth

https://evergreen.corp.mongodb.com/graphql/query

EVERGREEN_API_KEY_REST_URL

string

Override REST base URL for API key auth

https://evergreen.mongodb.com/rest/v2/

EVERGREEN_API_KEY_GRAPHQL_URL

string

Override GraphQL endpoint URL for API key auth

https://evergreen.mongodb.com/graphql/query

EVERGREEN_MCP_TRANSPORT

enum

Transport protocol

stdio, sse, streamable-http

EVERGREEN_MCP_HOST

string

HTTP host binding

0.0.0.0, 127.0.0.1

EVERGREEN_MCP_PORT

integer

HTTP port

8000

WORKSPACE_PATH

string

Workspace directory

/path/to/project

SENTRY_ENABLED

boolean

Enable/disable telemetry (default: true)

true, false

Command-Line Arguments

All command-line arguments and their usage:

evergreen-mcp-server [OPTIONS]

Options:

--project-id <PROJECT_ID>

  • Explicitly set the default Evergreen project

  • Overrides auto-detection and environment variables

  • Example: --project-id mongodb-mongo-master

--workspace-dir <PATH>

  • Specify workspace directory for project auto-detection

  • Useful when running outside the actual workspace

  • Example: --workspace-dir /path/to/mongodb

--transport <TRANSPORT>

  • Choose transport protocol

  • Values: stdio (default), sse, streamable-http

  • Example: --transport sse

--host <HOST>

  • Host to bind for HTTP transports

  • Default: 127.0.0.1 (localhost only)

  • Use 0.0.0.0 to allow external connections

  • Example: --host 0.0.0.0

--port <PORT>

  • Port to listen on for HTTP transports

  • Default: 8000

  • Example: --port 9000

--help

  • Display help information and exit

Usage examples:

# Basic usage (stdio with auto-detection)
evergreen-mcp-server

# Explicit project
evergreen-mcp-server --project-id mms

# HTTP server mode
evergreen-mcp-server --transport sse --host 0.0.0.0 --port 8080

# With workspace detection
evergreen-mcp-server --workspace-dir ~/projects/mongodb

# Combined
evergreen-mcp-server --project-id mms --workspace-dir ~/projects/mms

Advanced Docker Configuration

Custom Networking

Run on a specific Docker network:

docker network create mcp-network

docker run --rm -i \
  --network mcp-network \
  -v ~/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro \
  -v ~/.evergreen.yml:/home/evergreen/.evergreen.yml:ro \
  ghcr.io/evergreen-ci/evergreen-mcp-server:latest

Resource Limits

Limit CPU and memory:

docker run --rm -i \
  --cpus="1.0" \
  --memory="512m" \
  -v ~/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro \
  -v ~/.evergreen.yml:/home/evergreen/.evergreen.yml:ro \
  ghcr.io/evergreen-ci/evergreen-mcp-server:latest

Using Docker Compose

Create docker-compose.yml:

version: '3.8'
services:
  evergreen-mcp:
    image: ghcr.io/evergreen-ci/evergreen-mcp-server:latest
    stdin_open: true
    volumes:
      - ~/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro
      - ~/.evergreen.yml:/home/evergreen/.evergreen.yml:ro
    environment:
      - EVERGREEN_PROJECT=mongodb-mongo-master
      - EVERGREEN_MCP_TRANSPORT=sse
      - EVERGREEN_MCP_HOST=0.0.0.0
      - EVERGREEN_MCP_PORT=8000
    ports:
      - "8000:8000"

Start with: docker-compose up


MCP Inspector Deep Dive

The MCP Inspector is an essential tool for testing, debugging, and understanding your MCP server.

Installing MCP Inspector

Option 1: Use with npx (recommended for occasional use)

npx @modelcontextprotocol/inspector <command>

Option 2: Global installation

npm install -g @modelcontextprotocol/inspector
mcp-inspector <command>

Basic Inspector Usage

Testing Docker-based Server

npx @modelcontextprotocol/inspector docker run --rm -i \
  -v ~/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro \
  -v ~/.evergreen.yml:/home/evergreen/.evergreen.yml:ro \
  ghcr.io/evergreen-ci/evergreen-mcp-server:latest

Testing Local Installation

# From the project directory
npx @modelcontextprotocol/inspector .venv/bin/evergreen-mcp-server

# With project configuration
npx @modelcontextprotocol/inspector .venv/bin/evergreen-mcp-server --project-id mms

Inspector Interface Walkthrough

When you start the inspector, it opens a web interface (typically at http://localhost:6274).

1. Connection Status Panel

Top-left corner shows:

  • Connected: Server is running and responding

  • 🔄 Connecting: Inspector is starting the server

  • Error: Connection failed (check logs)

2. Server Info Tab

Shows:

  • Server name and version

  • Available capabilities

  • Server metadata

  • Connection details

3. Tools Tab

This is where you test tool calls.

Interface elements:

  • Tool Selector: Dropdown of available tools

  • Parameters Panel: JSON editor for tool arguments

  • Call Tool Button: Execute the tool call

  • Response Panel: Shows the result

Example workflow:

  1. Select list_user_recent_patches_evergreen

  2. Edit parameters:

    {
      "limit": 5,
      "project_id": "mms"
    }
  3. Click "Call Tool"

  4. View response in the panel below

  5. Copy patch IDs for next calls

4. Resources Tab

Browse available MCP resources:

  • List all resources

  • View resource URIs

  • Read resource contents

  • Test resource access

5. Prompts Tab

If the server exposes prompt templates, you can:

  • List available prompts

  • View prompt templates

  • Test prompt execution

6. Logs Panel

Bottom panel shows real-time logs:

  • Server stdout/stderr

  • Request/response messages

  • Error traces

  • Debug information

Log filtering:

  • Click icons to filter by severity

  • Search logs with Cmd+F

  • Copy logs for debugging

Advanced Inspector Workflows

Workflow 1: Complete Failure Investigation

Simulate the AI assistant's workflow manually:

# Start inspector
npx @modelcontextprotocol/inspector .venv/bin/evergreen-mcp-server
  1. List patches (Tools tab):

    {
      "tool": "list_user_recent_patches_evergreen",
      "arguments": { "limit": 10 }
    }
  2. Copy a patch_id from the response

  3. Get failed jobs:

    {
      "tool": "get_patch_failed_jobs_evergreen",
      "arguments": { "patch_id": "<copied_id>" }
    }
  4. Copy a task_id from the failed_tasks array

  5. Get test results:

    {
      "tool": "get_task_test_results_evergreen",
      "arguments": { "task_id": "<copied_task_id>", "failed_only": true }
    }
  6. Get logs:

    {
      "tool": "get_task_logs_evergreen",
      "arguments": { "task_id": "<copied_task_id>", "filter_errors": true }
    }

Workflow 2: Performance Testing

Test tool response times and data volume:

  1. Start inspector with logs visible

  2. Call list_user_recent_patches_evergreen with limit: 50

  3. Note response time in logs

  4. Check data size in response panel

  5. Test with different limits to find optimal values

Workflow 3: Error Reproduction

If users report issues:

  1. Start inspector with same configuration as user

  2. Reproduce the exact tool calls

  3. Check logs for error messages

  4. Verify authentication status

  5. Test with different parameters to isolate the issue

Debugging with Inspector

Authentication Issues

Symptoms:

  • 401 errors in logs

  • "Unauthorized" in responses

Debug steps:

  1. Check "Logs" panel for auth errors

  2. Verify credential files are mounted (Docker) or exist (local)

  3. Test with: list_user_recent_patches_evergreen with limit: 1

  4. Check response for user identification

Tool Parameter Issues

Symptoms:

  • Tool calls fail with validation errors

Debug steps:

  1. Use the Inspector's parameter editor

  2. Check required vs optional parameters

  3. Verify parameter types (string vs int vs array)

  4. Look at example responses to understand expected formats

Network/API Issues

Symptoms:

  • Timeouts

  • Partial responses

Debug steps:

  1. Check logs for GraphQL errors

  2. Monitor response times

  3. Test with smaller data requests

  4. Verify Evergreen API is accessible

Inspector Tips and Tricks

Keyboard shortcuts:

  • Cmd/Ctrl + F: Search logs

  • Cmd/Ctrl + K: Clear logs

  • Cmd/Ctrl + E: Focus parameter editor

JSON editing:

  • Use the built-in JSON editor for syntax highlighting

  • Format JSON with Cmd+Shift+F

  • Validate before calling

Saving test cases:

  • Copy successful tool calls for documentation

  • Save parameter sets for regression testing

  • Export responses for test fixtures


IDE Integration (Detailed)

Comprehensive guides for integrating the Evergreen MCP server with various IDEs and AI coding assistants.

Cursor IDE (Comprehensive)

Setup locations:

  1. Workspace-specific: .cursor/mcp.json in your project root

  2. Global: Settings → Features → MCP

Using uv (recommended):

{
  "mcpServers": {
    "evergreen": {
      "command": "uvx",
      "args": [
        "--from=git+https://github.com/evergreen-ci/evergreen-mcp-server",
        "evergreen-mcp-server"
      ]
    }
  }
}

Using Docker:

{
  "mcpServers": {
    "evergreen": {
      "command": "docker",
      "args": [
        "run", "--rm", "-i",
        "-v", "${HOME}/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro",
        "-v", "${HOME}/.evergreen.yml:/home/evergreen/.evergreen.yml:ro",
        "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
      ]
    }
  }
}

With automatic project detection (Docker):

{
  "mcpServers": {
    "evergreen": {
      "command": "docker",
      "args": [
        "run", "--rm", "-i",
        "-v", "${HOME}/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro",
        "-v", "${HOME}/.evergreen.yml:/home/evergreen/.evergreen.yml:ro",
        "-v", "${workspaceFolder}:${workspaceFolder}:ro",
        "-e", "WORKSPACE_PATH=${workspaceFolder}",
        "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
      ]
    }
  }
}

Using local installation:

{
  "mcpServers": {
    "evergreen": {
      "command": "/Users/yourname/evergreen-mcp-server/.venv/bin/evergreen-mcp-server",
      "args": ["--workspace-dir", "${workspaceFolder}"]
    }
  }
}

Testing in Cursor:

  1. Save .cursor/mcp.json

  2. Reload window: Cmd+Shift+P → "Developer: Reload Window"

  3. Open MCP panel: Cmd+Shift+P → "MCP: Show Panel"

  4. Verify "evergreen" server shows ✓ Connected

  5. Test by asking: "Show my recent Evergreen patches"

Cursor-specific tips:

  • Cursor automatically injects workspace context

  • Use ${workspaceFolder} for workspace-relative paths

  • Cursor shows MCP status in the status bar

  • Click the MCP icon to see connected servers

Claude Desktop (Comprehensive)

Configuration file locations:

  • macOS: ~/Library/Application Support/Claude/claude_desktop_config.json

  • Windows: %APPDATA%\Claude\claude_desktop_config.json

  • Linux: ~/.config/Claude/claude_desktop_config.json

Using uv (recommended):

{
  "mcpServers": {
    "evergreen": {
      "command": "uvx",
      "args": [
        "--from=git+https://github.com/evergreen-ci/evergreen-mcp-server",
        "evergreen-mcp-server"
      ]
    }
  }
}

Using Docker:

{
  "mcpServers": {
    "evergreen": {
      "command": "docker",
      "args": [
        "run", "--rm", "-i",
        "-v", "${HOME}/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro",
        "-v", "${HOME}/.evergreen.yml:/home/evergreen/.evergreen.yml:ro",
        "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
      ],
      "env": {
        "EVERGREEN_PROJECT": "mongodb-mongo-master"
      }
    }
  },
  "globalShortcut": "Ctrl+Space"
}

Multiple servers example:

{
  "mcpServers": {
    "evergreen": {
      "command": "docker",
      "args": ["run", "--rm", "-i", "-v", "...", "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"]
    },
    "filesystem": {
      "command": "npx",
      "args": ["-y", "@modelcontextprotocol/server-filesystem", "/Users/yourname/projects"]
    }
  }
}

Setup checklist:

  1. ✅ Create/edit config file

  2. ✅ Validate JSON syntax

  3. ✅ Quit Claude Desktop completely (not just close window)

  4. ✅ Verify Docker is running: docker ps

  5. ✅ Start Claude Desktop

  6. ✅ Look for 🔌 icon (bottom-right)

  7. ✅ Click 🔌 to verify "evergreen" is connected

  8. ✅ Test with a query

Troubleshooting Claude Desktop:

Problem: No 🔌 icon appears

  • Verify JSON syntax (use jsonlint or online validator)

  • Check file location is correct

  • Ensure file is named exactly claude_desktop_config.json

Problem: Server shows as disconnected

  • Check Docker is running: docker ps

  • Verify credential files exist: ls -la ~/.evergreen.yml

  • Check Claude logs: Settings → Advanced → View Logs

Problem: Server connects but tools don't work

  • Test authentication with: evergreen --version

  • Verify evergreen login was successful

  • Check token file exists: ls -la ~/.kanopy/token-oidclogin.json

VS Code MCP Extension (Comprehensive)

Prerequisites:

  1. Install VS Code MCP extension from marketplace

  2. Ensure Docker is installed (for Docker method)

Configuration location:

  • Open Settings (JSON): Cmd+, → Open Settings (JSON)

  • Or edit .vscode/settings.json in workspace

Docker configuration:

{
  "mcp.servers": {
    "evergreen": {
      "type": "stdio",
      "command": "docker",
      "args": [
        "run", "--rm", "-i",
        "-v", "${userHome}/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro",
        "-v", "${userHome}/.evergreen.yml:/home/evergreen/.evergreen.yml:ro",
        "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
      ],
      "env": {}
    }
  }
}

Per-workspace configuration: Create .vscode/settings.json:

{
  "mcp.servers": {
    "evergreen": {
      "type": "stdio",
      "command": "${workspaceFolder}/.venv/bin/evergreen-mcp-server",
      "args": ["--workspace-dir", "${workspaceFolder}"],
      "env": {
        "EVERGREEN_PROJECT": "mongodb-mongo-master"
      }
    }
  }
}

VS Code variable reference:

  • ${workspaceFolder}: Current workspace root

  • ${userHome}: User's home directory

  • ${env:VAR_NAME}: Environment variable

Testing in VS Code:

  1. Save settings.json

  2. Reload window: Cmd+Shift+P → "Developer: Reload Window"

  3. Open MCP panel (if extension provides one)

  4. Check Output panel → MCP for logs

Augment (Comprehensive)

Augment is an AI coding assistant available for VS Code and JetBrains IDEs.

Augment in VS Code

Configuration in settings.json:

{
  "augment.mcpServers": {
    "evergreen": {
      "command": "docker",
      "args": [
        "run", "--rm", "-i",
        "-v", "${HOME}/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro",
        "-v", "${HOME}/.evergreen.yml:/home/evergreen/.evergreen.yml:ro",
        "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
      ],
      "env": {}
    }
  }
}

Using HTTP/SSE transport:

First, start the server:

docker run --rm -p 8000:8000 \
  -e EVERGREEN_MCP_TRANSPORT=sse \
  -e EVERGREEN_MCP_HOST=0.0.0.0 \
  -v ~/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro \
  -v ~/.evergreen.yml:/home/evergreen/.evergreen.yml:ro \
  ghcr.io/evergreen-ci/evergreen-mcp-server:latest

Then configure Augment:

{
  "augment.mcpServers": {
    "evergreen": {
      "url": "http://localhost:8000/sse"
    }
  }
}

Augment in JetBrains IDEs

Configuration:

  1. Open Augment plugin settings

  2. Navigate to MCP Servers section

  3. Add new server configuration:

{
  "evergreen": {
    "command": "docker",
    "args": [
      "run", "--rm", "-i",
      "-v", "${HOME}/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro",
      "-v", "${HOME}/.evergreen.yml:/home/evergreen/.evergreen.yml:ro",
      "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
    ]
  }
}

Testing Augment integration:

  1. Restart IDE/reload Augment

  2. Open Augment chat

  3. Type: "Can you check my recent Evergreen patches?"

  4. Augment should use the MCP server to fetch the data

GitHub Copilot Chat (Comprehensive)

Note: MCP support in GitHub Copilot is experimental and may require specific Copilot versions.

VS Code configuration:

{
  "github.copilot.chat.mcp": {
    "servers": {
      "evergreen": {
        "command": "docker",
        "args": [
          "run", "--rm", "-i",
          "-v", "${HOME}/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro",
          "-v", "${HOME}/.evergreen.yml:/home/evergreen/.evergreen.yml:ro",
          "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
        ]
      }
    }
  }
}

Using with Copilot Workspace:

If using Copilot in workspace mode:

{
  "github.copilot.chat.mcp": {
    "servers": {
      "evergreen": {
        "command": "${workspaceFolder}/.venv/bin/evergreen-mcp-server",
        "args": ["--workspace-dir", "${workspaceFolder}"]
      }
    }
  }
}

Windsurf (Comprehensive)

Windsurf is Codeium's agentic IDE.

Configuration location:

  • Settings → Extensions → MCP Servers

Configuration:

{
  "mcp.servers": {
    "evergreen": {
      "command": "docker",
      "args": [
        "run", "--rm", "-i",
        "-v", "${HOME}/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro",
        "-v", "${HOME}/.evergreen.yml:/home/evergreen/.evergreen.yml:ro",
        "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
      ]
    }
  }
}

Other IDEs and Generic Setup

For any IDE that supports MCP, follow this general pattern:

Step 1: Identify MCP configuration location

  • Check IDE documentation for MCP settings

  • Usually in settings JSON or dedicated MCP panel

Step 2: Use appropriate configuration format

Docker-based (most portable):

{
  "command": "docker",
  "args": [
    "run", "--rm", "-i",
    "-v", "<home>/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro",
    "-v", "<home>/.evergreen.yml:/home/evergreen/.evergreen.yml:ro",
    "ghcr.io/evergreen-ci/evergreen-mcp-server:latest"
  ]
}

Local installation:

{
  "command": "/absolute/path/to/.venv/bin/evergreen-mcp-server",
  "args": []
}

Step 3: Test the configuration

  1. Save configuration

  2. Restart IDE or reload settings

  3. Verify server appears in MCP panel (if available)

  4. Test with a simple query

Configuration Troubleshooting Guide

Problem: Server won't start

Checklist:

  • ✅ Docker is running: docker ps

  • ✅ Credentials exist: ls -la ~/.evergreen.yml ~/.kanopy/token-oidclogin.json

  • ✅ Path is absolute (for local installations)

  • ✅ Virtual environment is activated (for local)

  • ✅ JSON syntax is valid

Problem: Server starts but authentication fails

Check:

  1. evergreen login status

  2. Token file permissions

  3. Config file format

  4. Environment variables

Test manually:

# Docker method
docker run --rm -it \
  -v ~/.kanopy/token-oidclogin.json:/home/evergreen/.kanopy/token-oidclogin.json:ro \
  -v ~/.evergreen.yml:/home/evergreen/.evergreen.yml:ro \
  ghcr.io/evergreen-ci/evergreen-mcp-server:latest \
  --help

# Local method
.venv/bin/evergreen-mcp-server --help

Problem: Tools don't appear or aren't working

Debug steps:

  1. Check IDE logs for MCP errors

  2. Use MCP Inspector to verify tool availability

  3. Test tool calls directly with Inspector

  4. Verify project_id is correct


Troubleshooting

"Authentication failed" errors

  1. Re-run evergreen login to refresh your credentials

  2. Verify ~/.evergreen.yml exists and has valid credentials

  3. Check that ~/.kanopy/token-oidclogin.json exists (for OIDC)

  4. Test authentication: evergreen --version

"Project not found" errors

  1. Use get_inferred_project_ids_evergreen to discover available projects

  2. Specify project_id explicitly in your tool calls

  3. Add project mappings to ~/.evergreen.yml

  4. Verify project identifier spelling (case-sensitive)

Docker permission errors

Ensure Docker can read your credential files:

ls -la ~/.evergreen.yml ~/.kanopy/token-oidclogin.json
chmod 600 ~/.evergreen.yml ~/.kanopy/token-oidclogin.json

Token refresh issues

OIDC tokens expire. Re-run evergreen login if you see authentication errors after some time.

MCP Server won't connect

  1. Check if Docker is running: docker ps

  2. Test Docker image manually:

    docker run --rm -it ghcr.io/evergreen-ci/evergreen-mcp-server:latest --help
  3. Verify JSON configuration syntax

  4. Check IDE/client logs for error messages

Tools return no data

  1. Verify you have access to the Evergreen project

  2. Check if patches/tasks exist in the specified time range

  3. Test with broader parameters (higher limit, no filters)

  4. Use MCP Inspector to isolate the issue


Development

Project Structure

evergreen-mcp-server/
├── src/evergreen_mcp/
│   ├── server.py                    # Main MCP server
│   ├── mcp_tools.py                 # Tool definitions
│   ├── evergreen_graphql_client.py  # GraphQL client
│   └── evergreen_queries.py         # GraphQL queries
├── tests/
├── Dockerfile
├── pyproject.toml
└── README.md

Running Tests

# Install dev dependencies
pip install -e ".[dev]"

# Run tests
python -m pytest tests/ -v

# Run with coverage
python -m pytest --cov=evergreen_mcp tests/

Code Quality

# Format code
black src/ tests/

# Sort imports
isort src/ tests/

# Lint
flake8 src/ tests/

Updating GraphQL Schema

./scripts/fetch_graphql_schema.sh

Contributing

  1. Fork the repository

  2. Create a feature branch

  3. Make your changes with tests

  4. Ensure all tests pass

  5. Submit a pull request


License

This project follows the same license as the main Evergreen project.

Version

Current version: 0.4.2

Available Tools

8 tools
download_task_artifacts_evergreenA

Download artifacts from a specific Evergreen task. Use this to retrieve build outputs, test results, logs, or other files generated by a task. Artifacts are downloaded to a local directory structure organized by version.

ParametersJSON Schema
NameRequiredDescriptionDefault
task_idYesThe ID of the task to download artifacts for. Required.
work_dirNoThe base directory to create artifact folders in. Defaults to 'WORK'.WORK
bearer_tokenNoOverride with a bearer token for this request. If not provided, uses the server's default credentials.
artifact_filterNoOptional filter to download only artifacts containing this string (case-insensitive). If not provided, all artifacts are downloaded.

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A3.9/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full burden. It mentions 'downloaded to a local directory structure organized by version' but does not disclose potential issues like overwrite behavior, permission requirements, rate limits, or error handling for invalid task IDs.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences, no unnecessary words. First sentence states the purpose, second provides additional context. Very concise and front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Although an output schema exists, the description does not mention what the tool returns (e.g., list of downloaded file paths). It only describes the local directory effect. For a download tool, return behavior is important for agents to process results.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema description coverage is 100%, with all four parameters described adequately. The description adds minimal extra meaning beyond the schema (e.g., 'organized by version'). Baseline is 3 for high coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'Download artifacts from a specific Evergreen task' and lists examples like build outputs, test results, logs. It uses a specific verb and resource, and distinguishes from sibling tools that are read-only get/list operations.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description tells when to use this tool ('retrieve build outputs, test results, logs, or other files generated by a task') but does not explicitly mention when not to use or compare with sibling tools like get_task_log_* for log content.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_inferred_project_ids_evergreenA

Get a list of unique project identifiers inferred from the user's recent patches. This helps discover which Evergreen projects the user has been working on, sorted by activity (patch count and recency). Useful for understanding project context and filtering other queries.

ParametersJSON Schema
NameRequiredDescriptionDefault
max_patchesNoMaximum number of recent patches to scan for project identifiers. Use 20-50 for quick discovery, up to 50 for comprehensive analysis. Default is 50.
bearer_tokenNoOverride with a bearer token for this request. If not provided, uses the server's default credentials.

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must fully disclose behavioral traits. It explains the tool scans recent patches up to max_patches and sorts by activity, but does not mention potential performance implications of scanning up to 50 patches, error cases, or authentication details beyond the optional bearer token. These gaps are acceptable for a simple read operation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences: the first clearly states the primary action and output, the second adds context about sorting and usefulness. There is no redundant or extraneous information. It is appropriately sized and front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (2 optional parameters, output schema exists), the description covers the key aspects: what it does, how it works (scanning recent patches), and why it's useful. It does not detail the output format or error handling, but the output schema likely covers format. For a read-only discovery tool, it is sufficiently complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% according to context signals, with both parameters well-documented in the input schema. The description adds value by explaining the sorting logic and the inference mechanism, but does not significantly expand on the schema's existing parameter descriptions. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's purpose: 'Get a list of unique project identifiers inferred from the user's recent patches.' It specifies the verb (get), resource (project identifiers), and method (inferred from patches). The additional context about sorting by activity and usefulness for understanding project context distinguishes it from sibling tools like list_user_recent_patches_evergreen.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description mentions the tool is 'useful for understanding project context and filtering other queries,' which implies when to use. However, it does not explicitly state when not to use or provide direct comparisons to sibling tools. The guidance is adequate but lacks explicit exclusion or alternative suggestions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_patch_failed_jobs_evergreenA

Analyze failed CI/CD jobs for a specific patch to understand why builds are failing. Shows detailed failure information including failed tasks, build variants, timeout issues, log links, and test failure counts. Essential for debugging patch failures. If project_id is not specified, will automatically detect it from your workspace directory and recent patch activity.This tool may return a list of available project_ids if it cannot determine the project_id automatically.You should ask the user which project they want to use, then call this tool again with the project_id parameter set to their choice.

ParametersJSON Schema
NameRequiredDescriptionDefault
patch_idYesPatch identifier obtained from list_user_recent_patches. This is the 'patch_id' field from the patches array.
project_idNoEvergreen project identifier for the patch. If not provided, will auto-detect.
max_resultsNoMaximum number of failed tasks to analyze. Use 10-20 for focused analysis, 50+ for comprehensive failure review.
bearer_tokenNoOverride with a bearer token for this request. If not provided, uses the server's default credentials.

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A4.4/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Discloses auto-detection behavior for project_id, potential return of project list, and recommends user interaction. While no annotations are present, the description covers key behavioral aspects; however, it could note that the tool is read-only.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Description is concise (4-5 sentences) and front-loaded with purpose. Each sentence adds value, but it could be slightly tighter. Overall well-structured.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the existence of an output schema, the description effectively covers what the tool does, the parameters, and edge cases (missing project_id). It is complete for an analysis tool with moderate complexity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Adds meaning beyond the 100% schema coverage by explaining the purpose of patch_id and project_id, and providing usage guidance for max_results ('10-20 for focused analysis, 50+ for comprehensive review'). This adds value for the agent.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's purpose: 'Analyze failed CI/CD jobs for a specific patch to understand why builds are failing.' It specifies the verb (analyze) and resource (failed CI/CD jobs) and is distinct from sibling tools that focus on individual tasks or test results.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Provides explicit guidance on when to use ('Essential for debugging patch failures') and how to handle missing project_id (ask user to specify). It does not explicitly exclude scenarios but gives sufficient context for appropriate use.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_task_log_detailedA

Get the complete raw task logs via REST API. Returns the full untruncated task execution log including timeout handler output, process dumps, and stdout/stderr — content that the GraphQL get_task_log_summary tool cannot access. Automatically scans for error patterns and returns a structured summary with top error terms and example lines when errors are found. Best for debugging non-test failures (setup errors, timeouts, compilation failures). Use task_id from get_patch_failed_jobs results.

ParametersJSON Schema
NameRequiredDescriptionDefault
task_idYesTask identifier from get_patch_failed_jobs response. Found in the 'task_id' field of failed_tasks array.
bearer_tokenNoOverride with a bearer token for this request. If not provided, uses the server's default credentials.
execution_retriesNoTask execution number if task was retried. Usually 0 for first execution, 1+ for retries.

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Discloses automatic error pattern scanning and structured summary, but with no annotations, more could be added (e.g., response size, auth requirements, destructive potential). No contradiction with annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Four sentences, front-loaded with purpose, no redundancy. Every sentence adds value.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given output schema exists (not shown) and no annotations, description sufficiently covers return value (full logs + error summary). Slightly lacking in response size disclosure, but adequate for the tool's complexity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so description adds marginal value. It reinforces task_id source but does not provide new meaning beyond schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states it gets complete raw task logs via REST API, and distinguishes from the GraphQL get_task_log_summary tool by listing content it can access (timeout handler output, process dumps, stdout/stderr).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicitly recommends use for debugging non-test failures and references get_patch_failed_jobs as source for task_id. Does not explicitly state when not to use or provide alternatives for test failures, but the differentiation from get_task_log_summary is clear.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_task_log_summaryA

Get a truncated view of task logs via GraphQL. Returns log metadata and filtered error/failure messages, but only captures a limited portion of the full log (mostly test log ingestion messages). For complete raw task logs including timeout output, process dumps, and full execution logs, use get_task_log_detailed instead. Use task_id from get_patch_failed_jobs results.

ParametersJSON Schema
NameRequiredDescriptionDefault
task_idYesTask identifier from get_patch_failed_jobs response. Found in the 'task_id' field of failed_tasks array.
executionNoTask execution number if task was retried. Usually 0 for first execution, 1+ for retries.
max_linesNoMaximum log lines to return. Use 100-500 for quick error analysis, 1000+ for comprehensive debugging.
bearer_tokenNoOverride with a bearer token for this request. If not provided, uses the server's default credentials.
filter_errorsNoWhether to show only error/failure messages (recommended) or all log output. Set to false only when you need complete context.

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A4.7/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description fully discloses that the tool returns only a limited portion of the full log (mostly test log ingestion messages) and directs users to the detailed version for complete logs. No contradictions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise (3 sentences) and front-loaded with the core purpose. Every sentence adds value: purpose, limitation, alternative, and data source. No redundant words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the presence of an output schema (not shown) and comprehensive parameter schema, the description covers all necessary context: what it does, its limitations, when to use the sibling, and where to get the input. It is complete for an agent to decide and invoke correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with detailed descriptions for each parameter. The tool description adds minimal parameter-specific value beyond the schema, though it reiterates the source of task_id. Baseline of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool gets a truncated view of task logs via GraphQL, specifies it returns log metadata and filtered error/failure messages, and explicitly distinguishes it from the sibling tool get_task_log_detailed for complete logs. The verb 'get' and resource 'task_log_summary' are specific.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides explicit when-to-use guidance (truncated view, error analysis) and when-not-to-use (for complete logs, use get_task_log_detailed). It also gives a concrete tip: 'Use task_id from get_patch_failed_jobs results.'

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_test_results_detailedA

Get raw test log content via REST API. Fetches actual test output (stored in S3, not accessible via GraphQL). Automatically scans for error patterns and returns a structured summary with top error terms and example lines when errors are found. Use this to understand WHY a test failed, not just that it failed. Requires task_id and test_name from get_patch_failed_jobs results.

ParametersJSON Schema
NameRequiredDescriptionDefault
task_idYesTask identifier from get_patch_failed_jobs response. Found in the 'task_id' field of failed_tasks array.
test_nameYesThe test name used to locate its log in S3. For resmoke tests this is typically Job0, Job1, etc. For other test runners it may be the full test identifier. Used to construct the S3 log path: TestLogs/{test_name}/global.log.
tail_limitNoThe number of lines to return from the end of the test results. Defaults to 100000 for comprehensive review.
bearer_tokenNoOverride with a bearer token for this request. If not provided, uses the server's default credentials.
execution_retriesNoTask execution number if task was retried. Usually 0 for first execution, 1+ for retries.

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A4.5/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, description fully carries behavioral disclosure. It reveals the tool fetches from S3, not GraphQL, automatically scans for error patterns, and returns a structured summary with top error terms and example lines. This goes beyond a simple 'get content' description, though it doesn't detail auth mechanics or rate limits.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Description is extremely concise: two sentences covering core functionality, plus a short usage guideline. Every sentence adds value, no redundancy. Front-loaded with primary purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's moderate complexity (5 parameters, output schema exists), the description covers core functionality, usage context, output characteristics (error scan), and prerequisites. It is self-contained and complete for an agent to understand invocation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, but description adds valuable context beyond schema. For test_name, it explains typical values for resmoke tests; for tail_limit, it clarifies default purpose; for task_id, it specifies source. This enriches parameter understanding.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the tool fetches raw test log content from S3, explicitly distinguishing it from GraphQL-based tools. It provides specific verb+resource (Get raw test log content) and hints at its unique value (scanning for error patterns). The purpose is clear and differentiates from sibling tools like get_test_results_summary and get_task_log_summary.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicitly states when to use: to understand WHY a test failed. Provides prerequisite: requires task_id and test_name from get_patch_failed_jobs. However, does not explicitly mention when not to use or list alternative tools, though context implies summary tools are for lighter needs.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_test_results_summaryA

Get test result metadata via GraphQL. Returns test names, pass/fail statuses, durations, and Parsley log viewer URLs — but not the actual error messages from test output. For the raw test log content with error pattern analysis, use get_test_results_detailed instead. Use task_id from get_patch_failed_jobs results.

ParametersJSON Schema
NameRequiredDescriptionDefault
limitNoMaximum number of test results to return. Use 50-100 for focused analysis, 200+ for comprehensive review.
task_idYesTask identifier from get_patch_failed_jobs response. Found in the 'task_id' field of failed_tasks array.
executionNoTask execution number if task was retried. Usually 0 for first execution, 1+ for retries.
failed_onlyNoWhether to fetch only failed tests (recommended) or all test results. Set to false to see all tests including passing ones.
bearer_tokenNoOverride with a bearer token for this request. If not provided, uses the server's default credentials.

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A4.8/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full burden. It discloses that the tool uses GraphQL and does not return error messages. While it covers the main behavioral trait (what is omitted), it could be slightly more detailed about the scope or performance implications, but overall it is transparent.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three sentences that are dense with information. No wasted words. Purpose is front-loaded, then differentiation, then usage pointer.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the complexity (5 params, 1 required, output schema exists), the description fully explains what the tool returns and what it doesn't. It provides sufficient context for an AI agent to know when to call this tool and what to expect.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters5/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with all 5 parameters described. The description adds substantial context beyond the schema: recommended ranges for limit, source of task_id, meaning of execution, recommendation for failed_only, and explanation of bearer_token override.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool gets test result metadata (test names, pass/fail, durations, Parsley URLs) and explicitly says what it does NOT return (actual error messages). It distinguishes itself from the sibling tool get_test_results_detailed.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Provides explicit guidance: 'For the raw test log content with error pattern analysis, use get_test_results_detailed instead.' Also instructs to 'Use task_id from get_patch_failed_jobs results', which clarifies the prerequisite and context of use.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_user_recent_patches_evergreenA

Retrieve the authenticated user's recent Evergreen patches/commits with their CI/CD status. Use this to see your recent code changes, check patch status (success/failed/running), and identify patches that need attention. Returns patch IDs needed for other tools. If project_id is not specified, will automatically detect it from your workspace directory and recent patch activity.This tool may return a list of available project_ids if it cannot determine the project_id automatically.You should ask the user which project they want to use, then call this tool again with the project_id parameter set to their choice.

ParametersJSON Schema
NameRequiredDescriptionDefault
limitNoNumber of recent patches to return. Use smaller numbers (3-5) for quick overview, larger (10-20) for comprehensive analysis. Maximum 50.
project_idYesEvergreen project identifier (e.g., 'mongodb-mongo-master', 'mms') to filter patches. If not provided, will auto-detect from recent activity.
bearer_tokenNoOverride with a bearer token for this request. If not provided, uses the server's default credentials.

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A4.7/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, so description carries full burden. Discloses auto-detection of project_id, returned list of available IDs if undetermined, and that it returns patch IDs. Lacks mention of rate limits or authentication details beyond bearer token.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Four sentences, front-loaded with core purpose. No wasted words; structure logically flows from purpose to usage to parameter details.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Output schema exists, so return values not needed. Covers auto-detection behavior and project_id handling, but omits pagination or historical depth. Generally sufficient for a list tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters5/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% (baseline 3), but description adds valuable context: usage tips for limit, auto-detection behavior for project_id, and bearer token override. Enhances parameter understanding beyond schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states 'Retrieve the authenticated user's recent Evergreen patches/commits with their CI/CD status', specifying verb, resource, and scope. Distinguishes from siblings by focusing on user's recent patches.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicitly says 'Use this to see your recent code changes, check patch status...' and provides guidance on handling missing project_id (ask user). Differentiates from sibling tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

  1. 8 tool updatesv0.5.0
    • First observeddownload_task_artifacts_evergreen
    • First observedget_inferred_project_ids_evergreen
    • First observedget_patch_failed_jobs_evergreen
    • First observedget_task_log_detailed
    • First observedget_task_log_summary
    • First observedget_test_results_detailed
    • First observedget_test_results_summary
    • First observedlist_user_recent_patches_evergreen

TDQS

A4.2/5.0

Scored across 8 tools

Disambiguation4/5

Most tools have distinct purposes, but the summary/detailed pairs (get_task_log/get_test_results) could cause initial confusion. However, descriptions clearly contrast them, reducing ambiguity.

Naming Consistency3/5

Naming patterns are inconsistent: some tools end with '_evergreen', others don't; verbs vary (download, get, list); 'detailed' and 'summary' are used as suffixes but not consistently across all tools.

Tool Count5/5

8 tools is a reasonable count for a CI/CD debugging server, covering artifact downloads, log retrieval, test results, and patch listing without being excessive.

Completeness5/5

The tool set provides comprehensive retrieval capabilities for debugging failures: from listing patches and failed jobs to detailed logs and test results. No obvious gaps for the intended use case.

Maintenance

ActivityMaintained
ResponsivenessNo issues

Related MCP Connectors

Related MCP Servers

  • A
    license
    Not graded
    quality
    D
    maintenance
    An MCP server that enables large language models to interact directly with MongoDB databases, allowing them to query collections, inspect schemas, and manage data through natural language.
    19 npm
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    A Model Context Protocol (MCP) server for MongoDB operations, enabling AI assistants to interact with MongoDB databases through a standardized interface.
    19 npm
    4
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    An MCP server that provides Azure DevOps integration for AI assistants, enabling them to list projects, run pipelines, analyze failures, view logs, and troubleshoot builds directly from chat interfaces.
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    Enterprise-grade MCP server for Jenkins CI/CD integration that enables AI assistants to diagnose build failures, analyze pipelines, and search logs through natural conversation.
    6
    GPL 3.0