Skip to main content
Glama
TestPilot MCP
by Kirit2121

TestPilot MCP

TestPilot MCP is an open-source Model Context Protocol (MCP) server that allows AI models (Claude, ChatGPT, GitHub Copilot) to run tests, analyze results, and orchestrate QA workflows locally.

It works with your existing UI and API test frameworks β€” no rewrites, no lock-in.


πŸš€ What TestPilot MCP Does

TestPilot MCP enables AI to:

  • Run Playwright UI tests

  • Run existing API test suites (any framework)

  • Read and summarize test reports

  • Rerun failed tests

  • Explain failures in plain English

All locally, using your current test setup.


Related MCP server: RunAutomation MCP Server

🧠 What TestPilot MCP Is NOT

  • ❌ Not a test framework

  • ❌ Not a Playwright replacement

  • ❌ Not a cloud service

  • ❌ Not automatic test generation

TestPilot MCP is a controller / orchestrator that lets AI interact with real tools via MCP.


πŸ“¦ Requirements

You must already have:

  • Node.js (v18+ recommended)

  • A working test setup (UI and/or API)

  • Tests that can run via CLI

If this works on your machine:

npx playwright test

or:

npm run api-tests

Then TestPilot MCP will work.


πŸ”§ Installation

git clone https://github.com/Kirit2121/testpilot-mcp
cd testpilot-mcp
npm install
npx playwright install

▢️ Running the MCP Server

node server.js

This starts the MCP server and exposes TestPilot tools to MCP-compatible AI clients.


πŸ€– Using with AI Clients

Claude Desktop / ChatGPT MCP

Add this to your MCP configuration:

{
  "mcpServers": {
    "testpilot": {
      "command": "node",
      "args": ["server.js"]
    }
  }
}

Restart the AI client after saving.


πŸ§ͺ Available Tools

UI Testing

  • run_ui_tests – Executes Playwright tests

  • read_test_report – Reads Playwright JSON report

  • rerun_failed_tests – Reruns failed Playwright tests

API Testing

  • run_api_tests – Runs any API test command (framework-agnostic)


πŸ§ͺ API Testing Usage Example

If your project already supports:

npm run api-tests

You can tell the AI:

β€œRun API tests using npm run api-tests and summarize failures.”

TestPilot MCP will:

  • Execute the command

  • Capture output

  • Return structured results to the AI

No framework changes required.


your-project/
β”œβ”€β”€ tests/
β”œβ”€β”€ playwright.config.ts
β”œβ”€β”€ package.json
β”œβ”€β”€ testpilot-mcp/

TestPilot MCP can live alongside your existing test repository.


πŸ” Security Model

  • TestPilot MCP only executes tools you explicitly expose

  • No remote execution unless you configure it

  • Runs locally under your user permissions

  • No hidden network access


🧩 Extending TestPilot MCP

You can extend TestPilot MCP with:

  • CI/CD triggers (GitHub Actions, Jenkins)

  • Jira issue creation

  • Slack / Teams notifications

  • Docker support

  • Release readiness scoring

Pull requests are welcome.


🀝 Who Is This For?

  • QA Engineers

  • SDETs

  • Developers

  • DevOps teams

  • AI tooling enthusiasts

If you already have tests, TestPilot MCP helps AI control and reason about them.


πŸ“„ License

MIT

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

Loading tool schema changelog…

    Related MCP Connectors

    Related MCP Servers

    • A
      license
      Not graded
      quality
      C
      maintenance
      Connect AI agents to your test results, insights, and targets. Query test runs, failures, flaky tests, and regressions across frameworks including Playwright, Jest, Pytest, Cypress and more.
      46 npm
      MIT
    • A
      license
      A
      quality
      B
      maintenance
      Enables AI assistants to create, run, autocorrect, and monitor Playwright tests for your app with a local dashboard, credential vault, and public status page.
      16
      MIT