TestPilot MCP
by Kirit2121
README.md
# TestPilot MCP
TestPilot MCP is an open-source **Model Context Protocol (MCP) server** that allows AI models
(Claude, ChatGPT, GitHub Copilot) to **run tests, analyze results, and orchestrate QA workflows locally**.
It works with your **existing UI and API test frameworks** โ no rewrites, no lock-in.
---
## ๐ What TestPilot MCP Does
TestPilot MCP enables AI to:
- Run Playwright UI tests
- Run existing API test suites (any framework)
- Read and summarize test reports
- Rerun failed tests
- Explain failures in plain English
All **locally**, using your current test setup.
---
## ๐ง What TestPilot MCP Is NOT
- โ Not a test framework
- โ Not a Playwright replacement
- โ Not a cloud service
- โ Not automatic test generation
TestPilot MCP is a **controller / orchestrator** that lets AI interact with real tools via MCP.
---
## ๐ฆ Requirements
You must already have:
- Node.js (v18+ recommended)
- A working test setup (UI and/or API)
- Tests that can run via CLI
If this works on your machine:
```bash
npx playwright test
```
or:
```bash
npm run api-tests
```
Then TestPilot MCP will work.
---
## ๐ง Installation
```bash
git clone https://github.com/Kirit2121/testpilot-mcp
cd testpilot-mcp
npm install
npx playwright install
```
---
## โถ๏ธ Running the MCP Server
```bash
node server.js
```
This starts the MCP server and exposes TestPilot tools to MCP-compatible AI clients.
---
## ๐ค Using with AI Clients
### Claude Desktop / ChatGPT MCP
Add this to your MCP configuration:
```json
{
"mcpServers": {
"testpilot": {
"command": "node",
"args": ["server.js"]
}
}
}
```
Restart the AI client after saving.
---
## ๐งช Available Tools
### UI Testing
- `run_ui_tests` โ Executes Playwright tests
- `read_test_report` โ Reads Playwright JSON report
- `rerun_failed_tests` โ Reruns failed Playwright tests
### API Testing
- `run_api_tests` โ Runs any API test command (framework-agnostic)
---
## ๐งช API Testing Usage Example
If your project already supports:
```bash
npm run api-tests
```
You can tell the AI:
> โRun API tests using npm run api-tests and summarize failures.โ
TestPilot MCP will:
- Execute the command
- Capture output
- Return structured results to the AI
No framework changes required.
---
## ๐ Recommended Project Structure
```
your-project/
โโโ tests/
โโโ playwright.config.ts
โโโ package.json
โโโ testpilot-mcp/
```
TestPilot MCP can live alongside your existing test repository.
---
## ๐ Security Model
- TestPilot MCP only executes tools you explicitly expose
- No remote execution unless you configure it
- Runs locally under your user permissions
- No hidden network access
---
## ๐งฉ Extending TestPilot MCP
You can extend TestPilot MCP with:
- CI/CD triggers (GitHub Actions, Jenkins)
- Jira issue creation
- Slack / Teams notifications
- Docker support
- Release readiness scoring
Pull requests are welcome.
---
## ๐ค Who Is This For?
- QA Engineers
- SDETs
- Developers
- DevOps teams
- AI tooling enthusiasts
If you already have tests, TestPilot MCP helps AI **control and reason about them**.
---
## ๐ License
MIT
This server cannot be deployed
Maintenance
ActivityInactive
ResponsivenessNo issues