Skip to main content
Glama
rabbiyamehmood

MCP Test Automation Framework

by rabbiyamehmood
OverviewSchemaSourceRelated ServersDiscussionsAdmin
TypeScript
Local

🤖 MCP Test Automation Framework

SQA Test Automation powered by Claude/Deepseek AI with self-healing locators and auto GitHub checkin

🏗️ Architecture

mcp-automation/
├── src/
│   ├── mcp/                  # MCP Server (connects AI to browser)
│   │   ├── mcp-server.ts     # MCP tool definitions & handlers
│   │   └── index.ts
│   ├── core/                 # Core modules
│   │   ├── browser-manager.ts  # Playwright browser lifecycle
│   │   ├── config.ts           # Settings loader
│   │   └── logger.ts           # Logging utility
│   ├── healing/              # Self-Healing Engine
│   │   └── locator-healer.ts   # Alternative locator strategies
│   ├── scripts/              # Utility scripts
│   │   └── git-auto-checkin.ts # Auto commit & push to GitHub
│   ├── tests/                # Test definitions
│   │   ├── types.ts
│   │   └── google-search.ts
│   ├── mcp-server-entry.ts   # MCP server entry point
│   └── runner.ts             # Direct test runner
├── config/
│   └── settings.json         # Framework configuration
├── logs/                     # Run logs & screenshots
├── .github/workflows/        # CI/CD pipeline
├── package.json
├── tsconfig.json
└── README.md

Related MCP server: BarrHawk

🔄 How It Works

  1. AI (Claude/Deepseek) calls MCP tool
          │
          ▼
  2. Playwright executes browser action
          │
          ▼
  3. Element not found? 
          │
          ▼
  4. Self-Healing Engine kicks in
     ┌─────────────────────────────┐
     │ Tries: role → text →        │
     │ placeholder → label → testId│
     │ → CSS → XPath → aria-label  │
     └─────────────────────────────┘
          │
          ▼
  5. Found? → Logs healing action, proceeds
     Not found? → Screenshot, reports failure
          │
          ▼
  6. GitHub Auto Checkin
     ┌─────────────────────────────┐
     │ Creates branch              │
     │ test-run/<name>-<timestamp> │
     │ Stages & commits all files  │
     │ Pushes to remote            │
     └─────────────────────────────┘

🚀 Quick Start

1. Install dependencies

npm install
npx playwright install chromium

2. Configure

Edit config/settings.json:

  • Set AI provider and API keys (via env vars)

  • Configure browser options

  • Set GitHub remote URL

3. Set API Keys (optional — for AI features)

set ANTHROPIC_API_KEY=sk-ant-...    # For Claude
set DEEPSEEK_API_KEY=sk-...         # For Deepseek

4. Run tests directly

npm run dev

5. Start MCP Server (for AI assistant connection)

npm run mcp-server

Then connect your AI assistant (Claude/Deepseek) to this MCP server.

🛠️ MCP Tools Available to AI

Tool

Description

navigate

Navigate to a URL

click

Click an element (with self-healing)

type / fill

Type text into fields (with self-healing)

get_text

Get element text (with self-healing)

wait_for_selector

Wait for element to appear

screenshot

Capture page screenshot

press_key

Press keyboard keys

run_test

Execute a full test case

auto_checkin

Commit & push to GitHub

get_healing_summary

View self-healing stats

🧪 Self-Healing

When a locator fails, the engine tries these strategies in order:

  1. getByRole — Find by ARIA role

  2. getByText — Find by text content

  3. getByPlaceholder — Find by placeholder attribute

  4. getByLabel — Find by associated label

  5. getByTestId — Find by data-testid

  6. CSS selector — Try original selector as CSS

  7. CSS alternatives — e.g., textarea → input, attribute variations

  8. [aria-label] — Find by aria-label attribute

All healing actions are logged to logs/healing-log.json.

📤 GitHub Auto Checkin

After each test run, the framework automatically:

  1. Creates a new branch: test-run/<test-name>-<timestamp>

  2. Stages all changed files (tests, logs, screenshots)

  3. Commits with descriptive message

  4. Pushes to remote

🔧 Configuration

See config/settings.json for all options:

Section

Key

Description

ai

provider

"auto", "claude", or "deepseek"

browser

headless

true/false for headed mode

selfHealing

enabled

Enable/disable self-healing

selfHealing

maxRetries

Max healing attempts per locator

github

autoCheckin

Enable auto commit/push

logging

level

"debug", "info", "warn", "error"

📄 License

MIT

This server cannot be deployed

One endpoint for every MCP toolRayrun runs every MCP server behind one URL and holds the credentials. Each call is decided per client, tool, and argument, then recorded.ray.runAd

Resources

Related MCP Connectors

Related MCP Servers

  • BarrHawk by barrhawk

    BarrHawkofficial

    barrhawk
    F
    license
    Not graded
    quality
    C
    maintenance
    Enables automated end-to-end testing and verification of web applications through natural language, with self-healing selectors and dual-mode execution.
    15
    -

  • self-healing-browser-mcp

    RAJUSHANIGARAPU
    A
    license
    B
    quality
    C
    maintenance
    Enables AI agents to control a browser with self-healing locators that automatically recover when selectors change, allowing reliable web automation through natural language.
    7
    MIT

  • tuxedo-qa

    jonathan-ponciano
    A
    license
    A
    quality
    B
    maintenance
    Enables AI assistants to create, run, autocorrect, and monitor Playwright tests for your app with a local dashboard, credential vault, and public status page.
    16
    MIT