MEOK MCP Test MCP

Drop-in golden-file + schema-drift + tool-failure test harness for ANY MCP server. Generates a pytest template, produces an HMAC-signed test report, prints a Shields.io grade badge for your README.

🧪 Part of the MEOK Governance Substrate (£499/mo) — combine with mcp-spec-compliance-mcp (spec audit) + meok-mcp-hardening-mcp (security red-team) for the full pre-publish gate.

Why this exists

Thousands of MCPs ship zero tests. MCP Inspector is debug-only. Anthropic Registry will probably enforce some baseline by Q4 2026. Every MCP author wants a green check before submitting.

This MCP gives you:

Quick start

pip install meok-mcp-test-mcp
# or
uvx meok-mcp-test-mcp

from server import run_test_suite, sign_test_report

report = run_test_suite(
    server_json=my_server_json,
    golden_pairs=[
        {"name": "list_chains", "actual": actual_out, "expected": expected_out},
    ],
    schema_drift_baseline=last_known_good_server_json,
)
sealed = sign_test_report(report)
print(sealed["badge_url"])  # paste in your README

Tools exposed

• run_test_suite(server_json, golden_pairs?, schema_drift_baseline?) — full default suite

• validate_server_json(server_json) — structural validation

• validate_tool_schema(tool) — single tool deep-check

• diff_server_json(old, new) — structural diff with breaking-change flag

• run_golden_diff(actual, expected) — single snapshot check

• check_idempotency_static(samples) — given N samples, return whether all equal

• generate_test_template() — pytest scaffolding

• sign_test_report(report) — HMAC-seal + Shields.io badge

Wire it up to your CI

# .github/workflows/mcp-test.yml
name: MEOK MCP Test
on: [push, pull_request]
jobs:
  test:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v4
      - uses: actions/setup-python@v5
        with: { python-version: "3.11" }
      - run: pip install meok-mcp-test-mcp
      - run: python -m server  # runs the included pytest scaffold

Scoring

• A ≥ 90% passed

• B ≥ 75%

• C ≥ 60%

• D ≥ 40%

• F otherwise

Verify any signed report

Paste any signed test report at https://meok.ai/verify — the HMAC signature is checked against MEOK's public JWKS.

Pricing

• Self-host: free (MIT)

• Starter: £29/mo — 1K test runs/mo + signed badge SLA

• Pro: £79/mo — 10K runs/mo + custom badge + public dashboard

• Governance Substrate: £499/mo — bundled with 10 governance MCPs

• A2A Substrate: £999/mo — bundled with all 12 A2A MCPs

Companion MCPs

• mcp-spec-compliance-mcp — registry-spec conformity audit

• meok-mcp-hardening-mcp — OWASP LLM Top 10 + 5 MCP-specific risks

• meok-mcp-cardgen-mcp — generate .well-known/mcp cards

• meok-agents-md-lint-mcp — AGENTS.md spec lint

Legal

Built by MEOK AI Labs — trading name of CSOAI LTD, UK Companies House 16939677. Founder: Nicholas Templeman (nicholas@meok.ai). License: MIT.