Skip to main content
Glama

Server Details

Evaluate ML features beyond a baseline and test bounded feature repairs. Invite-only beta.

Ownership verified
Status
Healthy
Uptime
100.0% over the last 24 hours
Last Tested
Transport
Streamable HTTP · MCP 2025-11-25
URL
ChatGPT
–
Claude
–

TDQS

B3.3/5.0

Scored across 26 tools

Disambiguation4/5

Most tools are distinguishable by workflow stage and resource type (upload, preflight, quote, submit, result, receipt, repair, campaign). The main ambiguity is among related families such as quote_audit/quote_repair/quote_campaign and the three upload/preflight variants, though the descriptions clarify their boundaries.

Naming Consistency5/5

All tool names use a consistent snake_case verb_noun pattern, such as get_audit_status, upload_private_dataset, quote_repair, and verify_audit_report. The vocabulary is predictable across the entire surface.

Tool Count3/5

The server covers a broad multi-stage ML audit workflow, so many tools are justified. However, 26 tools is heavy and includes several narrow lifecycle/admin operations, making the surface borderline over-scoped.

Completeness4/5

The surface covers discovery, access, credits, schemas, uploads, preflight validation, quoting, submission, status, results, receipts, verification, follow-up, usage, and deletion. Minor gaps remain, such as no obvious list-audits or cancellation flow.

Available Tools

26 tools
delete_auditA
DestructiveIdempotent
Inspect

Delete retained inputs and results for an audit owned by this tenant.

Inputs: audit_id (required).

delete_uploadA
DestructiveIdempotent
Inspect

Delete a tenant-private upload that is no longer needed.

Inputs: upload_id (required).

describe_refereeB
Read-onlyIdempotent
Inspect

Discover capabilities, privacy, and the approved public catalog.

Inputs: no named parameters.

get_audit_receiptA
Read-onlyIdempotent
Inspect

Read a tenant-private report fingerprint retained after report expiry or deletion. Older reports may have no record. This does not retrieve report contents.

Inputs: audit_id (required).

get_audit_resultB
Read-onlyIdempotent
Inspect

Read a completed tenant-private result and signed output manifest.

Inputs: audit_id (required).

get_audit_statusB
Read-onlyIdempotent
Inspect

Read the state of an audit owned by the authenticated tenant.

Inputs: audit_id (required).

get_beta_request_statusA
Read-onlyIdempotent
Inspect

Read the authenticated tenant's beta-access request status.

Inputs: request_id (required).

get_creditsB
Idempotent
Inspect

Read beta or paid audit-credit availability and usage.

Inputs: no named parameters.

get_input_schemaC
Read-onlyIdempotent
Inspect

Get neutral column roles and validation defaults for a vertical.

Inputs: vertical (required).

get_referee_readinessA
Read-onlyIdempotent
Inspect

Report connection, credential, audit-credit, and submission readiness with the next action.

Inputs: no named parameters.

get_referee_usageB
Read-onlyIdempotent
Inspect

Read aggregate, privacy-preserving Referee activity and outcome evidence for the selected audience.

Inputs: window_days.

get_repair_schemaC
Read-onlyIdempotent
Inspect

Get the feature-only contract for diagnosing degradation and testing bounded repairs.

Inputs: no named parameters.

list_verticalsB
Read-onlyIdempotent
Inspect

List the three supported evaluation profiles and their discovery tags.

Inputs: no named parameters.

preflight_datasetBInspect

Validate a tenant-private upload and its baseline evidence/row identity without spending a credit.

Inputs: contract (required), vertical (required), upload_id (required).

preflight_repairB
Idempotent
Inspect

Validate a tenant-private feature-repair matrix without spending a credit.

Inputs: contract (required), upload_id (required).

quote_auditB
Idempotent
Inspect

Create a contract-bound quote for one audit credit; baseline mode and evidence cannot be substituted.

Inputs: contract (required), vertical (required), upload_id (required), idempotency_key (required).

quote_campaignC
Idempotent
Inspect

Preflight all private feature shards, time a pilot, and quote credits and ETA for up to 1,000 candidates in one corrected search family.

Inputs: shards (required), vertical (required), idempotency_key (required).

quote_repairB
Idempotent
Inspect

Preflight and quote label-based feature repair; large jobs return a measured ETA and credit requirement.

Inputs: contract (required), upload_id (required), idempotency_key (required).

record_audit_followupC
Idempotent
Inspect

Record whether a completed audit changed a decision or was confirmed prospectively.

Inputs: kind (required), value (required), audit_id (required).

redeem_beta_inviteA
Idempotent
Inspect

Redeem one operator-issued invite for free beta audit credits before January 1, 2027.

Inputs: invite_code (required).

request_beta_accessC
Idempotent
Inspect

Request operator-reviewed beta access without purchasing or granting credits.

Inputs: lane (required), use_case (required), idempotency_key (required).

submit_auditC
Idempotent
Inspect

Accept a quote and atomically reserve its disclosed audit credits.

Inputs: quote_id (required), idempotency_key (required).

upload_campaign_shardC
Idempotent
Inspect

Encrypt one of up to 64 private feature shards for a large campaign; retain for at least 4,200 seconds.

Inputs: data (required), format, retention_seconds.

upload_private_datasetB
Idempotent
Inspect

Encrypt a de-identified CSV/JSON payload for a short tenant-private retention window.

Inputs: data (required), format, retention_seconds.

upload_repair_matrixC
Idempotent
Inspect

Encrypt one complete de-identified repair matrix of up to 100 MB and 1,000 diagnostic features.

Inputs: data (required), format, retention_seconds.

verify_audit_reportA
Read-onlyIdempotent
Inspect

Compare a locally computed SHA-256 with the retained tenant-private receipt. Use the exact downloaded result JSON bytes (not the API envelope), or UTF-8 result.report text with representation report_text. Never copy the expected hash as the candidate: compute it from the supplied artifact. A digest match does not validate a summary, factual correctness, or absence of harm. No report is uploaded.

Inputs: sha256 (required), audit_id (required), representation.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

Loading tool schema changelog…

    Related MCP Connectors

    Related MCP Servers

    • A
      license
      Not graded
      quality
      C
      maintenance
      Enables AI coding agents to submit code, files, or diffs for deterministic checks and optional re-verified LLM repair, returning cleaned code, structured findings, and a pass/fixed/reject verdict.
      MIT
    • A
      license
      Not graded
      quality
      D
      maintenance
      Provides advanced evaluation tools for assessing AI safety, alignment, and performance of LLM outputs. Enables programmatic evaluation of quality, safety metrics like toxicity and PII detection, and operational metrics including carbon footprint and cost estimation.
      4
      Apache 2.0
    Try in Browser

    Glama MCP Gateway

    Add one secure layer between your agents and this server.

    Resources