Skip to main content
Glama

Related Servers

Alternatives to benchmark-schema-mutation

No user-submitted related servers found.

    Related Servers

    • A
      license
      Not graded
      quality
      A
      maintenance
      Enables agents to browse and retrieve benchmark reasoning tasks, deterministically grade submitted answers, run the evaluation suite against a model provider, and inspect data provenance and the ranking-stability index entry. It also supports scoring stability analysis across repeated runs and prompt variants via its tools.
      MIT
    • A
      license
      Not graded
      quality
      B
      maintenance
      Enables agents to turn a real model failure into a deterministic benchmark task by forging it with exact assertions, grading the task itself across six weighted factors, and inspecting a tamper-evident SHA-384 audit trail. Exposes eleven typed JSON-RPC 2.0 tools that call the same idempotent service layer as the UI, so mutations and decisions stay sealed and reproducible.
      MIT
    • A
      license
      Not graded
      quality
      A
      maintenance
      Enables listing and retrieving tasks from a benchmark for rule-conflict scenarios, scoring model answers, running evaluations, and checking data provenance through MCP tools. It supports offline mock runs and OpenRouter-backed model evaluations with deterministic assertion grading.
      MIT
    • A
      license
      Not graded
      quality
      A
      maintenance
      Exposes MCP tools to list and inspect the 48 harm-ladder tasks, deterministically score a submitted decision trace, run a full evaluation against a mock or real model provider, and retrieve data provenance. This lets developers measure a model's pushback and refusal calibration as plan harm rises, directly from any MCP client.
      MIT