Skip to main content
Glama
Sign In
agent-eval-gate

agent-eval-gate

by dxwss
OverviewSchemaSourceRelated ServersDiscussionsAdmin
Python
Local

Related Servers

Alternatives to agent-eval-gate

No user-submitted related servers found.

    Related Servers

    • benchmark-sycophancy

      itsryanarmani
      A
      license
      Not graded
      quality
      B
      maintenance
      Exposes MCP tools to list and inspect the 48 harm-ladder tasks, deterministically score a submitted decision trace, run a full evaluation against a mock or real model provider, and retrieve data provenance. This lets developers measure a model's pushback and refusal calibration as plan harm rises, directly from any MCP client.
      19 npm
      MIT

    • evalsmith-mcp

      diegoperezg7
      A
      license
      A
      quality
      B
      maintenance
      Enables MCP clients to score retrieval quality with recall, precision, nDCG, hit rate and MRR, compare 2-3 configurations with seeded paired-bootstrap confidence intervals, audit agent tool calls against expected traces, and detect prompt regressions against golden sets. It also generates Markdown, JSON or JUnit reports with pass/fail gates, all deterministically and offline without paid API keys.
      6
      73 npm
      1
      MIT

    • JevLab MCP Server

      omnirogue
      A
      license
      B
      quality
      B
      maintenance
      Exposes offline LLM-as-judge evaluation tooling to MCP clients so they can benchmark recorded judges against golden labels, diagnose position and verbosity bias, and fit probability calibrators with agreement, cost-frontier, and rubric-template utilities. It deliberately omits command judges, keeping all analysis standard-library and network-free.
      4
      1
      Apache 2.0

    • AgentInspect MCP Server

      rajudandigam
      A
      license
      Not graded
      quality
      A
      maintenance
      Read-only local MCP server for inspecting AgentInspect TypeScript AI-agent traces. Lists runs, exposes bounded causal-failure and TraceFacts evidence, evaluates TraceContract checks, compares runs, and creates share-checked evidence without mutating traces or invoking agent tools.
      14,507 npm
      212
      MIT

    This server cannot be deployed

    One endpoint for every MCP toolRayrun runs every MCP server behind one URL and holds the credentials. Each call is decided per client, tool, and argument, then recorded.ray.runAd

    Maintenance

    ActivityInactive
    ResponsivenessNo recent community issues

    Resources