Skip to main content
Glama
egoring

judge-mcp

by egoring
OverviewSchemaSourceRelated ServersDiscussionsAdmin
Python
Remote

Related Servers

Alternatives to judge-mcp

No user-submitted related servers found.

    Related Servers

    • HumanJudge by humanjudge

      HumanJudgeofficial

      humanjudge
      A
      license
      Not graded
      quality
      B
      maintenance
      Human-evaluation infrastructure for AI quality. 25,000+ blind human reviews by 200+ verified reviewers across 58 AI models — query the data via five MCP tools (get_model_scores, compare_models, get_flags, check_content, get_latest).
      2
      MIT

    • retrieval

      hcarrillo001
      A
      license
      Not graded
      quality
      B
      maintenance
      Scores AI outputs for faithfulness, relevancy, and hallucination inside any MCP client, with custom metrics, golden sets, and run history with dashboards.
      Apache 2.0

    • judge-audit-mcp

      asif786ka
      A
      license
      A
      quality
      C
      maintenance
      An MCP server that audits LLM-as-judge evaluations, detecting judge drift across runs, measuring bias through controlled probes, and comparing judge agreement with human raters.
      6
      MIT

    • LLM Evaluation Harness MCP

      SaiArja
      A
      license
      Not graded
      quality
      C
      maintenance
      Evaluates RAG outputs on faithfulness, answer relevancy, and context precision using an LLM-as-a-Judge backend. Exposes tools for running evaluations, scoring individual samples, and checking thresholds, enabling CI gating and on-demand assessment via MCP.
      MIT

    This server cannot be deployed

    One endpoint for every MCP toolRayrun runs every MCP server behind one URL and holds the credentials. Each call is decided per client, tool, and argument, then recorded.ray.runAd

    Maintenance

    ActivityMaintained
    ResponsivenessNo issues

    Resources