Skip to main content
Glama
razilzul

llm-eval-harness

by razilzul
OverviewSchemaSourceRelated ServersDiscussionsAdmin
TypeScript
Local

Related Servers

Alternatives to llm-eval-harness

No user-submitted related servers found.

    Related Servers

    • Jev

      Ridlo543
      A
      license
      Not graded
      quality
      A
      maintenance
      Enables agents and terminal workflows to run calibrated, typed single-pass evaluations such as diff review scoring, acceptance gating, command safety screening, candidate selection, and claim verification. Returns compact structured verdicts with numeric confidence scores in place of verbose chat responses.
      MIT

    • galton

      Luissalet
      A
      license
      Not graded
      quality
      B
      maintenance
      Enables assistants to queue and monitor local language and vision model evaluations, compare results with confidence intervals, and retrieve routing recommendations for task categories.
      MIT
    • Trustwise MCP Server by trustwiseai

      Trustwise MCP Serverofficial

      trustwiseai
      A
      license
      Not graded
      quality
      C
      maintenance
      Provides advanced evaluation tools for assessing AI safety, alignment, and performance of LLM outputs. Enables programmatic evaluation of quality, safety metrics like toxicity and PII detection, and operational metrics including carbon footprint and cost estimation.
      4
      Apache 2.0

    • agent-eval-gate

      dxwss
      A
      license
      Not graded
      quality
      C
      maintenance
      Serves MCP tools to inspect agent trace JSONL files and evaluate them against golden-case constraints, returning structured metrics and gate results.
      MIT

    • EvalForge Lite

      thejaredchapman
      A
      license
      A
      quality
      B
      maintenance
      Lets assistants send the same test prompts to as many as four text models across OpenRouter, Amazon Bedrock, Google Vertex AI and Microsoft Foundry, then automatically grade each answer with a judge model, rule checks and a policy gate. Returns scored leaderboards with letter grades, per-response strengths and weaknesses, latency, throughput and estimated cost, plus downloadable PDF and CSV reports.
      9
      120 PyPI
      MIT

    This server cannot be deployed

    One endpoint for every MCP toolRayrun runs every MCP server behind one URL and holds the credentials. Each call is decided per client, tool, and argument, then recorded.ray.runAd

    Maintenance

    ActivityMaintained
    ResponsivenessUnresponsive

    Resources