LLM Evaluation Harness MCP Server

by SaiArja

Overview Schema Source Related Servers Discussions Admin

Python

Local

Related Servers

Alternatives to LLM Evaluation Harness MCP Server

No user-submitted related servers found.

Related Servers

AgentOps EvalBench MCP
AI & Machine Learning RAG Systems Observability
AbhinavVarma02
A
license
Not graded
quality
A
maintenance
Enables LLM evaluation and observability by uploading documents, building test sets, running RAG pipelines, and automatically scoring answers for groundedness, hallucination risk, retrieval quality, latency, and cost, with tools exposed to MCP-compatible clients.
Updated 12 days ago (2026-09-01 03:01 UTC)
1
MIT
retrieval
AI & Machine Learning Testing & QA Tools
hcarrillo001
A
license
Not graded
quality
B
maintenance
Scores AI outputs for faithfulness, relevancy, and hallucination inside any MCP client, with custom metrics, golden sets, and run history with dashboards.
Updated 17 days ago (2026-08-27 03:55 UTC)
Apache 2.0
hallumark
RAG Systems Testing & QA Tools AI & Machine Learning
cognis-digital
F
license
Not graded
quality
C
maintenance
MCP-native auditor for LLM hallucination and grounding issues in RAG systems. Provides prioritized findings in table, JSON, or SARIF format for CI gating and AI agent integration.
Updated 2 months ago (2026-06-30 03:29 UTC)
-
mcp-llm-eval
AI & Machine Learning CI/CD & DevOps Testing & QA Tools
berkayildi
A
license
A
quality
C
maintenance
A local MCP server that packages LLM evaluation gates as reusable CI/CD primitives, enabling AI agents to run datasets against models, score responses, and enforce quality thresholds.
Updated 4 months ago (2026-05-03 21:53 UTC)
10
MIT
groundcheck
RAG Systems AI & Machine Learning
offquestxo
A
license
A
quality
B
maintenance
An MCP server that lets any AI agent evaluate RAG outputs -- faithfulness scoring, hallucination detection, and retrieval quality metrics -- with zero API keys, using MCP sampling.
Updated 2 months ago (2026-07-22 18:55 UTC)
6
MIT
Patronus MCP Serverofficial
AI & Machine Learning Testing & QA Tools
patronus-ai
A
license
Not graded
quality
D
maintenance
Enables running LLM evaluations, experiments, and custom evaluators through a standardized MCP interface.
Updated a year ago (2025-03-26 12:33 UTC)
16
Apache 2.0