A
licenseNot graded
qualityB
maintenanceEnables agents to run evals mid-task, providing tools to validate suites, execute model comparisons, and inspect calibration and win-rate reports.
MIT
io.github.Srikarmk/evalpair
by Srikarmk
Related Servers
Alternatives to io.github.Srikarmk/evalpair
No user-submitted related servers found.
Related Servers
Coval MCP Serverofficial
AlicenseBqualityBmaintenanceEnables AI assistants to interact with Coval's evaluation platform for launching and monitoring evaluation runs, managing agents and test sets, and retrieving evaluation metrics.34252 npm3MIT- AlicenseNot gradedqualityBmaintenanceEnables LLM evaluation and observability by uploading documents, building test sets, running RAG pipelines, and automatically scoring answers for groundedness, hallucination risk, retrieval quality, latency, and cost, with tools exposed to MCP-compatible clients.1MIT
- AlicenseAqualityCmaintenanceProvides read-only tools to generate test plans for AI agents, score agent runs, and produce reusable evaluation scorecards.3MIT
- AlicenseNot gradedqualityBmaintenanceEnables agents to browse and retrieve benchmark reasoning tasks, deterministically grade submitted answers, run the evaluation suite against a model provider, and inspect data provenance and the ranking-stability index entry. It also supports scoring stability analysis across repeated runs and prompt variants via its tools.26 npmMIT
- AlicenseNot gradedqualityCmaintenanceEnables scheduling fine-tuning runs, running regression evaluations on fine-tuned models, and comparing outputs from multiple models on shared prompts.MIT
This server cannot be deployed
Maintenance
ActivityMaintained
ResponsivenessNo recent community issues