A
licenseNot graded
qualityC
maintenanceEnables benchmarking of local LLM models (performance and quality) and sharing results to a public leaderboard via MCP tools.
14 npm
8
Apache 2.0
@mhdd_24/ai-benchmark-mcp
by Mhdd-24
Related Servers
Alternatives to @mhdd_24/ai-benchmark-mcp
No user-submitted related servers found.
Related Servers
- AlicenseNot gradedqualityAmaintenanceLets MCP clients browse benchmark tasks, inspect individual tasks, grade answers, execute the benchmark suite, and fetch provenance metadata.391 npmMIT
Patronus MCP Serverofficial
AlicenseNot gradedqualityDmaintenanceEnables running LLM evaluations, experiments, and custom evaluators through a standardized MCP interface.16Apache 2.0- AlicenseNot gradedqualityAmaintenanceEnables users to list and inspect benchmark tasks, grade answers, run benchmark evaluations, and retrieve provenance through its MCP interface.211 npmMIT
- FlicenseNot gradedqualityBmaintenanceEnables running deterministic multi-model prompt regression and golden dataset benchmark suites, exposing structured results and telemetry through the Model Context Protocol for integration with MCP-compliant clients.8-
- AlicenseNot gradedqualityAmaintenanceEnables MCP clients to list and inspect benchmark tasks, score submitted answers, run evaluations through OpenRouter, and retrieve provenance data for exploit-resistance testing.398 npmMIT
TDQS
C2.8/5.0
Scored across 4 tools
Disambiguation4/5
The four tools are mostly distinct: status shows configuration/health, list enumerates entities, inspect examines a single artifact, and compare contrasts two items. There is slight potential confusion between 'inspect' and 'compare' since both involve examining artifacts, but their purposes are clear enough.
Naming Consistency4/5
All tools share the 'aibench_' prefix and use simple verb-based names (status, list, inspect, compare). This is consistent, though the prefix is a bit verbose and 'aibench_status' is more of a noun than a verb_noun pattern.
Tool Count4/5
Four tools is a reasonable, focused set for a benchmark server. It covers the core operations without being bloated, though it is on the smaller side.
Completeness3/5
The set covers status, listing, inspection, and comparison, which are the main read-only operations for benchmarks. However, there are no tools to run, create, or delete benchmarks, so the surface is incomplete for a full lifecycle.
Maintenance
ActivitySlowing
ResponsivenessNo issues