Skip to main content
Glama
fayehall-ai

eval-sample-size

by fayehall-ai
OverviewSchemaSourceRelated ServersDiscussionsAdmin
Python
Remote

Related Servers

Alternatives to eval-sample-size

No user-submitted related servers found.

    Related Servers

    • evalgateprivate

      ipezygj
      A
      license
      A
      quality
      C
      maintenance
      Eval-integrity statistics for AI benchmark claims — multiple-testing correction, power/MDE for model gaps, judge-bias and leaderboard-rank checks. Catches a benchmark number that won't survive a second look.
      9
      MIT

    • agent-eval

      RudrenduPaul
      A
      license
      A
      quality
      C
      maintenance
      MCP server exposing statistical regression testing for LLM agents as a "run" tool: p-value, effect size, and confidence interval on whether agent behavior actually changed.
      1
      62 PyPI
      Apache 2.0

    • evalsmith-mcp

      diegoperezg7
      A
      license
      A
      quality
      A
      maintenance
      Enables MCP clients to score retrieval quality with recall, precision, nDCG, hit rate and MRR, compare 2-3 configurations with seeded paired-bootstrap confidence intervals, audit agent tool calls against expected traces, and detect prompt regressions against golden sets. It also generates Markdown, JSON or JUnit reports with pass/fail gates, all deterministically and offline without paid API keys.
      6
      308 npm
      1
      MIT

    • statistician-mcp

      bmewing
      A
      license
      Not graded
      quality
      C
      maintenance
      Provides a virtual statistician for AI agents, offering real statistical methods such as design of experiments, hypothesis testing, regression, and process control. It includes an advisor tool to recommend appropriate analyses and generates plain-language interpretations of results.
      MIT
    • genpark-hypothesis-welch-t-test-statistical-evaluator-skill by Alpha-Park

      genpark-hypothesis-welch-tofficial

      Alpha-Park
      A
      license
      Not graded
      quality
      B
      maintenance
      Enables statistical A/B testing by computing Welch's two-sample t-test, Satterthwaite degrees of freedom, and two-tailed p-values, alongside time-series forecasting, anomaly detection, regression, and PCA through MCP tools.
      7
      MIT

    • shewhart-mcp

      bertanucar
      A
      license
      Not graded
      quality
      D
      maintenance
      Enables AI agents to perform statistical process control calculations using validated, deterministic tools such as control charts, capability analysis, and tolerance intervals.
      3
      MIT
    Deploy Server
    One endpoint for every MCP toolRayrun runs every MCP server behind one URL and holds the credentials. Each call is decided per client, tool, and argument, then recorded.ray.runAd

    TDQS

    A3.6/5.0

    Scored across 4 tools

    Disambiguation5/5

    Each tool has a clearly distinct statistical purpose: planning sample size, checking minimum detectable gap, paired comparison, and unpaired comparison. The paired vs. unpaired tests are explicitly distinguished by name and description, leaving little room for misselection.

    Naming Consistency4/5

    All tools share the eval_ prefix and snake_case formatting, which provides a predictable namespace. However, the suffixes mix verb-led names (eval_compare_paired) with noun phrases (eval_sample_size, eval_min_detectable_gap), a minor inconsistency.

    Tool Count5/5

    Four tools is well-scoped for a focused eval-statistics utility. Each tool covers a distinct and necessary part of sample-size planning and model comparison, with no redundant entries.

    Completeness5/5

    The surface covers the key lifecycle for eval statistical planning: determining required sample size, assessing detectable gaps, and comparing models under both paired and unpaired designs. No obvious gaps remain for the stated purpose.

    Maintenance

    ActivityMaintained
    ResponsivenessNo issues

    Resources