rigor-mcp
rigor
AIエージェントのための検証済み統計的推論。
LLMは統計を暗唱するのは得意ですが、実際に計算するのは苦手です。
t統計量や必要サンプルサイズは学習データから思い出された数値であり、計算・検証されたものではありません。rigorはその代替手段です。古典的仮説検定、効果量、検出力/標本サイズ計算、多重比較補正を、ゼロから計算し、引用付きで前提条件をチェックした回答として返します。
MCPサーバーとして構築されています。現在のMCPエコシステム(Context7はコーディングドキュメント用、いくつかの物理学/工学/化学/地理サーバー、さらにはBentleyのSTAAD統合など)を調査したところ、統計学/実験計画は、まだ誰もカバーしていない数少ない共通のエージェントニーズの一つであることがわかりました。
統計計算自体(rigor/distributions.py、inference.py、effect_size.py、power.py、corrections.py)は純粋な標準ライブラリで、依存関係はありません。パッケージ全体としては、MCPサーバーがアドオンではなく出荷時の第一級の部品であるため、公式のmcp SDKに依存しています。詳細はインストールを参照してください。
インストール
pip install rigor-mcp(PyPIディストリビューションはrigor-mcpです。これは、単なるrigorは無関係のパッケージによって既に使用されていたためです。インポート可能なパッケージとCLIコマンドは両方とも引き続き単にrigorです。)これにより、rigor(CLI)とrigor-mcp(MCPサーバー)の両方のコンソールコマンドが取得できます。意図的に1つのインストールで、追加で何かを指定する必要はありません。なぜなら、uvx rigor-mcp(ほとんどのMCPクライアントが実際にこれを呼び出す方法)には、追加機能を要求する方法がないからです。
Related MCP server: evalgate
内容
rigor/distributions.py— t分布、カイ二乗分布、F分布をstdlib(正則化不完全ガンマ/ベータ関数)のみでゼロから構築。信頼できる転記ではなく、正確な閉形式の恒等式(t(1) = コーシー分布、chi2(2) = スケーリングされた指数分布、t² = F(1, df))に対して検証済み。rigor/inference.py— 1標本/2標本t検定、対応のあるt検定、1標本/2標本比率のz検定、カイ二乗適合度検定と独立性検定、一元配置分散分析。それぞれ統計量、自由度、両側p値、信頼区間、引用、および前提条件の警告(例:小標本の正規性への依存、低い期待セル数)を含むTestResultを返します。rigor/effect_size.py— Cohenのd、Hedgesのg、Cohenのh、CramérのV。rigor/power.py— 2標本t検定と2標本比率のz検定の検出力と必要標本サイズ。2つの方向(nが与えられた場合の検出力、検出力が与えられた場合のn)は、同じ基礎となる検出力関数に対する二分法により、互いに正確な数値上の逆数となっており、Cohen(1988)のd=0.5/α=.05/検出力=.80の教科書的な参考ケース(n≈64)に対して健全性がチェックされています。rigor/corrections.py— Bonferroni補正とBenjamini-Hochberg(FDR)多重比較補正。rigor/cli.py— 上記すべてをカバーするCLI(リポジトリルートのrigor.pyは、python3 rigor.py ...を何もインストールせずにプレーンなチェックアウトからでも動作させるための薄いシムです)。rigor/mcp_server.py— 17のすべての操作を任意のMCPクライアント(Claude Code、Claude Desktopなど)に公開するMCPツールラッパー。実際のクライアントに対するstdioを介したエンドツーエンドのスモークテスト済み。ツールディスカバリと代表的な呼び出しが既知の参照値に対してチェックされており、Cohen(1988)のケースがn=63で完全なラウンドトリップを着地させることを含みます。
使用方法
CLI、インストール後:
rigor ttest one-sample --data 5.1,4.9,5.3,5.0,4.8,5.2 --mu0 5.0
rigor power ttest-2samp --effect-size 0.5 --power 0.8
rigor --help # full list of subcommands (ttest, ztest, chi2, anova, effect-size, power, correct)または、何もインストールせずにチェックアウトから直接:
python3 rigor.py ttest one-sample --data 5.1,4.9,5.3,5.0,4.8,5.2 --mu0 5.0MCPサーバー、stdio経由(Claude Codeのようなローカルクライアントが期待するトランスポート):
pip install rigor-mcp
rigor-mcpまたはチェックアウトから: pip install mcp && python3 -m rigor.mcp_server。
Claude Codeに登録:
claude mcp add rigor -- rigor-mcp(または、チェックアウトから: claude mcp add rigor -- python3 -m rigor.mcp_server、このリポジトリのルートから、または絶対モジュールパスを使用して実行)。MCP Inspectorで対話的に試す場合は、インストールされたコマンドではなくスクリプトとして実行します。つまり、Inspectorがファイルを直接インポートするため、パッケージルートを手動でパスに追加する必要があります:
pip install "mcp[cli]"
PYTHONPATH=. mcp dev rigor/mcp_server.py対処されたトランスポートレベルのエッジケース
cohens_dは、ゼロ分散サンプルに対して正しく+inf/-infを返します(独自の文書化された契約による)が、非有限浮動小数点数はMCPの構造化コンテンツ上でJSON nullにシリアライズされます。以前はこれにより、ツール自身の数値型出力スキーマが失敗し、呼び出しがクラッシュしていました。MCPのcohens_dツールは、裸のfloatの代わりに{"value": float | null, "warnings": [...]}を返すようになり、そのケースが(null値、方向を示す警告)明示的に報告され、爆発しなくなりました。ここにある他のすべての数値ツールは有界であり、有効な入力に対して常に有限であるため、この処理はcohens_dに固有のものです。
テスト
python3 -m unittest discover -s tests -v70のテスト: 65は統計を直接実行。5は実際のMCPクライアントがするようにmcp_server.pyを起動し、ワイヤー越しに結果をチェックします(mcpがインストールされていない場合は自動的にスキップされます)。
ライセンス
MIT — LICENSEを参照してください。
Available Tools
37 toolsbenjamini_hochberg_correctionARead-onlyIdempotent
Adjust a batch of p-values for multiple comparisons, controlling the false discovery rate. Less conservative than Bonferroni; the standard choice when testing many hypotheses at once.
Inputs: p_values (required), alpha.
bonferroni_correctionARead-onlyIdempotent
Adjust a batch of p-values for multiple comparisons, controlling the family-wise error rate. Conservative; use when any false positive among the batch is costly.
Inputs: p_values (required), alpha.
chi_square_goodness_of_fitARead-onlyIdempotent
Test whether observed category counts match an expected distribution -- e.g. "are these six days-of-week signup counts evenly distributed, or skewed towards weekends?" Returns the chi-squared statistic, degrees of freedom (len-1), p-value, a citation, and a warning if any expected count is below 5 (the usual threshold below which this approximation gets unreliable).
Inputs: expected (required), observed (required), alpha.
chi_square_independenceARead-onlyIdempotent
Test whether the row and column variables of a contingency table are independent (e.g. "does group membership relate to outcome?"). Returns the chi-squared statistic, degrees of freedom, p-value, a citation, and a warning if any expected cell count is below 5 (consider cramers_v afterwards for effect size).
Inputs: table (required), alpha.
cohens_dARead-onlyIdempotent
Standardized mean difference between two samples (pooled SD). Use alongside two_sample_t_test, which tells you whether a difference is significant but not how large it is. Rough guidance: ~0.2 small, ~0.5 medium, ~0.8 large -- context-dependent. Returns {"value": float or null, "warnings": [...]}. value is null only when both samples have zero variance and unequal means, where the effect size is mathematically infinite -- see the warning for which direction, and report the raw mean difference instead in that case.
Inputs: a (required), b (required).
cohens_hARead-onlyIdempotent
Effect size for a difference between two proportions (Cohen, 1988), via the arcsine-square-root transform -- more appropriate than a raw percentage-point difference since it stabilizes variance across the full [0, 1] range. p1 and p2 are interchangeable (the sign of the result just indicates direction); use alongside two_proportion_z_test, which tells you whether a difference is significant but not how large it is. Returns a float (can be negative); rough guidance: ~0.2 small, ~0.5 medium, ~0.8 large.
Inputs: p1 (required), p2 (required). Returns: result
cramers_vARead-onlyIdempotent
Effect size for a chi-squared test of independence (Cramer, 1946), normalized to [0, 1] regardless of table shape so it's comparable across tables of different sizes, unlike the raw chi-squared statistic. Call after chi_square_independence, passing its statistic and the same table's n/rows/cols. Returns a float in [0, 1]; rough guidance for a 2x2 table: ~0.1 small, ~0.3 medium, ~0.5 large -- the threshold shifts for larger tables.
Inputs: n (required), cols (required), rows (required), chi2_statistic (required). Returns: result
eta_squaredARead-onlyIdempotent
Effect size for a one-way ANOVA: proportion of total variance explained by group membership. Use alongside one_way_anova, which tells you whether groups differ but not how much of the variance that accounts for. Rough guidance: ~0.01 small, ~0.06 medium, ~0.14 large. Biased upward for small samples -- prefer omega_squared when that matters. Returns a float in [0, 1].
Inputs: groups (required). Returns: result
fisher_exact_testARead-onlyIdempotent
Test whether the row and column variables of a 2x2 contingency
table are independent -- exact (via the hypergeometric distribution
over all tables with the same margins), unlike
chi_square_independence's chi-squared approximation. Use this
instead whenever chi_square_independence warns an expected cell
count is below 5, or whenever the sample is small. 2x2 tables only.
Returns the sample odds ratio as statistic (can be inf/0 for a
zero cell), a two-tailed p-value, a citation, and warnings.
Inputs: table (required), alpha.
kruskal_wallisARead-onlyIdempotent
The non-parametric alternative to one_way_anova -- use when that test's own small-df warning makes a normal-theory result suspect. Tests whether all groups are drawn from the same distribution, by ranking the combined data rather than assuming normal populations. A significant result means at least one group differs, not which one -- same caveat as one_way_anova.
Inputs: groups (required), alpha.
levene_testARead-onlyIdempotent
Test whether two or more groups have equal population variances (homogeneity of variance) -- use this to decide equal_var for two_sample_t_test, or to sanity-check one_way_anova's equal-variance assumption. Uses the Brown-Forsythe variant (deviations from each group's median), more robust to non-normal data than the original mean-based Levene's test. Returns the same shape as one_way_anova (it's computed as one internally, on absolute deviations from each group's median).
Inputs: groups (required), alpha.
mann_whitney_uARead-onlyIdempotent
The non-parametric alternative to two_sample_t_test -- use when that test's own small-n warning makes a normal-theory result suspect, or the data is ordinal/skewed. Tests whether values from sample a are systematically larger or smaller than values from sample b, by ranking the combined data rather than assuming normal populations. statistic is U for sample a; pair with rank_biserial_correlation for a standardized effect size. Returns the same result shape as the parametric tests (statistic, p_value, citation, warnings).
Inputs: a (required), b (required), alpha.
mcnemar_exact_testARead-onlyIdempotent
Exact version of mcnemar_test: an exact binomial test (p=0.5) on
the discordant pairs instead of the chi-squared approximation -- the
small-sample-safe alternative mcnemar_test's own warning points to,
the same relationship fisher_exact_test has to
chi_square_independence. statistic is b-c (the raw
discordant-pair imbalance); the p-value is two-tailed.
Inputs: table (required), alpha.
mcnemar_testARead-onlyIdempotent
Test whether two paired proportions are equal -- e.g. the same subjects' yes/no answers before and after an intervention, or two raters' calls on the same items. Use this instead of two_proportion_z_test whenever the "two groups" are actually the same subjects measured twice; two_proportion_z_test assumes independent groups and gets the standard error wrong for paired data. Yates continuity-corrected chi-squared, 1 df -- use mcnemar_exact_test instead when there are few discordant pairs (this warns when there are). Returns that chi-squared statistic, a p-value, and a confidence interval for the difference in marginal proportions.
Inputs: table (required), alpha.
naive_peeking_inflationARead-onlyIdempotent
Demonstrates, by simulation, why sequential_two_sample_mean_test / sequential_two_proportion_test exist: the actual false-positive rate of checking an ordinary fixed-sample test (two_sample_t_test, two_proportion_z_test, ...) after every new observation and stopping the first time it clears alpha, versus the alpha actually intended. Call this to show a skeptical stakeholder concretely what "just peek at the dashboard and stop early" costs before recommending the always-valid alternative. Returns the estimated true false-positive rate, its Monte Carlo standard error, and a citation.
Inputs: n_looks (required), alpha, trials.
omega_squaredARead-onlyIdempotent
Effect size for a one-way ANOVA, less biased than eta_squared for small samples since it subtracts out the variance explained by chance alone. Use alongside one_way_anova. Can be slightly negative when the true effect is near zero -- that's expected, not an error.
Inputs: groups (required). Returns: result
one_proportion_z_testARead-onlyIdempotent
Test whether an observed proportion (successes out of n) differs from a hypothesized proportion p0 -- e.g. "is this coin fair (p0=0.5) given 55 heads in 100 flips?" Uses the normal approximation, which degrades for small n or p0 near 0 or 1; a warning is included when that assumption looks shaky. Returns the z-statistic, two-tailed p-value, a confidence interval for the true proportion, a citation, and warnings.
Inputs: n (required), p0 (required), successes (required), alpha.
one_sample_t_testARead-onlyIdempotent
Test whether a sample's mean differs from a hypothesized value mu0. Returns the t-statistic, degrees of freedom, two-tailed p-value, a confidence interval for the mean, and any assumption warnings.
Inputs: mu0 (required), data (required), alpha.
one_way_anovaARead-onlyIdempotent
Test whether three or more independent groups have different means -- e.g. comparing average order value across three marketing channels. A significant result means at least one group differs from the others, not which one -- follow up with pairwise two_sample_t_test calls (correcting for multiple comparisons via bonferroni_correction or benjamini_hochberg_correction) to find which. Returns the F-statistic, between/within degrees of freedom, p-value, a citation, and a warning if within-group df is small.
Inputs: groups (required), alpha.
paired_t_testARead-onlyIdempotent
Test whether the mean difference between paired observations (e.g. before/after measurements on the same subjects, or matched pairs) is zero. a[i] and b[i] must be the two measurements of the same pair -- use two_sample_t_test instead if the two samples are independent (different subjects in each group). Returns the t-statistic, degrees of freedom (n-1), two-tailed p-value, a confidence interval for the mean difference, a citation, and assumption warnings.
Inputs: a (required), b (required), alpha.
pairwise_group_comparisonsARead-onlyIdempotent
Run every pairwise comparison across 2+ groups and correct for multiple comparisons in one call, instead of orchestrating k*(k-1)/2 separate two_sample_t_test/mann_whitney_u calls plus a separate correction call by hand -- and forgetting the correction is one of the most common real mistakes this package exists to prevent. The natural follow-up after a significant one_way_anova/kruskal_wallis result: pass the same groups here to find which group(s) differ, not just whether any do. Returns every pair's statistic, raw p-value, whether it's still significant after correction, and an effect size, plus the correction method's citation and warnings.
Inputs: groups (required), test, alpha, labels, +2 more.
pearson_correlationARead-onlyIdempotent
Test for a linear association between two paired variables -- e.g. "does hours studied predict test score?" statistic is r itself (in [-1, 1]), not a t-statistic. Returns r, df (n-2), a two-tailed p-value (H0: r=0), a confidence interval for r via the Fisher z-transform, a citation, and warnings. Use spearman_correlation instead if the relationship may be monotonic but not linear, or if outliers shouldn't dominate the result. Use simple_linear_regression instead for the actual slope (units of y per unit of x), not just the strength of association.
Inputs: x (required), y (required), alpha.
power_for_one_sample_t_testARead-onlyIdempotent
Statistical power to detect a given Cohen's d with n observations, using a one-sample (or paired) t-test. Use for paired_t_test too -- it's a one-sample t-test on the differences, so the same power formula applies. Use sample_size_for_one_sample_t_test instead to solve for n given a target power. Returns a float in [alpha, 1].
Inputs: n (required), effect_size_d (required), alpha. Returns: result
power_for_two_proportion_testARead-onlyIdempotent
Statistical power to detect a difference between two proportions (e.g. two conversion rates) with n_per_group observations in each group, using a two-proportion z-test. p1 and p2 are interchangeable (only their difference matters) -- e.g. current vs. new conversion rate. Use sample_size_for_two_proportion_test instead to solve for n given a target power. Returns a float in [alpha, 1].
Inputs: p1 (required), p2 (required), n_per_group (required), alpha. Returns: result
power_for_two_sample_t_testARead-onlyIdempotent
Statistical power to detect a given Cohen's d with n_per_group observations per group, using a two-sample t-test. Power is the probability of correctly detecting a real effect of this size at the given alpha; a design with low power means a non-significant result would be inconclusive rather than good evidence the effect doesn't exist. Use sample_size_for_two_sample_t_test instead to solve for n given a target power. Returns a float in [alpha, 1].
Inputs: n_per_group (required), effect_size_d (required), alpha. Returns: result
rank_biserial_correlationARead-onlyIdempotent
Effect size for a Mann-Whitney U test. Call after mann_whitney_u, passing its statistic and the two sample sizes. Positive means sample 1's values tend to exceed sample 2's; negative means the reverse; 0 is no tendency either way. Returns a float in [-1, 1]; rough guidance mirrors Cohen's d: ~0.1 small, ~0.3 medium, ~0.5 large.
Inputs: n1 (required), n2 (required), u1_statistic (required). Returns: result
recommend_testARead-onlyIdempotent
Not sure which rigor tool fits your question? Answer a few characteristics of the data and get back which tool to call, why, what to call instead if this test's assumptions look shaky, and what to run alongside it (an effect size, a power calculation, a natural follow-up). Every test in this package already documents this guidance in its own docstring for the sibling comparisons it knows about -- this tool exists so you don't have to have already read every other tool's docstring to find the one relevant cross-reference. Pure decision logic, no statistics computed here.
Inputs: outcome_type (required), paired, n_groups, small_or_skewed, +3 more.
sample_size_for_one_sample_t_testARead-onlyIdempotent
How many observations are needed to detect a given Cohen's d with a one-sample (or paired) t-test at the target power. Use for paired_t_test too -- a paired t-test is a one-sample t-test on the differences, so the same power formula applies. Returns a continuous value and a rounded-up integer to actually use.
Inputs: effect_size_d (required), alpha, target_power.
sample_size_for_two_proportion_testARead-onlyIdempotent
How many observations per group are needed to detect a difference between two proportions (e.g. conversion rates) at the target power. p1 and p2 are interchangeable -- only their difference matters.
Inputs: p1 (required), p2 (required), alpha, target_power.
sample_size_for_two_sample_t_testARead-onlyIdempotent
How many observations per group are needed to detect a given Cohen's d with a two-sample t-test at the target power. Returns a continuous value and a rounded-up integer to actually use.
Inputs: effect_size_d (required), alpha, target_power.
sequential_two_proportion_testARead-onlyIdempotent
Always-valid test of whether two proportions (e.g. two conversion rates in a live A/B test) differ, safe to call again after every new observation in either group -- the sequential-monitoring counterpart to two_proportion_z_test. Use this instead whenever the result will be checked more than once before the experiment ends, which is the normal case for a live dashboard rather than a one-shot analysis. p1 and p2 are interchangeable (only their difference matters). tau does not need to be exact -- reuse the minimum-detectable-effect you'd otherwise plug into sample_size_for_two_proportion_test.
Inputs: n1 (required), n2 (required), tau (required), successes1 (required), +2 more.
sequential_two_sample_mean_testARead-onlyIdempotent
Always-valid test of whether two groups' means differ, safe to call again after every new observation in either group -- unlike two_sample_t_test, which needs a sample size decided in advance and gives no such guarantee if checked repeatedly and stopped at the first significant look (that repeated-checking failure mode is exactly what inflates false positives; see naive_peeking_inflation for a demonstration). Use this instead of two_sample_t_test whenever a result will be (or already has been) checked more than once as data accumulates, e.g. monitoring a live experiment. Returns the current effect estimate, its standard error, the mixture likelihood ratio and always-valid p-value, and assumption warnings. tau does not need to be exact -- reuse the minimum-detectable-effect you'd otherwise plug into sample_size_for_two_sample_t_test.
Inputs: a (required), b (required), tau (required), alpha, +1 more.
simple_linear_regressionARead-onlyIdempotent
Fit y = intercept + slope * x by ordinary least squares -- single predictor only. Reports the slope (change in y per unit of x), the intercept, R^2 (proportion of y's variance explained by x), and a significance test + confidence interval for the slope (H0: slope=0). Use pearson_correlation instead if you only need the strength of a linear association, not its actual units/magnitude.
Inputs: x (required), y (required), alpha.
spearman_correlationARead-onlyIdempotent
Test for a monotonic association between two paired variables, via the Pearson correlation of their ranks -- doesn't assume linearity and is far less sensitive to outliers' exact magnitude than pearson_correlation. Same return shape as pearson_correlation (statistic is rho itself, in [-1, 1]).
Inputs: x (required), y (required), alpha.
two_proportion_z_testARead-onlyIdempotent
Test whether two independent proportions differ -- the standard test behind comparing conversion rates between two groups (e.g. an A/B test). Returns the z-statistic, two-tailed p-value, a confidence interval for the difference in proportions, a citation, and warnings.
Inputs: n1 (required), n2 (required), successes1 (required), successes2 (required), +1 more.
two_sample_t_testARead-onlyIdempotent
Test whether two independent samples have different means. Defaults to Welch's t-test (does not assume equal variances); pass equal_var=true for the classic pooled-variance test.
Inputs: a (required), b (required), alpha, equal_var.
wilcoxon_signed_rankARead-onlyIdempotent
The non-parametric alternative to paired_t_test -- use when that test's own small-n warning makes a normal-theory result suspect. Tests whether the median of the paired differences is zero, by ranking the absolute differences rather than assuming they're normally distributed. Pairs with a zero difference are dropped (and counted in a warning), the standard procedure. statistic is T = min(W+, W-).
Inputs: a (required), b (required), alpha.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
TDQS
Scored across 37 tools
Every tool targets a distinct statistical procedure or design (e.g., paired vs. independent proportions, fixed-sample vs. sequential means, chi-square vs. exact test), and the descriptions explicitly cross-reference sibling tools to prevent misselection. Even the paired power/sample-size tools are clearly differentiated as inverse operations.
All tool names use consistent snake_case and follow a predictable pattern: tests are named after the procedure (e.g., two_sample_t_test, mann_whitney_u), effect sizes after the statistic, and power/sample-size tools share the power_for_/sample_size_for_ prefix. The few non-test utilities (recommend_test, naive_peeking_inflation) are still stylistically consistent.
37 tools is well beyond the 25+ threshold for a heavy surface, even though each tool is individually useful. The inclusion of recommend_test and pairwise_group_comparisons mitigates the burden, but the set would benefit from consolidation or a more focused scope.
The suite covers the common lifecycle of a statistical analysis: assumption checks, parametric/nonparametric tests, effect sizes, power/sample-size planning, multiple-comparison corrections, and pairwise follow-ups. Minor gaps remain, such as no power/sample-size calculations for ANOVA or chi-square and no explicit normality test, but agents can work around these.
Maintenance
Related MCP Connectors
Exact statistics & probability: distributions, hypothesis tests, CIs, Bayesian updates, regression.
Valid and reliable data engineering and statistical analysis without hallucinations.
Verify before you cite: URL checks, quotes, page-to-Markdown, metadata, schema, links, archives.
111A statistical analyst in your AI chat: bring data and a question, get a citable, re-runnable report.
Related MCP Servers
- FlicenseNot gradedqualityDmaintenanceEnables comprehensive statistical analysis including descriptive statistics, hypothesis testing, regression, and more via a FastMCP-based API.3-
- AlicenseAqualityCmaintenanceEval-integrity statistics for AI benchmark claims — multiple-testing correction, power/MDE for model gaps, judge-bias and leaderboard-rank checks. Catches a benchmark number that won't survive a second look.9MIT
- AlicenseAqualityBmaintenanceEnables AI assistants to run verified statistical and analytics computations—including hypothesis tests, A/B testing, descriptive summaries, and sample-size planning—directly on local CSV, TSV, Excel, and Parquet files of any size. Results include effect sizes, confidence intervals, plain-English interpretations, and assumption warnings, with optional independent checks.2373 npmMIT
- AlicenseAqualityBmaintenanceEnables MCP clients and AI agents to compute sample sizes and statistical power for the G*Power t-test family through six tools — listing and describing tests, running power analyses, computing effect sizes, generating power curves, and reporting engine provenance — with every result returned as the engine's verbatim JSON.6MIT