Skip to main content
Glama
FactCheck MCP Toolkit

FactCheck MCP Toolkit

by Orolol

FactCheck MCP Toolkit

Serveur MCP pour la verification automatisee de declarations politiques chiffrees, connecte aux APIs statistiques institutionnelles.

Le LLM compatible MCP (ex: Claude Desktop) utilise les outils exposes par ce serveur pour verifier des affirmations factuelles contre les donnees officielles de l'INSEE, Eurostat, la Banque mondiale et l'OCDE.

Fonctionnalites

  • Resolution d'indicateurs — Traduit les termes courants du debat politique ("chomage", "dette publique", "inflation") vers les codes d'indicateurs officiels via une ontologie de 30 entrees avec regles de desambiguisation

  • Donnees INSEE — Recherche, metadonnees et series temporelles depuis le BDM (Banque de donnees macroeconomiques) via pynsee

  • Comparaisons internationales — Donnees Eurostat (UE27), Banque mondiale (217 pays) et OCDE, avec classements par pays

  • Fact-checks existants — Recherche dans les bases Google Fact Check Tools et scoring de check-worthiness via ClaimBuster

  • Detection de cherry-picking — Analyse de robustesse temporelle par perturbation des bornes de dates, avec score de robustesse 0-1

  • Comparaison de valeurs — Ecart absolu/relatif entre valeur declaree et valeur reelle, avec qualification indicative (negligeable/significatif/majeur)

  • Cache persistant — diskcache avec TTL par source (24h INSEE, 12h Eurostat, 7j Banque mondiale, 1h Google FC)

Related MCP server: Poligraph MCP Server

Outils MCP exposes (18)

Module

Outils

Description

resolver

resolve_indicator

Resolution de termes vers codes indicateurs

insee

insee_search_indicators, insee_get_indicator_metadata, insee_get_data, insee_search_geography

Donnees macroeconomiques francaises

eurostat

eurostat_search_datasets, eurostat_get_data, eurostat_get_ranking, eurostat_get_dataset_structure

Donnees europeennes comparatives

worldbank

worldbank_search_indicators, worldbank_get_data, worldbank_get_country_ranking

Donnees mondiales

oecd

oecd_search_datasets, oecd_get_data

Donnees OCDE via SDMX

factcheck

lookup_existing_factchecks, score_check_worthiness

Fact-checks existants + scoring

cherry_picking

analyze_cherry_picking

Detection de cherry-picking temporel

compare

compare_values

Comparaison valeur declaree vs reelle

Prerequis

  • Python 3.12+

  • uv (gestionnaire de paquets)

  • Cles API (optionnelles) : Google Fact Check (Google Cloud Console), ClaimBuster (idir.uta.edu)

Aucune cle API necessaire pour : INSEE BDM, Eurostat, Banque mondiale, OCDE (gratuits et ouverts).

Installation

git clone <repo-url>
cd factcheck-mcp
uv sync

Configuration

Creer un fichier .env a la racine du projet :

GOOGLE_FACTCHECK_API_KEY=votre_cle_google
CLAIMBUSTER_API_KEY=votre_cle_claimbuster
FACTCHECK_CACHE_DIR=~/.cache/factcheck-mcp

Les outils fonctionnent sans cles API (les fonctions Google FC et ClaimBuster retournent des listes vides au lieu de planter).

Integration Claude Desktop

Ajouter dans ~/.config/claude/claude_desktop_config.json :

{
  "mcpServers": {
    "factcheck": {
      "command": "uv",
      "args": ["run", "--directory", "/chemin/vers/factcheck-mcp", "factcheck-mcp"],
      "env": {
        "GOOGLE_FACTCHECK_API_KEY": "votre_cle",
        "CLAIMBUSTER_API_KEY": "votre_cle"
      }
    }
  }
}

Verification

Depuis Claude Desktop, demander :

"Le chomage en France a baisse de 2 points depuis 2020, verifie cette affirmation."

Le LLM invoquera les outils MCP pour :

  1. Chercher des fact-checks existants

  2. Resoudre "chomage" vers le taux de chomage BIT de l'INSEE

  3. Recuperer les donnees reelles

  4. Comparer et produire un rapport avec sources

Developpement

# Lancer les tests unitaires (152 tests)
uv run pytest

# Lancer les tests en mode verbose
uv run pytest -v

# Lancer les tests d'integration (APIs reelles, necessite reseau)
uv run pytest -m integration

# Lancer le serveur en mode standalone (debug)
uv run factcheck-mcp

# Lint et formatage
uv run ruff check src/ tests/
uv run ruff format src/ tests/

Architecture

src/factcheck_mcp/
├── server.py              # Serveur FastMCP, enregistrement des 18 outils
├── tools/                 # Implementations MCP (un module par source)
│   ├── resolver.py        # Resolution d'indicateurs via ontologie YAML
│   ├── insee.py           # 4 outils INSEE (pynsee)
│   ├── eurostat.py        # 4 outils Eurostat
│   ├── worldbank.py       # 3 outils Banque mondiale (wbgapi)
│   ├── oecd.py            # 2 outils OCDE (sdmx1)
│   ├── factcheck.py       # Google Fact Check + ClaimBuster (httpx)
│   ├── cherry_picking.py  # Analyse de robustesse temporelle
│   └── compare.py         # Comparaison de valeurs avec qualification
├── core/                  # Infrastructure partagee
│   ├── models.py          # 12 modeles Pydantic
│   ├── cache.py           # Cache diskcache avec TTL par source
│   ├── config.py          # Configuration pydantic-settings
│   ├── errors.py          # 6 exceptions metier
│   └── retry.py           # Backoff exponentiel pour rate-limiting
└── ontology/              # Donnees statiques
    ├── indicators.yaml    # 30 indicateurs politiques -> codes sources
    └── geographies.yaml   # Noms geographiques -> codes INSEE/ISO

Principes de conception

  • Serveur unique — Un seul processus MCP expose tous les outils

  • Verdict LLM-assiste — Le serveur fournit donnees brutes + metriques, le LLM formule le verdict

  • Fonctions synchrones — fastmcp les execute automatiquement dans un threadpool

  • Degradation gracieuse — Cles API manquantes ou APIs indisponibles ne font pas planter le serveur

  • Zero cout — Toutes les APIs utilisees sont gratuites

Licence

MIT

Available Tools

18 tools
analyze_cherry_pickingC

Analyze whether a claimed time-period variation is cherry-picked.

Args: time_series: TimeSeries as dict (MCP tools receive dicts). claimed_start: Start period of the claimed variation. claimed_end: End period of the claimed variation. claimed_variation: The numeric variation asserted in the claim. claimed_direction: Direction of claim: 'hausse', 'baisse', or 'stable'.

Returns: CherryPickingAnalysis as dict.

Inputs: claimed_end (required), time_series (required), claimed_start (required), claimed_direction (required), +1 more. Returns: object

compare_valuesB

Compare a claimed value to actual data and qualify the deviation.

Args: claimed_value: The value asserted in the claim. actual_value: The value from the data source. claimed_period: The period referenced in the claim. actual_period: The period of the actual data.

Returns: ComparisonResult with deviation metrics and qualification.

Inputs: actual_value (required), actual_period (required), claimed_value (required), claimed_period (required). Returns: Result of comparing a claimed value to actual data.

eurostat_get_dataB

Retrieve Eurostat data and convert to TimeSeries per country.

Args: dataset_code: Eurostat dataset code (e.g. 'nama_10_gdp'). geo: List of country codes (e.g. ['FR', 'DE']). time_period: Optional year filter (e.g. '2022'). filters: Optional additional filters dict.

Returns: List of TimeSeries, one per requested country.

Inputs: geo (required), dataset_code (required), filters, time_period. Returns: result

eurostat_get_dataset_structureA

Get dimension info for a Eurostat dataset.

Args: dataset_code: Eurostat dataset code.

Returns: Dict mapping dimension names to lists of possible values.

Inputs: dataset_code (required). Returns: object

eurostat_get_rankingA

Rank countries by a Eurostat indicator value.

Args: dataset_code: Eurostat dataset code. metric: Metric/na_item code. year: Year to rank on. If None, uses most recent available. geo_scope: Geographic scope filter (unused in basic implementation).

Returns: List of RankingEntry sorted by value descending.

Inputs: metric (required), dataset_code (required), year, geo_scope. Returns: result

eurostat_search_datasetsA

Search Eurostat datasets by keyword.

Args: query: Search keyword. limit: Maximum number of results to return.

Returns: List of dicts with code, title, last_update fields.

Inputs: query (required), limit. Returns: result

insee_get_dataA

Get time series data for an INSEE indicator.

Args: idbank: The INSEE IDBANK identifier. start_period: Optional start period filter (inclusive). end_period: Optional end period filter (inclusive). last_n: Optional limit to last N observations.

Returns: TimeSeries with observations.

Inputs: idbank (required), last_n, end_period, start_period. Returns: Ordered observations for an indicator over time.

insee_get_indicator_metadataA

Get full metadata for an INSEE series by idbank code.

Args: idbank: The INSEE IDBANK identifier.

Returns: IndicatorMetadata with definition, frequency, etc.

Inputs: idbank (required). Returns: Full metadata for a resolved indicator.

insee_search_geographyC

Search INSEE geographic entities.

Args: geo_type: Geographic level (commune, departement, region). name_filter: Optional name filter.

Returns: List of GeoResult.

Inputs: geo_type (required), name_filter. Returns: result

insee_search_indicatorsA

Search INSEE macrodata indicators by keyword.

Args: keyword: Search pattern for indicator names.

Returns: List of matching IndicatorResult.

Inputs: keyword (required). Returns: result

lookup_existing_factchecksA

Search for existing fact-checks matching a claim.

Args: query: The claim text to search for. language_code: BCP-47 language code (default "fr").

Returns: List of existing fact-checks found, or empty list on error/missing key.

Inputs: query (required), language_code. Returns: result

oecd_get_dataA

Retrieve OECD data and convert to TimeSeries per country.

Args: dataflow: OECD dataflow identifier (e.g. 'QNA'). country: List of country codes (e.g. ['FRA', 'DEU']). time_period: Optional time period filter. filters: Optional additional SDMX filters.

Returns: List of TimeSeries, one per country.

Inputs: country (required), dataflow (required), filters, time_period. Returns: result

oecd_search_datasetsA

Search OECD datasets by keyword.

Args: query: Search keyword. limit: Maximum number of results to return.

Returns: List of dicts with code, title fields.

Inputs: query (required), limit. Returns: result

resolve_indicatorA

Resolve a natural-language term to ranked indicator codes.

Args: term: The indicator term to resolve (e.g. "chomage", "PIB"). context: Optional surrounding text for disambiguation. preferred_source: Optional source preference (insee, eurostat, worldbank, oecd).

Returns: List of IndicatorResult ranked by relevance.

Raises: IndicatorNotFoundError: If no matching indicator is found.

Inputs: term (required), context, preferred_source. Returns: result

score_check_worthinessA

Score sentences in a text for check-worthiness using ClaimBuster.

Args: text: The text containing one or more sentences to score.

Returns: List of dicts with keys: sentence, score, index. Returns empty list on error or missing API key.

Inputs: text (required). Returns: result

worldbank_get_country_rankingA

Rank countries by a World Bank indicator value.

Args: indicator: World Bank indicator code. year: Year to rank on. If None, uses most recent available. income_group: Optional income group filter.

Returns: List of RankingEntry sorted by value descending.

Inputs: indicator (required), year, income_group. Returns: result

worldbank_get_dataA

Retrieve World Bank indicator data for given countries.

Args: indicator: World Bank indicator code (e.g. 'NY.GDP.MKTP.CD'). country: List of ISO3 country codes (e.g. ['FRA', 'DEU']). year_range: Optional year range as 'YYYY:YYYY'. most_recent: Optional number of most recent values to return.

Returns: List of TimeSeries, one per country.

Inputs: country (required), indicator (required), year_range, most_recent. Returns: result

worldbank_search_indicatorsA

Search World Bank indicators by keyword.

Args: query: Search keyword. limit: Maximum number of results to return.

Returns: List of IndicatorResult matching the query.

Inputs: query (required), limit. Returns: result

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

Loading tool schema changelog…

    TDQS

    A3.6/5.0

    Scored across 18 tools

    Disambiguation4/5

    Most tools target a distinct source-action combination (e.g. insee_get_data vs eurostat_get_ranking), and the fact-checking utilities are clearly separated. Some overlap exists between resolve_indicator and source-specific search functions, and between compare_values and analyze_cherry_picking, but the descriptions are sufficient to disambiguate.

    Naming Consistency4/5

    The dominant naming pattern is source_verb_noun (insee_search_indicators, worldbank_get_data), and generic tools use verb_noun as well. Minor deviations like eurostat_get_ranking vs worldbank_get_country_ranking and lookup_existing_factchecks instead of search_... prevent a perfect score.

    Tool Count4/5

    18 tools is slightly above the typical 5-15 sweet spot, but the count is justified by four external data providers and the fact-checking workflow endpoints. Each provider needs search/get/ranking tools, so the set does not feel bloated.

    Completeness4/5

    The toolkit covers the core fact-checking pipeline: check-worthiness scoring, existing lookup, indicator resolution, data retrieval, value comparison, and cherry-picking detection. Minor gaps include lack of OECD ranking/metadata tools and no way to save or publish fact-checks.

    Maintenance

    ActivityInactive
    ResponsivenessNo recent community issues

    Related MCP Connectors

    Related MCP Servers