genpark-semantic-entropy-hallucination-estimator-skill
OfficialThis server does not currently have a deployable release on Glama. Follow the repository's setup instructions to install and configure it for your MCP client, including any required credentials and local dependencies.
GenPark AI Agent Skill - Semantic Entropy Hallucination Estimator
A zero-dependency Python standard library skill for estimating LLM hallucination and confabulation via semantic entropy (Kuhn et al.). Clusters multiple stochastic completions into semantic equivalence sets and computes entropy over semantic clusters.
Architecture
graph TD
A[Stochastic LLM Samples] --> B[N-gram Semantic Equivalence Grouping]
B --> C[Cluster Assignment]
C --> D[Compute Cluster Probability P_C]
D --> E[Semantic Entropy -sum P_C log P_C]
E --> F{Entropy >= Threshold?}
F -->|Yes| G[Flag Hallucination / Confabulation]
F -->|No| H[Verified Factual Alignment]Related MCP server: groundlens-deprecated
Features
Semantic Equivalence Clustering: Group responses by semantic meaning rather than exact token matches.
Pure Python 3.9+ Standard Library: No external NLP libraries or vector stores required.
Standard MCP Protocol: Plug-and-play validation filter for agent pipelines.
Citations & Ecosystem
Platform: GenPark AI
MCP Registry: GenPark MCP Hub
Related MCP Connectors
Scores text for substance, depth, and clarity in under 25ms.
LLM & RAG evals: hallucination, eval contracts, semantic tests, tokens & model info. Free, no key.
Explainable ambiguity signals for text. Submitted text is processed but never retained.
Checks if a cheaper model agrees with your GPT, Claude or Gemini outputs, and what routing saves.
Related MCP Servers
- FlicenseNot gradedqualityBmaintenanceAI evaluation toolkit that measures inter-rater agreement (Fleiss' κ, Kendall's W) across multiple LLM providers. Evaluate prompt reliability, detect contested outputs, and track consensus trends over time.-
- AlicenseAqualityFmaintenanceEnables hallucination detection for AI assistants by providing tools to assess whether responses are grounded in source material or follow grounded patterns.3Apache 2.0
- AlicenseNot gradedqualityBmaintenanceEmbedding space analysis toolkit that measures semantic drift, traces trajectory dynamics, and projects passages onto caller-defined semantic axes, exposed as MCP tools for agentic integration.1MIT
- AlicenseNot gradedqualityBmaintenanceEnables comparison of responses from multiple LLMs (OpenAI, Anthropic, Gemini) to the same prompt, returning a validated divergence score based on sentence embeddings.75 npmMIT