genpark-semantic-entropy-hallucination-estimator-skill
OfficialThis server does not currently have a deployable release on Glama. Follow the repository's setup instructions to install and configure it for your MCP client, including any required credentials and local dependencies.
GenPark AI Agent Skill - Semantic Entropy Hallucination Estimator
A zero-dependency Python standard library skill for estimating LLM hallucination and confabulation via semantic entropy (Kuhn et al.). Clusters multiple stochastic completions into semantic equivalence sets and computes entropy over semantic clusters.
Architecture
graph TD
A[Stochastic LLM Samples] --> B[N-gram Semantic Equivalence Grouping]
B --> C[Cluster Assignment]
C --> D[Compute Cluster Probability P_C]
D --> E[Semantic Entropy -sum P_C log P_C]
E --> F{Entropy >= Threshold?}
F -->|Yes| G[Flag Hallucination / Confabulation]
F -->|No| H[Verified Factual Alignment]Related MCP server: groundlens-deprecated
Features
Semantic Equivalence Clustering: Group responses by semantic meaning rather than exact token matches.
Pure Python 3.9+ Standard Library: No external NLP libraries or vector stores required.
Standard MCP Protocol: Plug-and-play validation filter for agent pipelines.
Citations & Ecosystem
Platform: GenPark AI
MCP Registry: GenPark MCP Hub
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
Related MCP Connectors
Scores text for substance, depth, and clarity in under 25ms.
LLM & RAG evals: hallucination, eval contracts, semantic tests, tokens & model info. Free, no key.
Explainable ambiguity signals for text. Submitted text is processed but never retained.
Checks if a cheaper model agrees with your GPT, Claude or Gemini outputs, and what routing saves.
Related MCP Servers
- FlicenseNot gradedqualityCmaintenanceAI evaluation toolkit that measures inter-rater agreement (Fleiss' κ, Kendall's W) across multiple LLM providers. Evaluate prompt reliability, detect contested outputs, and track consensus trends over time.-
- AlicenseAqualityFmaintenanceEnables hallucination detection for AI assistants by providing tools to assess whether responses are grounded in source material or follow grounded patterns.3Apache 2.0
- AlicenseNot gradedqualityBmaintenanceEnables comparison of responses from multiple LLMs (OpenAI, Anthropic, Gemini) to the same prompt, returning a validated divergence score based on sentence embeddings.75 npmMIT
- AlicenseNot gradedqualityBmaintenanceReal-time conversation health monitor for AI agents that tracks structural dynamics like semantic drift and information gain using deterministic arithmetic, without calling an LLM.335 PyPIMIT