truthgate
This server does not currently have a deployable release on Glama. Follow the repository's setup instructions to install and configure it for your MCP client, including any required credentials and local dependencies.
TruthGate (codesphere-u/truthgate)
Deterministic Agent Hallucination Auditor, Citation-Span Entailment Verifier & Workspace Symbol Grounding Engine (with MCP Server)
Why TruthGate?
Even when AI agents use RAG (cortex-mcp, auralis-local) or codebase search tools, they frequently produce subtle, high-severity hallucinations:
Phantom Citations & Unsupported Claims (
TG001,TG002): The agent appends[doc_99]to a claim or attributes a fabricated statement to[sec_policy].Negation & Antonym Polarity Flip (
TG003): The source says "TLS 1.0 is not permitted in production", and the agent summarizes "TLS 1.0 is permitted in production [sec_policy]".Numeric, Percentage & Currency Drift (
TG004): The tool output reportslatency = 42.8 msorUGX 1,250,000, and the agent writes4.28 msorUGX 125,000.Hallucinated Code Symbols, File Paths & Line Ranges (
TG006–TG008): Coding agents reference[src/auth/jwt.py#L120-L150]whenjwt.pyonly has 24 lines, or callverify_token_v2()when the function does not exist in the workspace AST.Expensive LLM-as-a-Judge: Calling a second frontier LLM to audit every response adds 3 seconds of latency and doubles API spend. TruthGate provides a sub-millisecond (
0.12 msP50), zero-dependency deterministic verification gate that catches citation mismatches, polarity inversions, numeric drift, and phantom workspace references—and compiles a surgical self-correction prompt when a check fails.
Related MCP server: flameox
Architecture
flowchart LR
Resp["Agent Markdown Response"] --> Decomp["ClaimDecomposer\n(Atomic Claims, Citations,\nNumbers, Negations, CodeRefs)"]
Decomp --> Entail["CitationEntailmentVerifier\n(Rules TG001–TG005)"]
Decomp --> Ground["WorkspaceSymbolGrounder\n(Rules TG006–TG008)"]
Docs[("SourceDocument Corpus")] --> Entail
AST[("Workspace Files & AST")] --> Ground
Entail --> Gate{"Verification\nPassed?"}
Ground --> Gate
Gate -- "True" --> Pass["Deliver Grounded Response"]
Gate -- "False" --> Repair["SurgicalRepairCompiler\n(Self-Correction Prompt)"]Deterministic Verification Rules (TG001–TG008)
Rule Code | Name | Category | Verdict Status | Severity | Deterministic Check |
| Phantom Source Citation | Entailment |
|
| Claim cites a |
| Low Lexical/Entity Support | Entailment |
|
| IDF-weighted stem and technical-entity overlap between claim and cited source falls below threshold. |
| Negation Polarity Inversion | Entailment |
|
| High entity overlap with a source sentence, but opposite negation or antonym polarity ( |
| Numeric & Magnitude Drift | Entailment |
|
| Claim introduces a number, percentage, or currency ( |
| Uncited Factual Assertion | Entailment |
|
| Factual or numeric proposition in strict-grounding mode lacks any supporting |
| Non-Existent File Path | Workspace Grounding |
|
| Referenced file path ( |
| Out-of-Bounds Line Range | Workspace Grounding |
|
| Referenced line range ( |
| Phantom Code Symbol | Workspace Grounding |
|
| Referenced function, class, or method ( |
Verified Benchmark Results (40-Scenario Suite)
Reproduce locally via truthgate benchmark:
Metric | Verified Value | Notes |
Total Scenarios | 40 | 10 Grounded Truthful + 30 Adversarial Hallucinations ( |
Precision | 100.0% |
|
Recall | 100.0% |
|
False Positive Rate (FPR) | 0.0% |
|
Exact Rule Code Accuracy | 100.0% |
|
P50 Verification Latency | 0.12 ms | Sub-millisecond deterministic execution |
P95 Verification Latency | 0.37 ms |
|
Quickstart
Installation
git clone https://github.com/codesphere-u/truthgate.git
cd truthgate
python3 -m pip install -e ".[dev]"Run the End-to-End Audit & Self-Correction Demo
truthgate demoOutput excerpt:
[Audit Summary] Passed: False | Score: 0.25 | Claims: 1/4 supported | Latency: 1.207 ms
[Claim-by-Claim Verdicts]
- [FAIL:TG003] (CONTRADICTED) TLS 1.0 is permitted in production environments [sec_policy].
- [FAIL:TG004] (NUMERIC_DRIFT) The P95 gateway routing latency is 4.28 ms across East Africa edge nodes [sla_metrics].
- [PASS] (SUPPORTED) Daily instant settlement volume is capped at UGX 1,250,000 for Tier-1 merchant accounts [fin_ledger].
- [FAIL:TG008] (BROKEN_CODE_REF) In `src/auth/jwt.py`, call `verify_token_v2()` to validate bearer tokens.
[Compiled Surgical Self-Correction Prompt]
------------------------------------------------------------------------------------
[TRUTHGATE VERIFICATION FAILED — 3 violation(s) detected: TG003, TG004, TG008]
Rewrite your response to fix ONLY the following deterministic verification failures:
1. [TG003 (Negation Polarity Inversion)] Offending statement: "TLS 1.0 is permitted in production environments [sec_policy]."
- Ground-Truth Evidence: "TLS 1.0 is not permitted in production environments."
...Python SDK Usage
from truthgate import SourceDocument, TruthGateVerifier
sources = [
SourceDocument(
source_id="sec_policy",
title="Production TLS Policy",
content="TLS 1.0 is not permitted in production environments.",
),
SourceDocument(
source_id="sla_metrics",
title="Gateway Telemetry",
content="The P95 gateway routing latency is 42.8 ms across East Africa edge nodes.",
),
]
verifier = TruthGateVerifier()
result = verifier.verify(
response_text=(
"TLS 1.0 is permitted in production environments [sec_policy]. "
"The P95 gateway routing latency is 4.28 ms across East Africa edge nodes [sla_metrics]."
),
sources=sources,
)
print("Passed:", result.passed)
print("Violations:", result.violation_counts) # {'TG003': 1, 'TG004': 1}
print(result.repair_prompt)CLI Reference
# 1. Run end-to-end hallucination audit & repair prompt demo
truthgate demo
# 2. Run the 40-scenario benchmark suite (human-readable or JSON)
truthgate benchmark
truthgate benchmark --json
# 3. List all 8 deterministic verification rules (TG001-TG008)
truthgate rules
# 4. Verify an agent response against a JSON sources file and workspace directory
truthgate verify \
--response "TLS 1.0 is not permitted in production environments [sec_policy]." \
--sources-json sources.json \
--workspace . \
--fail-on-violation
# 5. Ground workspace file paths, #Lstart-Lend line ranges, and AST symbols
truthgate ground \
--response "See [models.py](truthgate/models.py#L1-L40) and \`TruthGateVerifier\`." \
--workspace .
# 6. Start the JSON-RPC 2.0 Stdio MCP server
truthgate mcpMCP Server Integration
Add truthgate to your Claude Desktop, Cursor, or Antigravity mcp_config.json:
{
"mcpServers": {
"truthgate": {
"command": "truthgate",
"args": ["mcp"]
}
}
}Exposed MCP Tools
truthgate_verify_response: Verifies an agent response against source documents and an optional workspace directory, returning claim-by-claim verdicts and a surgical repair prompt.truthgate_ground_workspace_refs: Verifies all file paths,#Lstart-Lendline ranges, and AST symbols referenced in markdown text against a workspace directory.truthgate_list_rules: Lists all 8 deterministic verification rules (TG001–TG008).truthgate_run_benchmark: Runs the reproducible 40-scenario benchmark suite.
Part of the Codesphere Agentic Infrastructure Stack
Built by Akandwanaho Ivan Alvin (@codesphere-u), Founder & MD of Codesphere Innovations (U) Limited in Kampala, Uganda:
codesphere-u/cortex-mcp— Hybrid BM25 + Vector Persistent Memory & Context Compression MCP Servercodesphere-u/agentshield— Zero-Trust Runtime Security Firewall & Prompt-Injection Guardrail for AI Agentscodesphere-u/agentflight— Deterministic Black-Box Flight Recorder & Replay Debugger for AI Agentscodesphere-u/synapse-router— Latency/Cost-Aware Multi-Model Semantic Router & Circuit Breakercodesphere-u/patchpilot— Autonomous Code Repair Engine & Anti-Reward-Hacking Patch Verifiercodesphere-u/truthgate— Deterministic Agent Hallucination Auditor, Citation-Span Entailment Verifier & Workspace Symbol Grounding Engine
License
MIT License — see LICENSE.
This server cannot be deployed
Maintenance
Related MCP Connectors
MCP gateway with runtime security policy, tool-call-level control, and audit of agent actions.
Governed MCP: agent audit, provenance, deterministic checks, and receipt-backed FragGate execution.
MCP-native AI evaluation: rubric audits, eval suites, and proof reports for AI/LLM output.
Compliance frameworks (SOC 2, ISO 27001, CMMC, NIST, more) delivered to AI agents as MCP tools.
Related MCP Servers
- AlicenseNot gradedqualityCmaintenanceProvides deterministic AST graph queries and rule validation for AI coding agents via MCP tools, enabling structural intelligence without LLM calls.3 npmMIT
- AlicenseCqualityBmaintenanceEnables coding agents to query, compare, and audit local profiler traces, benchmarks, memory captures, and execution evidence without uploading code or data, using CLI and MCP interfaces.11188 PyPI232MIT
- AlicenseNot gradedqualityCmaintenanceEnables AI coding agents and hosts to enforce deterministic repository boundaries via MCP, providing structured reads, supervised edits, snapshots, audits, and recovery with machine-readable evidence.MIT
- FlicenseNot gradedqualityBmaintenanceEnables reproducible evaluation of AI coding agents by exposing repository inspection, code editing, test running, and deterministic verification through MCP tools.-