mcp-ai-accountability
Sends reliability alerts and audit report notifications to Slack channels.
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@mcp-ai-accountability Check my reliability score for the last 24 hours and tell me the top 3 problems."
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
mcp-ai-accountability
Make your AI agents trustworthy and accountable.
This is a production-ready Model Context Protocol (MCP) server that helps AI agents (and the entrepreneurs who build them) measure, track, score, and improve reliability.
Why this exists
AI agents fail silently every day.
Tool calls time out. Schemas drift. Hallucinations happen.
Entrepreneurs lose money and trust because they cannot see why their agent is unreliable.
This MCP server turns reliability into a first-class tool that any agent can call.
Related MCP server: intent-engineering
What it does (simple language)
Imagine your AI agent is a delivery boy.
Sometimes he delivers the package late or to the wrong house.
This server is like a scorecard + GPS tracker + coach that:
Records every delivery (tool call)
Gives a reliability score (0-100)
Tells you why things went wrong
Suggests how to make the agent better next time
Perfect for founders who want accountable AI products.
Main Tools
Tool | What it does |
| Log a tool call result (success/fail + details) |
| Get current score for an agent or session |
| Find patterns in failures |
| Get concrete suggestions to improve reliability |
| Full report for compliance / investors |
| Ping another MCP server and check if it is healthy |
| Track full agent runs |
Quick Start
# Install
pip install mcp-ai-accountability
# Or run from source
uv sync
uv run python -m src.serverAdd to your Claude / Cursor / any MCP client:
{
"mcpServers": {
"ai-accountability": {
"command": "uv",
"args": ["run", "python", "-m", "src.server"],
"env": {
"RELIABILITY_DB": "./reliability.db"
}
}
}
}For Entrepreneurs (non-developers)
You do not need to write code.
Just connect this MCP to your existing AI agent (Claude Desktop, Cursor, etc.).
Then ask your agent:
"Check my reliability score for the last 24 hours and tell me the top 3 problems."
The agent will use the tools automatically and give you a clear report.
Pricing Suggestion
Free tier: 1,000 interactions / month
Pro: $29/month – unlimited + audit reports + Slack alerts
Enterprise: custom (SSO + private hosting)
License
MIT
Built daily by the Prevalid team for the AI agent ecosystem.
Available Tools
8 toolsanalyze_failuresA
Find the most common failure patterns for an agent. Returns the tools that fail most often and sample error messages.
Inputs: agent_id (required), hours, limit.
check_mcp_healthA
Simple health check against another MCP server (HTTP transport). Useful for multi-agent systems that depend on other MCP servers.
Inputs: server_url.
end_sessionB
End a tracking session and get a quick summary.
Inputs: session_id (required).
generate_audit_reportC
Generate a full audit-style report useful for investors, compliance or internal reviews.
Inputs: agent_id (required), hours.
get_reliability_scoreA
Get the current reliability score (0-100) for an agent. Score = percentage of successful tool calls in the last N hours.
Inputs: agent_id (required), hours.
recommend_improvementsC
Give concrete, actionable recommendations to improve reliability. Based on real failure data.
Inputs: agent_id (required), hours.
record_interactionB
Log one tool-call result. Call this after every important tool use so reliability can be measured.
Inputs: success (required), agent_id (required), tool_name (required), metadata, +3 more.
start_sessionA
Start a new tracking session for an agent. Call this at the beginning of a multi-step agent run. Returns a session_id that you should pass to later tools.
Inputs: agent_id (required).
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
TDQS
Scored across 8 tools
Each tool targets a distinct activity: session lifecycle (start/end), logging interactions, score retrieval, failure analysis, improvement recommendations, audit reports, and external health checks. No two tools overlap in a way that would cause confusion for an agent.
All tools follow a consistent verb_noun pattern in snake_case: start_session, end_session, record_interaction, get_reliability_score, analyze_failures, recommend_improvements, generate_audit_report, check_mcp_health. The naming is predictable and uniform.
8 tools is well-scoped for an accountability/reliability tracking server. Each tool covers a distinct part of the workflow (session management, interaction logging, scoring, analysis, recommendations, reporting, health checks) without redundancy or bloat.
The core lifecycle is covered: session start/end, interaction logging, reliability scoring, failure analysis, recommendations, and audit reports. Minor gaps exist such as session history or detailed interaction listing, but the existing tools form a complete workflow for the stated purpose.
Maintenance
Related MCP Connectors
MCP server for building and testing AI agents with multi-model experimentation and insights.
MCP server for your apps' tools and custom tools, plus hosted AI agents and approval-gated workflows
Analytics for MCP servers. Find out which of your tools agents get wrong. MCPulse shows you which tools AI agents retry, which come back empty, and which they never call at all. Two lines inside your own server. It never sees your arguments or your results. getmcpulse.com
MCP server providing access to the Scorecard API to evaluate and optimize LLM systems.
Related MCP Servers
- AlicenseAqualityFmaintenanceAn MCP server that provides cost and reliability observability for LLM and agent workflows. It records model calls and allows querying and aggregating telemetry data through MCP tools.6MIT
- AlicenseAqualityDmaintenanceAn MCP server that exposes three tools for auditing, scaffolding, and triaging agent intent specs against a unified template, helping prevent intent failures in AI agents.359 npmMIT
- AlicenseNot gradedqualityDmaintenanceMCP server that analyzes AI agent execution logs to calculate reliability scores, detect failure patterns, and suggest concrete improvements for making AI agents more reliable.MIT
- AlicenseAqualityDmaintenanceMCP server that provides structured audit logging for AI agent repair tasks via tools to start, record, end, query, and export event traces, with JSONL persistence and SDK integration.58 npmMIT