A
licenseNot graded
qualityC
maintenanceEnables AI agents to access observability and evaluation data, including run history, span traces, LLM-as-judge evaluation results, and regression reports.
MIT
Shepherd MCP
by neuralis-in
Related Servers
Alternatives to Shepherd MCP
No user-submitted related servers found.
Related Servers
- FlicenseAqualityBmaintenanceEnables monitoring and analysis of agent goal achievement and failures across sessions, repos, and tools, with detailed views and tracing.3-
- FlicenseAqualityFmaintenanceEnables AI assistants to query local ChatLab chat history using natural language, with tools for session listing, message retrieval, and analytics.1713 npm-
- AlicenseAqualityAmaintenanceConnects AI assistants to OpenTelemetry trace backends such as Jaeger, Tempo, Traceloop, and Datadog, enabling natural-language searching of traces and spans, error discovery, and service listing. It also provides LLM-specific analytics, including token usage aggregation, model performance comparison, and identification of the most expensive or slowest traces.19177 PyPIApache 2.0
- AlicenseNot gradedqualityDmaintenanceEnables natural language querying and analysis of OpenTelemetry traces, metrics, and logs stored in Elasticsearch/OpenSearch, allowing AI assistants to investigate performance issues, find root causes, and explore system behavior.9 npm14MIT
- AlicenseAqualityCmaintenanceConnects AI assistants to Warpmetrics telemetry data to monitor AI agent performance, execution runs, and LLM costs. It allows users to query success rates, latency, and spend metrics directly through natural language interfaces.2095 npmMIT
TDQS
B3.1/5.0
Scored across 18 tools
Disambiguation3/5
The tools are organized into two clear domains (AIOBS and Langfuse), but within each domain there is significant overlap. For example, aiobs_list_sessions and aiobs_search_sessions both retrieve sessions, with the latter adding filtering, which could cause confusion about which to use. Similarly, langfuse_list_sessions and langfuse_search_sessions serve very similar purposes. The deprecated tools further add redundancy without clear differentiation from their AIOBS counterparts.
Naming Consistency4/5
The naming follows a consistent prefix_verb_noun pattern (e.g., aiobs_diff_sessions, langfuse_get_observation), which is predictable and readable. However, there are minor deviations: some tools use 'list' while others use 'search' for similar operations, and the deprecated tools lack the prefix, breaking full consistency but not severely impacting usability.
Tool Count3/5
With 18 tools, the count is borderline high for the scope, which appears to be monitoring and analyzing AI agent sessions and traces. The inclusion of deprecated tools (6 out of 18) inflates the number unnecessarily, making the set feel heavy and cluttered, though the core functionality is well-represented.
Completeness4/5
The tool set provides comprehensive coverage for querying and analyzing sessions, traces, observations, and scores across two systems (AIOBS and Langfuse), with operations like get, list, search, and diff. Minor gaps might include update or delete operations, but these are likely not needed for the monitoring domain, and agents can work effectively with the provided read-oriented tools.
Maintenance
ActivityInactive
ResponsivenessNo issues