xai-toolkit
Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||
Instructions
Guidance the server publishes about itself, which clients place ahead of the tool catalog so the model reads it before choosing anything.
This server publishes no instructions, or was last inspected before Glama recorded them.
Capabilities
Features and capabilities supported by this server
Protocol revision2025-11-25
| Capability | Details |
|---|---|
| tools | {
"listChanged": false
} |
| prompts | {
"listChanged": false
} |
| resources | {
"subscribe": false,
"listChanged": false
} |
| experimental | {} |
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
| explain_predictionA | Explain why a single sample received its classification. |
| explain_prediction_waterfallA | Show a SHAP waterfall plot for a single prediction. |
| summarize_modelA | Summarize what a model does and what drives its decisions. |
| compare_featuresB | Rank features by importance and describe which matter most. |
| get_partial_dependenceA | Show how a single feature affects predictions across its range. |
| list_modelsA | List all registered models with their metadata. Returns model IDs, types, dataset names, feature counts, and accuracy. Use this to discover what models are available before asking questions. |
| describe_datasetA | Describe the dataset associated with a model. |
| compare_predictionsA | Compare what two models predict for the same sample and explain why. |
| detect_driftA | Detect data drift between a model's training data and test data. |
| detect_feature_driftB | Detect drift for a single feature between training and test data. |
| list_drift_alertsA | Browse batch drift findings across features and models. |
| list_explained_samplesA | Browse which samples have precomputed explanations. |
| standard_briefingA | Generate a concise, predefined briefing from persisted batch results. |
| retrieve_business_contextA | Retrieve relevant business context from the knowledge base. |
| get_xai_methodologyA | Retrieve the XAI analysis methodology guide. Call this BEFORE starting any model explanation to understand the correct tool sequence (explanation funnel), Glass Floor protocol, and anti-patterns to avoid. Returns the full workflow guide. |
| list_skillsB | List available versioned context skills and guardrail metadata. |
| get_glass_floorA | Retrieve the Glass Floor separation principles for presenting model explanations alongside business context. Call this when you need to present both deterministic model outputs and AI-interpreted business guidance. Returns the two-layer separation protocol. |
| get_skillC | Retrieve one skill by id/version with guardrails and checksum. |
| record_feedbackA | Record expert feedback on a toolkit narrative. |
| get_taste_contextA | Retrieve organizational taste — what experts think good explanations look like. |
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
| xai_methodology | The XAI analysis methodology — explanation funnel, Glass Floor, anti-patterns. |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |
TDQS
Scored across 20 tools
Most tools have distinct purposes, but some overlap exists between explain_prediction and explain_prediction_waterfall (both explain individual predictions using SHAP), and between detect_drift and detect_feature_drift (both detect drift, with one being a subset of the other). The descriptions clarify the differences, but an agent might occasionally misselect between these pairs.
Tool names follow a consistent snake_case pattern throughout, with clear verb_noun structures (e.g., compare_features, describe_dataset, detect_drift). There are no deviations in naming conventions, making the set predictable and easy to parse.
With 20 tools, the count is slightly high but reasonable for a comprehensive XAI toolkit covering explanation, drift detection, feedback, and context retrieval. It feels slightly heavy but not overwhelming, as each tool appears to serve a specific function in the domain.
The toolset provides complete coverage for the XAI domain, including model listing, prediction explanation, drift detection, feedback recording, and business context integration. There are no obvious gaps; it supports a full workflow from model discovery to explanation and evaluation.