golden-dataset-mcp
Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||
Capabilities
Features and capabilities supported by this server
| Capability | Details |
|---|---|
| tools | {
"listChanged": true
} |
| logging | {} |
| prompts | {
"listChanged": false
} |
| resources | {
"subscribe": false,
"listChanged": false
} |
| extensions | {
"io.modelcontextprotocol/ui": {}
} |
| experimental | {} |
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
| init_datasetA | Initialise a new version-controlled golden dataset at dataset_path. Creates a .golden_dataset/ directory there. Fails if one already exists at that path — delete .golden_dataset/ manually to start fresh. |
| add_entryA | Add a question-answer pair to the working tree of a golden dataset. Entries added here are NOT yet versioned — call commit_version to snapshot them. dataset_path must already be initialised. |
| update_entryA | Update fields of an existing working-tree entry by its id. Only fields you provide are changed; omitted fields are left as-is. Raises an error if entry_id is not found in the working tree. |
| delete_entryA | Remove an entry from the working tree by its id. Does not affect already-committed versions. |
| list_entriesA | List entries in a dataset. Omit version to see the uncommitted working tree; pass a version (e.g. '1.0') to see a committed snapshot. |
| commit_versionB | Snapshot the current working tree as a new immutable dataset version. Versions auto-increment (1.0 -> 1.1 -> 1.2...). Fails if the working tree is empty. |
| diff_versionsB | Show entries added, removed, or changed between two committed versions. |
| evaluate_answersA | Score actual LLM/RAG-generated answers against the golden dataset using TF-IDF cosine similarity (no LLM call, no API key needed). actual_answers must be supplied in the same order as the entries in
the target version. Omit |
| dataset_statusB | Show the current state of a golden dataset: name, current version, and working tree size. |
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |
Latest Blog Posts
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/nipunkhanderia/golden-dataset-mcp'
If you have feedback or need assistance with the MCP directory API, please join our Discord server