Skip to main content
Glama
nipunkhanderia

golden-dataset-mcp

Server Configuration

Describes the environment variables required to run the server.

NameRequiredDescriptionDefault

No arguments

Capabilities

Features and capabilities supported by this server

CapabilityDetails
tools
{
  "listChanged": true
}
logging
{}
prompts
{
  "listChanged": false
}
resources
{
  "subscribe": false,
  "listChanged": false
}
extensions
{
  "io.modelcontextprotocol/ui": {}
}
experimental
{}

Tools

Functions exposed to the LLM to take actions

NameDescription
init_datasetA

Initialise a new version-controlled golden dataset at dataset_path.

Creates a .golden_dataset/ directory there. Fails if one already exists at that path — delete .golden_dataset/ manually to start fresh.

add_entryA

Add a question-answer pair to the working tree of a golden dataset.

Entries added here are NOT yet versioned — call commit_version to snapshot them. dataset_path must already be initialised.

update_entryA

Update fields of an existing working-tree entry by its id.

Only fields you provide are changed; omitted fields are left as-is. Raises an error if entry_id is not found in the working tree.

delete_entryA

Remove an entry from the working tree by its id. Does not affect already-committed versions.

list_entriesA

List entries in a dataset. Omit version to see the uncommitted working tree; pass a version (e.g. '1.0') to see a committed snapshot.

commit_versionB

Snapshot the current working tree as a new immutable dataset version.

Versions auto-increment (1.0 -> 1.1 -> 1.2...). Fails if the working tree is empty.

diff_versionsB

Show entries added, removed, or changed between two committed versions.

evaluate_answersA

Score actual LLM/RAG-generated answers against the golden dataset using TF-IDF cosine similarity (no LLM call, no API key needed).

actual_answers must be supplied in the same order as the entries in the target version. Omit version to evaluate against the current committed version.

dataset_statusB

Show the current state of a golden dataset: name, current version, and working tree size.

Prompts

Interactive templates invoked by user choice

NameDescription

No prompts

Resources

Contextual data attached and managed by the client

NameDescription

No resources

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/nipunkhanderia/golden-dataset-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server