Skip to main content
Glama
research-workflow-studio

research-workflow-studio

by BorgDiven

rws_evaluation_import

Idempotent

Validate and register existing typed evaluation results with fixed protocol, code, and input versions; does not compute metrics.

Instructions

Validate and register existing typed evaluation results with fixed protocol/code/input versions; does not compute metrics.

Tool call template

Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.

{
  "id": 1,
  "jsonrpc": "2.0",
  "method": "tools/call",
  "params": {
    "arguments": {
      "requestId": "<requestId>",
      "projectId": "<projectId>",
      "expectedRevision": "<expectedRevision>",
      "record": "<record>"
    },
    "name": "rws_evaluation_import"
  }
}

Input Schema

NameRequiredDescriptionDefault
recordYes
projectIdYes
requestIdYes
expectedRevisionYes

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed9 schema fields changedv0.4.2
    • changedInput schema / properties / record / properties / codeRef / properties / type / enum
      Previous value: -[
      -  "research",
      -  "experiment",
      -  "code",
      -  "run",
      -  "artifact",
      -  "protocol",
      -  "dataset",
      -  "evaluation",
      -  "comparison",
      -  "analysis",
      -  "report",
      -  "conversation",
      -  "proposal",
      -  "usage",
      -  "spec",
      -  "amendment"
      -]New value: +[
      +  "research",
      +  "experiment",
      +  "code",
      +  "run",
      +  "artifact",
      +  "protocol",
      +  "dataset",
      +  "evaluation",
      +  "comparison",
      +  "analysis",
      +  "report",
      +  "conversation",
      +  "proposal",
      +  "usage",
      +  "spec",
      +  "amendment",
      +  "server",
      +  "repository",
      +  "environment",
      +  "operation"
      +]
    • changedInput schema / properties / record / properties / datasetRef / properties / type / enum
      Previous value: -[
      -  "research",
      -  "experiment",
      -  "code",
      -  "run",
      -  "artifact",
      -  "protocol",
      -  "dataset",
      -  "evaluation",
      -  "comparison",
      -  "analysis",
      -  "report",
      -  "conversation",
      -  "proposal",
      -  "usage",
      -  "spec",
      -  "amendment"
      -]New value: +[
      +  "research",
      +  "experiment",
      +  "code",
      +  "run",
      +  "artifact",
      +  "protocol",
      +  "dataset",
      +  "evaluation",
      +  "comparison",
      +  "analysis",
      +  "report",
      +  "conversation",
      +  "proposal",
      +  "usage",
      +  "spec",
      +  "amendment",
      +  "server",
      +  "repository",
      +  "environment",
      +  "operation"
      +]
    • changedInput schema / properties / record / properties / experimentRef / properties / type / enum
      Previous value: -[
      -  "research",
      -  "experiment",
      -  "code",
      -  "run",
      -  "artifact",
      -  "protocol",
      -  "dataset",
      -  "evaluation",
      -  "comparison",
      -  "analysis",
      -  "report",
      -  "conversation",
      -  "proposal",
      -  "usage",
      -  "spec",
      -  "amendment"
      -]New value: +[
      +  "research",
      +  "experiment",
      +  "code",
      +  "run",
      +  "artifact",
      +  "protocol",
      +  "dataset",
      +  "evaluation",
      +  "comparison",
      +  "analysis",
      +  "report",
      +  "conversation",
      +  "proposal",
      +  "usage",
      +  "spec",
      +  "amendment",
      +  "server",
      +  "repository",
      +  "environment",
      +  "operation"
      +]
    • changedInput schema / properties / record / properties / inputRefs / items / properties / type / enum
      Previous value: -[
      -  "research",
      -  "experiment",
      -  "code",
      -  "run",
      -  "artifact",
      -  "protocol",
      -  "dataset",
      -  "evaluation",
      -  "comparison",
      -  "analysis",
      -  "report",
      -  "conversation",
      -  "proposal",
      -  "usage",
      -  "spec",
      -  "amendment"
      -]New value: +[
      +  "research",
      +  "experiment",
      +  "code",
      +  "run",
      +  "artifact",
      +  "protocol",
      +  "dataset",
      +  "evaluation",
      +  "comparison",
      +  "analysis",
      +  "report",
      +  "conversation",
      +  "proposal",
      +  "usage",
      +  "spec",
      +  "amendment",
      +  "server",
      +  "repository",
      +  "environment",
      +  "operation"
      +]
    • changedInput schema / properties / record / properties / pairs / items / properties / predictionRef / properties / type / enum
      Previous value: -[
      -  "research",
      -  "experiment",
      -  "code",
      -  "run",
      -  "artifact",
      -  "protocol",
      -  "dataset",
      -  "evaluation",
      -  "comparison",
      -  "analysis",
      -  "report",
      -  "conversation",
      -  "proposal",
      -  "usage",
      -  "spec",
      -  "amendment"
      -]New value: +[
      +  "research",
      +  "experiment",
      +  "code",
      +  "run",
      +  "artifact",
      +  "protocol",
      +  "dataset",
      +  "evaluation",
      +  "comparison",
      +  "analysis",
      +  "report",
      +  "conversation",
      +  "proposal",
      +  "usage",
      +  "spec",
      +  "amendment",
      +  "server",
      +  "repository",
      +  "environment",
      +  "operation"
      +]
    • changedInput schema / properties / record / properties / pairs / items / properties / referenceRef / properties / type / enum
      Previous value: -[
      -  "research",
      -  "experiment",
      -  "code",
      -  "run",
      -  "artifact",
      -  "protocol",
      -  "dataset",
      -  "evaluation",
      -  "comparison",
      -  "analysis",
      -  "report",
      -  "conversation",
      -  "proposal",
      -  "usage",
      -  "spec",
      -  "amendment"
      -]New value: +[
      +  "research",
      +  "experiment",
      +  "code",
      +  "run",
      +  "artifact",
      +  "protocol",
      +  "dataset",
      +  "evaluation",
      +  "comparison",
      +  "analysis",
      +  "report",
      +  "conversation",
      +  "proposal",
      +  "usage",
      +  "spec",
      +  "amendment",
      +  "server",
      +  "repository",
      +  "environment",
      +  "operation"
      +]
    • changedInput schema / properties / record / properties / protocolRef / properties / type / enum
      Previous value: -[
      -  "research",
      -  "experiment",
      -  "code",
      -  "run",
      -  "artifact",
      -  "protocol",
      -  "dataset",
      -  "evaluation",
      -  "comparison",
      -  "analysis",
      -  "report",
      -  "conversation",
      -  "proposal",
      -  "usage",
      -  "spec",
      -  "amendment"
      -]New value: +[
      +  "research",
      +  "experiment",
      +  "code",
      +  "run",
      +  "artifact",
      +  "protocol",
      +  "dataset",
      +  "evaluation",
      +  "comparison",
      +  "analysis",
      +  "report",
      +  "conversation",
      +  "proposal",
      +  "usage",
      +  "spec",
      +  "amendment",
      +  "server",
      +  "repository",
      +  "environment",
      +  "operation"
      +]
    • changedInput schema / properties / record / properties / results / items / oneOf
      Previous value: -[
      -  {
      -    "additionalProperties": false,
      -    "anyOf": [
      -      {
      -        "required": [
      -          "name"
      -        ]
      -      },
      -      {
      -        "required": [
      -          "metricId"
      -        ]
      -      }
      -    ],
      -    "properties": {
      -      "aggregation": {
      -        "type": "string"
      -      },
      -      "direction": {
      -        "enum": [
      -          "higher",
      -          "lower",
      -          "higher-is-better",
      -          "lower-is-better",
      -          "none",
      -          "target"
      -        ]
      -      },
      -      "kind": {
      -        "const": "metric"
      -      },
      -      "label": {
      -        "type": "string"
      -      },
      -      "metricId": {
      -        "type": "string"
      -      },
      -      "name": {
      -        "type": "string"
      -      },
      -      "reason": {
      -        "type": "string"
      -      },
      -      "sampleId": {
      -        "type": "string"
      -      },
      -      "sampleIds": {
      -        "items": {
      -          "type": "string"
      -        },
      -        "type": "array",
      -        "uniqueItems": true
      -      },
      -      "sourceRef": {
      -        "additionalProperties": false,
      -        "properties": {
      -          "id": {
      -            "type": "string"
      -          },
      -          "projectId": {
      -            "type": "string"
      -          },
      -          "type": {
      -            "enum": [
      -              "research",
      -              "experiment",
      -              "code",
      -              "run",
      -              "artifact",
      -              "protocol",
      -              "dataset",
      -              "evaluation",
      -              "comparison",
      -              "analysis",
      -              "report",
      -              "conversation",
      -              "proposal",
      -              "usage",
      -              "spec",
      -              "amendment"
      -            ],
      -            "type": "string"
      -          },
      -          "version": {
      -            "minimum": 1,
      -            "type": "integer"
      -          }
      -        },
      -        "required": [
      -          "projectId",
      -          "type",
      -          "id"
      -        ],
      -        "type": "object"
      -      },
      -      "status": {
      -        "enum": [
      -          "completed",
      -          "missing",
      -          "failed",
      -          "undefined"
      -        ]
      -      },
      -      "unit": {
      -        "type": "string"
      -      },
      -      "value": {
      -        "type": [
      -          "number",
      -          "null"
      -        ]
      -      }
      -    },
      -    "required": [
      -      "kind",
      -      "value"
      -    ],
      -    "type": "object"
      -  },
      -  {
      -    "additionalProperties": false,
      -    "anyOf": [
      -      {
      -        "required": [
      -          "xAxis",
      -          "yAxis"
      -        ]
      -      },
      -      {
      -        "required": [
      -          "x",
      -          "y"
      -        ]
      -      }
      -    ],
      -    "properties": {
      -      "kind": {
      -        "const": "series"
      -      },
      -      "label": {
      -        "type": "string"
      -      },
      -      "name": {
      -        "type": "string"
      -      },
      -      "points": {
      -        "items": {
      -          "anyOf": [
      -            {
      -              "additionalProperties": false,
      -              "properties": {
      -                "x": {
      -                  "type": "number"
      -                },
      -                "y": {
      -                  "type": "number"
      -                }
      -              },
      -              "required": [
      -                "x",
      -                "y"
      -              ],
      -              "type": "object"
      -            },
      -            {
      -              "items": {
      -                "type": "number"
      -              },
      -              "maxItems": 2,
      -              "minItems": 2,
      -              "type": "array"
      -            }
      -          ]
      -        },
      -        "type": "array"
      -      },
      -      "sampleId": {
      -        "type": "string"
      -      },
      -      "sourceRef": {
      -        "additionalProperties": false,
      -        "properties": {
      -          "id": {
      -            "type": "string"
      -          },
      -          "projectId": {
      -            "type": "string"
      -          },
      -          "type": {
      -            "enum": [
      -              "research",
      -              "experiment",
      -              "code",
      -              "run",
      -              "artifact",
      -              "protocol",
      -              "dataset",
      -              "evaluation",
      -              "comparison",
      -              "analysis",
      -              "report",
      -              "conversation",
      -              "proposal",
      -              "usage",
      -              "spec",
      -              "amendment"
      -            ],
      -            "type": "string"
      -          },
      -          "version": {
      -            "minimum": 1,
      -            "type": "integer"
      -          }
      -        },
      -        "required": [
      -          "projectId",
      -          "type",
      -          "id"
      -        ],
      -        "type": "object"
      -      },
      -      "x": {
      -        "additionalProperties": false,
      -        "properties": {
      -          "label": {
      -            "minLength": 1,
      -            "type": "string"
      -          },
      -          "unit": {
      -            "type": "string"
      -          }
      -        },
      -        "required": [
      -          "label",
      -          "unit"
      -        ],
      -        "type": "object"
      -      },
      -      "xAxis": {
      -        "additionalProperties": false,
      -        "properties": {
      -          "label": {
      -            "minLength": 1,
      -            "type": "string"
      -          },
      -          "unit": {
      -            "type": "string"
      -          }
      -        },
      -        "required": [
      -          "label",
      -          "unit"
      -        ],
      -        "type": "object"
      -      },
      -      "y": {
      -        "additionalProperties": false,
      -        "properties": {
      -          "label": {
      -            "minLength": 1,
      -            "type": "string"
      -          },
      -          "unit": {
      -            "type": "string"
      -          }
      -        },
      -        "required": [
      -          "label",
      -          "unit"
      -        ],
      -        "type": "object"
      -      },
      -      "yAxis": {
      -        "additionalProperties": false,
      -        "properties": {
      -          "label": {
      -            "minLength": 1,
      -            "type": "string"
      -          },
      -          "unit": {
      -            "type": "string"
      -          }
      -        },
      -        "required": [
      -          "label",
      -          "unit"
      -        ],
      -        "type": "object"
      -      }
      -    },
      -    "required": [
      -      "kind",
      -      "points"
      -    ],
      -    "type": "object"
      -  },
      -  {
      -    "additionalProperties": false,
      -    "properties": {
      -      "items": {
      -        "items": {
      -          "additionalProperties": false,
      -          "anyOf": [
      -            {
      -              "required": [
      -                "artifactRef"
      -              ]
      -            },
      -            {
      -              "required": [
      -                "uri"
      -              ]
      -            }
      -          ],
      -          "properties": {
      -            "artifactRef": {
      -              "additionalProperties": false,
      -              "properties": {
      -                "id": {
      -                  "type": "string"
      -                },
      -                "projectId": {
      -                  "type": "string"
      -                },
      -                "type": {
      -                  "enum": [
      -                    "artifact"
      -                  ],
      -                  "type": "string"
      -                },
      -                "version": {
      -                  "minimum": 1,
      -                  "type": "integer"
      -                }
      -              },
      -              "required": [
      -                "projectId",
      -                "type",
      -                "id"
      -              ],
      -              "type": "object"
      -            },
      -            "caption": {
      -              "type": "string"
      -            },
      -            "config": {
      -              "additionalProperties": true,
      -              "type": "object"
      -            },
      -            "sampleId": {
      -              "type": "string"
      -            },
      -            "uri": {
      -              "type": "string"
      -            }
      -          },
      -          "type": "object"
      -        },
      -        "type": "array"
      -      },
      -      "kind": {
      -        "const": "image-set"
      -      },
      -      "label": {
      -        "type": "string"
      -      },
      -      "name": {
      -        "type": "string"
      -      },
      -      "sampleId": {
      -        "type": "string"
      -      },
      -      "sourceRef": {
      -        "additionalProperties": false,
      -        "properties": {
      -          "id": {
      -            "type": "string"
      -          },
      -          "projectId": {
      -            "type": "string"
      -          },
      -          "type": {
      -            "enum": [
      -              "research",
      -              "experiment",
      -              "code",
      -              "run",
      -              "artifact",
      -              "protocol",
      -              "dataset",
      -              "evaluation",
      -              "comparison",
      -              "analysis",
      -              "report",
      -              "conversation",
      -              "proposal",
      -              "usage",
      -              "spec",
      -              "amendment"
      -            ],
      -            "type": "string"
      -          },
      -          "version": {
      -            "minimum": 1,
      -            "type": "integer"
      -          }
      -        },
      -        "required": [
      -          "projectId",
      -          "type",
      -          "id"
      -        ],
      -        "type": "object"
      -      }
      -    },
      -    "required": [
      -      "kind",
      -      "items"
      -    ],
      -    "type": "object"
      -  },
      -  {
      -    "additionalProperties": false,
      -    "properties": {
      -      "columns": {
      -        "items": {
      -          "additionalProperties": false,
      -          "anyOf": [
      -            {
      -              "required": [
      -                "key"
      -              ]
      -            },
      -            {
      -              "required": [
      -                "name"
      -              ]
      -            }
      -          ],
      -          "properties": {
      -            "key": {
      -              "type": "string"
      -            },
      -            "label": {
      -              "type": "string"
      -            },
      -            "metricId": {
      -              "type": "string"
      -            },
      -            "name": {
      -              "type": "string"
      -            },
      -            "type": {
      -              "enum": [
      -                "string",
      -                "number",
      -                "boolean"
      -              ]
      -            },
      -            "unit": {
      -              "type": "string"
      -            }
      -          },
      -          "required": [
      -            "type"
      -          ],
      -          "type": "object"
      -        },
      -        "type": "array"
      -      },
      -      "kind": {
      -        "const": "table"
      -      },
      -      "label": {
      -        "type": "string"
      -      },
      -      "name": {
      -        "type": "string"
      -      },
      -      "rows": {
      -        "items": {
      -          "additionalProperties": {
      -            "type": [
      -              "string",
      -              "number",
      -              "boolean",
      -              "null"
      -            ]
      -          },
      -          "type": "object"
      -        },
      -        "type": "array"
      -      },
      -      "sampleId": {
      -        "type": "string"
      -      },
      -      "sourceRef": {
      -        "additionalProperties": false,
      -        "properties": {
      -          "id": {
      -            "type": "string"
      -          },
      -          "projectId": {
      -            "type": "string"
      -          },
      -          "type": {
      -            "enum": [
      -              "research",
      -              "experiment",
      -              "code",
      -              "run",
      -              "artifact",
      -              "protocol",
      -              "dataset",
      -              "evaluation",
      -              "comparison",
      -              "analysis",
      -              "report",
      -              "conversation",
      -              "proposal",
      -              "usage",
      -              "spec",
      -              "amendment"
      -            ],
      -            "type": "string"
      -          },
      -          "version": {
      -            "minimum": 1,
      -            "type": "integer"
      -          }
      -        },
      -        "required": [
      -          "projectId",
      -          "type",
      -          "id"
      -        ],
      -        "type": "object"
      -      }
      -    },
      -    "required": [
      -      "kind",
      -      "columns",
      -      "rows"
      -    ],
      -    "type": "object"
      -  },
      -  {
      -    "additionalProperties": false,
      -    "anyOf": [
      -      {
      -        "required": [
      -          "mimeType"
      -        ]
      -      },
      -      {
      -        "required": [
      -          "mediaType"
      -        ]
      -      }
      -    ],
      -    "properties": {
      -      "availability": {
      -        "enum": [
      -          "available",
      -          "unavailable",
      -          "unknown"
      -        ]
      -      },
      -      "description": {
      -        "type": "string"
      -      },
      -      "kind": {
      -        "const": "attachment"
      -      },
      -      "label": {
      -        "type": "string"
      -      },
      -      "mediaType": {
      -        "type": "string"
      -      },
      -      "mimeType": {
      -        "type": "string"
      -      },
      -      "name": {
      -        "type": "string"
      -      },
      -      "sampleId": {
      -        "type": "string"
      -      },
      -      "sourceRef": {
      -        "additionalProperties": false,
      -        "properties": {
      -          "id": {
      -            "type": "string"
      -          },
      -          "projectId": {
      -            "type": "string"
      -          },
      -          "type": {
      -            "enum": [
      -              "research",
      -              "experiment",
      -              "code",
      -              "run",
      -              "artifact",
      -              "protocol",
      -              "dataset",
      -              "evaluation",
      -              "comparison",
      -              "analysis",
      -              "report",
      -              "conversation",
      -              "proposal",
      -              "usage",
      -              "spec",
      -              "amendment"
      -            ],
      -            "type": "string"
      -          },
      -          "version": {
      -            "minimum": 1,
      -            "type": "integer"
      -          }
      -        },
      -        "required": [
      -          "projectId",
      -          "type",
      -          "id"
      -        ],
      -        "type": "object"
      -      },
      -      "uri": {
      -        "type": "string"
      -      }
      -    },
      -    "required": [
      -      "kind",
      -      "uri"
      -    ],
      -    "type": "object"
      -  }
      -]New value: +[
      +  {
      +    "additionalProperties": false,
      +    "anyOf": [
      +      {
      +        "required": [
      +          "name"
      +        ]
      +      },
      +      {
      +        "required": [
      +          "metricId"
      +        ]
      +      }
      +    ],
      +    "properties": {
      +      "aggregation": {
      +        "type": "string"
      +      },
      +      "direction": {
      +        "enum": [
      +          "higher",
      +          "lower",
      +          "higher-is-better",
      +          "lower-is-better",
      +          "none",
      +          "target"
      +        ]
      +      },
      +      "kind": {
      +        "const": "metric"
      +      },
      +      "label": {
      +        "type": "string"
      +      },
      +      "metricId": {
      +        "type": "string"
      +      },
      +      "name": {
      +        "type": "string"
      +      },
      +      "reason": {
      +        "type": "string"
      +      },
      +      "sampleId": {
      +        "type": "string"
      +      },
      +      "sampleIds": {
      +        "items": {
      +          "type": "string"
      +        },
      +        "type": "array",
      +        "uniqueItems": true
      +      },
      +      "sourceRef": {
      +        "additionalProperties": false,
      +        "properties": {
      +          "id": {
      +            "type": "string"
      +          },
      +          "projectId": {
      +            "type": "string"
      +          },
      +          "type": {
      +            "enum": [
      +              "research",
      +              "experiment",
      +              "code",
      +              "run",
      +              "artifact",
      +              "protocol",
      +              "dataset",
      +              "evaluation",
      +              "comparison",
      +              "analysis",
      +              "report",
      +              "conversation",
      +              "proposal",
      +              "usage",
      +              "spec",
      +              "amendment",
      +              "server",
      +              "repository",
      +              "environment",
      +              "operation"
      +            ],
      +            "type": "string"
      +          },
      +          "version": {
      +            "minimum": 1,
      +            "type": "integer"
      +          }
      +        },
      +        "required": [
      +          "projectId",
      +          "type",
      +          "id"
      +        ],
      +        "type": "object"
      +      },
      +      "status": {
      +        "enum": [
      +          "completed",
      +          "missing",
      +          "failed",
      +          "undefined"
      +        ]
      +      },
      +      "unit": {
      +        "type": "string"
      +      },
      +      "value": {
      +        "type": [
      +          "number",
      +          "null"
      +        ]
      +      }
      +    },
      +    "required": [
      +      "kind",
      +      "value"
      +    ],
      +    "type": "object"
      +  },
      +  {
      +    "additionalProperties": false,
      +    "anyOf": [
      +      {
      +        "required": [
      +          "xAxis",
      +          "yAxis"
      +        ]
      +      },
      +      {
      +        "required": [
      +          "x",
      +          "y"
      +        ]
      +      }
      +    ],
      +    "properties": {
      +      "kind": {
      +        "const": "series"
      +      },
      +      "label": {
      +        "type": "string"
      +      },
      +      "name": {
      +        "type": "string"
      +      },
      +      "points": {
      +        "items": {
      +          "anyOf": [
      +            {
      +              "additionalProperties": false,
      +              "properties": {
      +                "x": {
      +                  "type": "number"
      +                },
      +                "y": {
      +                  "type": "number"
      +                }
      +              },
      +              "required": [
      +                "x",
      +                "y"
      +              ],
      +              "type": "object"
      +            },
      +            {
      +              "items": {
      +                "type": "number"
      +              },
      +              "maxItems": 2,
      +              "minItems": 2,
      +              "type": "array"
      +            }
      +          ]
      +        },
      +        "type": "array"
      +      },
      +      "sampleId": {
      +        "type": "string"
      +      },
      +      "sourceRef": {
      +        "additionalProperties": false,
      +        "properties": {
      +          "id": {
      +            "type": "string"
      +          },
      +          "projectId": {
      +            "type": "string"
      +          },
      +          "type": {
      +            "enum": [
      +              "research",
      +              "experiment",
      +              "code",
      +              "run",
      +              "artifact",
      +              "protocol",
      +              "dataset",
      +              "evaluation",
      +              "comparison",
      +              "analysis",
      +              "report",
      +              "conversation",
      +              "proposal",
      +              "usage",
      +              "spec",
      +              "amendment",
      +              "server",
      +              "repository",
      +              "environment",
      +              "operation"
      +            ],
      +            "type": "string"
      +          },
      +          "version": {
      +            "minimum": 1,
      +            "type": "integer"
      +          }
      +        },
      +        "required": [
      +          "projectId",
      +          "type",
      +          "id"
      +        ],
      +        "type": "object"
      +      },
      +      "x": {
      +        "additionalProperties": false,
      +        "properties": {
      +          "label": {
      +            "minLength": 1,
      +            "type": "string"
      +          },
      +          "unit": {
      +            "type": "string"
      +          }
      +        },
      +        "required": [
      +          "label",
      +          "unit"
      +        ],
      +        "type": "object"
      +      },
      +      "xAxis": {
      +        "additionalProperties": false,
      +        "properties": {
      +          "label": {
      +            "minLength": 1,
      +            "type": "string"
      +          },
      +          "unit": {
      +            "type": "string"
      +          }
      +        },
      +        "required": [
      +          "label",
      +          "unit"
      +        ],
      +        "type": "object"
      +      },
      +      "y": {
      +        "additionalProperties": false,
      +        "properties": {
      +          "label": {
      +            "minLength": 1,
      +            "type": "string"
      +          },
      +          "unit": {
      +            "type": "string"
      +          }
      +        },
      +        "required": [
      +          "label",
      +          "unit"
      +        ],
      +        "type": "object"
      +      },
      +      "yAxis": {
      +        "additionalProperties": false,
      +        "properties": {
      +          "label": {
      +            "minLength": 1,
      +            "type": "string"
      +          },
      +          "unit": {
      +            "type": "string"
      +          }
      +        },
      +        "required": [
      +          "label",
      +          "unit"
      +        ],
      +        "type": "object"
      +      }
      +    },
      +    "required": [
      +      "kind",
      +      "points"
      +    ],
      +    "type": "object"
      +  },
      +  {
      +    "additionalProperties": false,
      +    "properties": {
      +      "items": {
      +        "items": {
      +          "additionalProperties": false,
      +          "anyOf": [
      +            {
      +              "required": [
      +                "artifactRef"
      +              ]
      +            },
      +            {
      +              "required": [
      +                "uri"
      +              ]
      +            }
      +          ],
      +          "properties": {
      +            "artifactRef": {
      +              "additionalProperties": false,
      +              "properties": {
      +                "id": {
      +                  "type": "string"
      +                },
      +                "projectId": {
      +                  "type": "string"
      +                },
      +                "type": {
      +                  "enum": [
      +                    "artifact"
      +                  ],
      +                  "type": "string"
      +                },
      +                "version": {
      +                  "minimum": 1,
      +                  "type": "integer"
      +                }
      +              },
      +              "required": [
      +                "projectId",
      +                "type",
      +                "id"
      +              ],
      +              "type": "object"
      +            },
      +            "caption": {
      +              "type": "string"
      +            },
      +            "config": {
      +              "additionalProperties": true,
      +              "type": "object"
      +            },
      +            "sampleId": {
      +              "type": "string"
      +            },
      +            "uri": {
      +              "type": "string"
      +            }
      +          },
      +          "type": "object"
      +        },
      +        "type": "array"
      +      },
      +      "kind": {
      +        "const": "image-set"
      +      },
      +      "label": {
      +        "type": "string"
      +      },
      +      "name": {
      +        "type": "string"
      +      },
      +      "sampleId": {
      +        "type": "string"
      +      },
      +      "sourceRef": {
      +        "additionalProperties": false,
      +        "properties": {
      +          "id": {
      +            "type": "string"
      +          },
      +          "projectId": {
      +            "type": "string"
      +          },
      +          "type": {
      +            "enum": [
      +              "research",
      +              "experiment",
      +              "code",
      +              "run",
      +              "artifact",
      +              "protocol",
      +              "dataset",
      +              "evaluation",
      +              "comparison",
      +              "analysis",
      +              "report",
      +              "conversation",
      +              "proposal",
      +              "usage",
      +              "spec",
      +              "amendment",
      +              "server",
      +              "repository",
      +              "environment",
      +              "operation"
      +            ],
      +            "type": "string"
      +          },
      +          "version": {
      +            "minimum": 1,
      +            "type": "integer"
      +          }
      +        },
      +        "required": [
      +          "projectId",
      +          "type",
      +          "id"
      +        ],
      +        "type": "object"
      +      }
      +    },
      +    "required": [
      +      "kind",
      +      "items"
      +    ],
      +    "type": "object"
      +  },
      +  {
      +    "additionalProperties": false,
      +    "properties": {
      +      "columns": {
      +        "items": {
      +          "additionalProperties": false,
      +          "anyOf": [
      +            {
      +              "required": [
      +                "key"
      +              ]
      +            },
      +            {
      +              "required": [
      +                "name"
      +              ]
      +            }
      +          ],
      +          "properties": {
      +            "key": {
      +              "type": "string"
      +            },
      +            "label": {
      +              "type": "string"
      +            },
      +            "metricId": {
      +              "type": "string"
      +            },
      +            "name": {
      +              "type": "string"
      +            },
      +            "type": {
      +              "enum": [
      +                "string",
      +                "number",
      +                "boolean"
      +              ]
      +            },
      +            "unit": {
      +              "type": "string"
      +            }
      +          },
      +          "required": [
      +            "type"
      +          ],
      +          "type": "object"
      +        },
      +        "type": "array"
      +      },
      +      "kind": {
      +        "const": "table"
      +      },
      +      "label": {
      +        "type": "string"
      +      },
      +      "name": {
      +        "type": "string"
      +      },
      +      "rows": {
      +        "items": {
      +          "additionalProperties": {
      +            "type": [
      +              "string",
      +              "number",
      +              "boolean",
      +              "null"
      +            ]
      +          },
      +          "type": "object"
      +        },
      +        "type": "array"
      +      },
      +      "sampleId": {
      +        "type": "string"
      +      },
      +      "sourceRef": {
      +        "additionalProperties": false,
      +        "properties": {
      +          "id": {
      +            "type": "string"
      +          },
      +          "projectId": {
      +            "type": "string"
      +          },
      +          "type": {
      +            "enum": [
      +              "research",
      +              "experiment",
      +              "code",
      +              "run",
      +              "artifact",
      +              "protocol",
      +              "dataset",
      +              "evaluation",
      +              "comparison",
      +              "analysis",
      +              "report",
      +              "conversation",
      +              "proposal",
      +              "usage",
      +              "spec",
      +              "amendment",
      +              "server",
      +              "repository",
      +              "environment",
      +              "operation"
      +            ],
      +            "type": "string"
      +          },
      +          "version": {
      +            "minimum": 1,
      +            "type": "integer"
      +          }
      +        },
      +        "required": [
      +          "projectId",
      +          "type",
      +          "id"
      +        ],
      +        "type": "object"
      +      }
      +    },
      +    "required": [
      +      "kind",
      +      "columns",
      +      "rows"
      +    ],
      +    "type": "object"
      +  },
      +  {
      +    "additionalProperties": false,
      +    "anyOf": [
      +      {
      +        "required": [
      +          "mimeType"
      +        ]
      +      },
      +      {
      +        "required": [
      +          "mediaType"
      +        ]
      +      }
      +    ],
      +    "properties": {
      +      "availability": {
      +        "enum": [
      +          "available",
      +          "unavailable",
      +          "unknown"
      +        ]
      +      },
      +      "description": {
      +        "type": "string"
      +      },
      +      "kind": {
      +        "const": "attachment"
      +      },
      +      "label": {
      +        "type": "string"
      +      },
      +      "mediaType": {
      +        "type": "string"
      +      },
      +      "mimeType": {
      +        "type": "string"
      +      },
      +      "name": {
      +        "type": "string"
      +      },
      +      "sampleId": {
      +        "type": "string"
      +      },
      +      "sourceRef": {
      +        "additionalProperties": false,
      +        "properties": {
      +          "id": {
      +            "type": "string"
      +          },
      +          "projectId": {
      +            "type": "string"
      +          },
      +          "type": {
      +            "enum": [
      +              "research",
      +              "experiment",
      +              "code",
      +              "run",
      +              "artifact",
      +              "protocol",
      +              "dataset",
      +              "evaluation",
      +              "comparison",
      +              "analysis",
      +              "report",
      +              "conversation",
      +              "proposal",
      +              "usage",
      +              "spec",
      +              "amendment",
      +              "server",
      +              "repository",
      +              "environment",
      +              "operation"
      +            ],
      +            "type": "string"
      +          },
      +          "version": {
      +            "minimum": 1,
      +            "type": "integer"
      +          }
      +        },
      +        "required": [
      +          "projectId",
      +          "type",
      +          "id"
      +        ],
      +        "type": "object"
      +      },
      +      "uri": {
      +        "type": "string"
      +      }
      +    },
      +    "required": [
      +      "kind",
      +      "uri"
      +    ],
      +    "type": "object"
      +  }
      +]
    • changedInput schema / properties / record / properties / status / enum
      Previous value: -[
      -  "planned",
      -  "running",
      -  "completed",
      -  "failed",
      -  "partial"
      -]New value: +[
      +  "planned",
      +  "running",
      +  "completed",
      +  "failed",
      +  "partial",
      +  "unknown"
      +]
  2. First observedv0.3.3

TDQS

B3.2/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=false, idempotentHint=true, destructiveHint=false and closed-world, so the safety profile is covered. The description adds that a validation step runs before registration, which is useful context beyond annotations, but it does not disclose optimistic-concurrency behavior implied by expectedRevision or the idempotency contract of requestId.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single compact sentence that front-loads the action and ends with the key negative constraint. Zero filler, no repetition of the title or name.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

This tool accepts a deeply nested record schema with five result variants and four required top-level parameters, plus no output schema, yet the description is one short clause. It omits concurrency semantics (expectedRevision), idempotency key behavior (requestId), and what happens on validation failure — all essential for correct invocation of a write tool with this complexity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must carry parameter meaning. It hints at record contents (protocol/code/input versions) mapping to record.protocolRef, codeRef and inputRefs, but says nothing about requestId, projectId, or the critical expectedRevision concurrency parameter.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific compound verb (validate and register) applied to a specific resource (existing typed evaluation results) with scope qualifiers (fixed protocol/code/input versions). The clause 'does not compute metrics' implicitly separates it from metric-producing siblings like rws_metrics_append, though no sibling is named explicitly.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The word 'existing' signals this is for results already produced elsewhere rather than computed here, and 'does not compute metrics' gives one exclusion. However, there is no explicit when-to-use/when-not comparison against rws_result_query or rws_metrics_append, and no prerequisites are stated.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.