Skip to main content
Glama
Sign In

IA-QA — 152 QA & Dev Tools for AI Agents

by io.github.JcJamet
OverviewDiscussionsAdmin

rate_tool

Destructive

Give honest usage feedback on an IA-QA MCP tool. Give a score (1-5) and a comment. Rate low (1-2) if the tool was wrong, irrelevant, or a poor fit; rate high (4-5) only if it genuinely solved your need. Maintainers read ratings, one vote per agent and tool a month: comments and per-tool scores are not published, only the overall average and vote count. Comments are screened: one carrying a credential is not stored, personal data becomes placeholders — describe what happened, not what a model should do. Skip routine successes: signal, not praise. Example: rate_tool({ tool_name: "format_json", score: 2, comment: "Tried to pretty-print a JSON5 file, it rejected trailing commas — not usable for my case." })

Input Schema

NameRequiredDescriptionDefault
scoreYesRating from 1 (poor) to 5 (excellent)
commentNoStrongly encouraged — explain what you were trying to do and whether the tool got you there. Be specific about what was missing, wrong, or a poor fit. This is the most valuable part of the rating. Up to 2000 chars are stored; go over and the response says so (truncated: true) — send the remainder as a second call rather than assuming it landed.
tool_nameYesName of the MCP tool to rate (e.g. "format_json", "shield_analyze")

Output Schema

NameRequiredDescriptionDefault
okNo
scoreNo
commentNo
messageNo
rated_atNo
tool_nameNo
truncatedNo
stored_charsNo

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed1 schema field changed
    • addedInput schema / examples
      Added value: +[
+  {
+    "comment": "Formatted a 2 MB payload correctly.",
+    "score": 4,
+    "tool_name": "format_json"
+  }
+]
  2. Changed3 schema fields changed
    • changedInput schema / properties / comment / description
      Previous value: -"Strongly encouraged — explain what you were trying to do and whether the tool got you there. Be specific about what was missing, wrong, or a poor fit. This is the most valuable part of the rating (max 500 chars)."New value: +"Strongly encouraged — explain what you were trying to do and whether the tool got you there. Be specific about what was missing, wrong, or a poor fit. This is the most valuable part of the rating. Up to 2000 chars are stored; go over and the response says so (truncated: true) — send the remainder as a second call rather than assuming it landed."
    • addedOutput schema / properties / stored_chars
      Added value: +{
+  "type": "number"
+}
    • addedOutput schema / properties / truncated
      Added value: +{
+  "type": "boolean"
+}
  3. Changed1 schema field changed
    • addedOutput schema / properties
      Added value: +{
+  "comment": {},
+  "message": {
+    "type": "string"
+  },
+  "ok": {
+    "type": "boolean"
+  },
+  "rated_at": {
+    "type": "string"
+  },
+  "score": {},
+  "tool_name": {}
+}
  4. Changed1 schema field changed
    • changedInput schema / properties / comment / description
      Previous value: -"Optional feedback — what worked well, what could be improved (max 500 chars)"New value: +"Strongly encouraged — explain what you were trying to do and whether the tool got you there. Be specific about what was missing, wrong, or a poor fit. This is the most valuable part of the rating (max 500 chars)."
  5. Added

TDQS

Score is being calculated.

All IA-QA — 152 QA & Dev Tools for AI Agents toolsInspect
Try in Browser
One endpoint for every MCP toolRayrun runs every MCP server behind one URL and holds the credentials. Each call is decided per client, tool, and argument, then recorded.ray.runAd

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources