Skip to main content
Glama

IA-QA — 152 QA & Dev Tools for AI Agents

rag_relevance_rank

Read-onlyIdempotent

Rank an array of text chunks by relevance to a query using TF-IDF scoring. Simulates retrieval ranking for RAG testing without needing embeddings or an API.

Input Schema

NameRequiredDescriptionDefault
queryYesThe user query
top_kNoReturn top K results (default: all)
chunksYesArray of text chunks to rank

Output Schema

NameRequiredDescriptionDefault
rankNo
indexNo
queryNo
scoreNo
resultsNo
returnedNo
total_chunksNo
chunk_previewNo
keyword_overlapNo

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed1 schema field changed
    • addedInput schema / examples
      Added value: +[
      +  {
      +    "chunks": [
      +      "a b c",
      +      "d e f"
      +    ],
      +    "query": "quantum"
      +  }
      +]
  2. Changed1 schema field changed
    • addedOutput schema / properties
      Added value: +{
      +  "chunk_preview": {},
      +  "index": {},
      +  "keyword_overlap": {},
      +  "query": {},
      +  "rank": {
      +    "type": "number"
      +  },
      +  "results": {},
      +  "returned": {
      +    "type": "number"
      +  },
      +  "score": {
      +    "type": "string"
      +  },
      +  "total_chunks": {
      +    "type": "number"
      +  }
      +}
  3. Changed1 schema field changed
    • changedOutput schema / (root)
      Previous value: -nullNew value: +{
      +  "additionalProperties": true,
      +  "type": "object"
      +}
  4. First observed

TDQS

A4/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint, idempotentHint, non-destructive, and closed-world, so safety and side-effect behavior are covered. The description adds meaningful behavioral context by naming the scoring algorithm (TF-IDF) and clarifying that it works offline without embeddings or API calls, though it omits details like sort order or score range.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two tight sentences with no filler. The core purpose and the key differentiator (no embeddings/API) are front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given full schema coverage, rich annotations, and an output schema, the description does not need to explain return values. It adequately explains the method and intended context, though it could briefly mention output ordering or tie-breaking behavior.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already documents 'query', 'chunks', and 'top_k' (including its default). The description adds no parameter-specific meaning beyond what the schema provides, so the baseline of 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb ('Rank'), resource ('array of text chunks'), and the scoring method ('TF-IDF'). The phrase 'without needing embeddings or an API' implicitly distinguishes it from sibling tools like embedding_similarity and vector_similarity.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives a usage context ('Simulates retrieval ranking for RAG testing'), implying it is for testing rather than production retrieval. However, it never explicitly says when to use this versus alternatives such as bm25_score, embedding_similarity, or rerank_evaluate, nor does it state any exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.