Skip to main content
Glama

audit_screening_job

Generate an automated Bias & Disparate Impact Audit for a screening job, aligned with NYC Local Law 144 AEDT and EEOC 4/5ths Rule standards. Evaluates scoring stability against demographic proxy perturbations and computes adverse impact ratios. Produces an unguessable public verification certificate URL.

Tool call template

Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.

{
  "id": 1,
  "jsonrpc": "2.0",
  "method": "tools/call",
  "params": {
    "arguments": {
      "job_id": "<job_id>"
    },
    "name": "audit_screening_job"
  }
}

Input Schema

NameRequiredDescriptionDefault
job_idYesThe ID of the completed screening job to audit.
selection_thresholdNoPassing score threshold for adverse impact analysis (1-100, default: 70).

Schema Changelog

Changes observed during successful MCP inspections.

  1. Added

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden; it does disclose meaningful behavior — perturbation-based stability testing, adverse impact ratio computation, and creation of a public verification certificate URL, which signals persistence and external exposure. It omits critical operational traits for a presumably expensive generate operation: cost, runtime/duration, idempotency on re-invocation, whether the certificate is permanently public, and any credit consumption.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three tight sentences, each carrying distinct information (purpose + standards, method, output). Front-loaded with the action and unencumbered by filler or restated parameters.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema, the description usefully characterizes the return (an unguessable public certificate URL) and the analysis performed, which is enough to call the tool correctly. The remaining gaps — cost, latency, and re-run semantics — are real but secondary for a two-parameter tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so both parameters are already self-documenting (job_id, selection_threshold with range and default), making 3 the baseline. The description adds only the "completed" precondition for job_id and does not explain how selection_threshold changes the adverse-impact verdict, which would have been genuine added meaning.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb and resource ("Generate an automated Bias & Disparate Impact Audit for a screening job") and pins the domain with named standards (NYC LL144 AEDT, EEOC 4/5ths Rule). No sibling tool does audits, so an agent can immediately distinguish this from get_results or compare_candidates.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Usage is implied rather than stated: the schema parameter description says "completed screening job to audit," which tells the agent the job must be finished, but the description itself offers no explicit when-to-use, when-not, or alternative routing. An agent must infer that this is a post-completion, compliance-driven call rather than a routine results fetch.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources