Skip to main content
Glama
dreamiurg

Datadog MCP Server

by dreamiurg

Datadog MCP Server

CI codecov OpenSSF Scorecard

The Datadog MCP server your AI deserves. 117 read-only tools. Every observability pillar. Zero writes. Zero regrets.


Why This One?

Look, we get it. You searched "datadog mcp server" and got seven results. You're wondering which one to pick. Let us save you approximately forty-five seconds of reading other READMEs that say "supports monitors and dashboards" like that's supposed to impress someone.

Feature

Us (117 tools)

Project 1

Project 2

Project 3

Observability Core

Logs (search + aggregate + pipelines + indexes)

7 tools

1 tool

0-1 tool

0-1 tool

APM (traces, spans, services, dependencies)

7 tools

1 tool

0 tools

0 tools

Metrics (query, metadata, volumes, tags)

6 tools

1 tool

0-1 tool

0 tools

RUM (events, apps, aggregation)

3 tools

3 tools

0 tools

0 tools

Alerting & Reliability

Monitors (list, get, search)

4 tools

1 tool

0-1 tool

0-1 tool

Dashboards (get, list, collections)

3 tools

1 tool

0-1 tool

0-1 tool

SLOs (list, get, history, search, corrections)

5 tools

0 tools

0-1 tool

0-1 tool

Synthetics (tests, results, locations)

5 tools

0 tools

0-1 tool

0 tools

Events & Incidents

7 tools

2 tools

0-1 tool

0 tools

Downtimes

2 tools

1 tool

0-1 tool

0 tools

Infrastructure & Security

Infrastructure (hosts, tags, containers, processes)

8 tools

2 tools

0-1 tool

0-1 tool

Security (findings, posture, signals, rules, scanning)

10 tools

0 tools

0-1 tool

0 tools

Network Monitoring

2 tools

0 tools

0 tools

0 tools

Cloud Integrations (AWS/GCP/Azure/Cloudflare/Confluent)

5 tools

0 tools

0 tools

0 tools

Platform & DevOps

Service Catalog

3 tools

0 tools

0-1 tool

0 tools

CI Visibility (pipelines + tests)

4 tools

0 tools

0-1 tool

0 tools

Organization (teams, users, auth)

5 tools

0 tools

0-1 tool

0 tools

Error Tracking

3 tools

0 tools

0 tools

0 tools

Database Monitoring

2 tools

0 tools

0 tools

0 tools

Workflows & Automation

2 tools

0 tools

0 tools

0 tools

DORA Metrics

1 tool

0 tools

0 tools

0 tools

Governance & Cost

Audit Trail

2 tools

0 tools

0 tools

0 tools

Usage & Billing

4 tools

0 tools

0 tools

0 tools

Cloud Cost Management

1 tool

0 tools

0 tools

0 tools

Access Control (keys, mappings, policies)

4 tools

0 tools

0 tools

0 tools

Notebooks

3 tools

0 tools

0 tools

0 tools

Fleet Management

1 tool

0 tools

0 tools

0 tools

Webhooks

1 tool

0 tools

0 tools

0 tools

Monitor Notifications

1 tool

0 tools

0 tools

0 tools

IP Ranges & Config

1 tool

0 tools

0 tools

0 tools

Total

117

~20

~13

~29

Accidentally deletes your monitors

No

No

No

No

Can mute your hosts at 3 AM

No

No

No

Yes

Test coverage

90%+

Unknown

Unknown

Unknown

We're not saying the other MCP servers are bad. That would be rude, and also legally questionable. They're all built by talented engineers who are contributing to open source and making the ecosystem better. Some of them have features we don't, like the ability to write to your Datadog account from an AI chat window. We chose not to include those. On purpose. You're welcome.

The Philosophy

Read everything. Write nothing.

Your AI assistant should be able to see all of Datadog. It should not be able to silence your pager at 3 AM because it decided your alerts were "probably fine." That's not a hypothetical scenario. That's a Tuesday. We have opinions about this, and they are all correct.


Related MCP server: databricks-mcp

Quick Start

npx github:dreamiurg/datadog-mcp --help

That's it. No installation required. Node.js 20+. Works in 8 seconds. We timed it.


Setup

1. Get Datadog Credentials

You need two keys from your Datadog Organization Settings:

Credential

Where to Find

Difficulty

API Key

Organization Settings -> API Keys -> New Key

Easy

Application Key

Organization Settings -> Application Keys -> New Key

Also easy

Tip: For least-privilege access, scope your Application Key to only the permissions you need. Or give it everything. We won't judge. (We will judge a little.)

2. Configure Your AI Tool

claude mcp add datadog -- npx github:dreamiurg/datadog-mcp \
  --apiKey YOUR_API_KEY \
  --appKey YOUR_APP_KEY \
  --site datadoghq.com

Or add to ~/.claude.json:

{
  "mcpServers": {
    "datadog": {
      "command": "npx",
      "args": ["github:dreamiurg/datadog-mcp", "--apiKey", "YOUR_API_KEY", "--appKey", "YOUR_APP_KEY"]
    }
  }
}

Add to your config file:

  • macOS: ~/Library/Application Support/Claude/claude_desktop_config.json

  • Windows: %APPDATA%/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "datadog": {
      "command": "npx",
      "args": ["github:dreamiurg/datadog-mcp", "--apiKey", "YOUR_API_KEY", "--appKey", "YOUR_APP_KEY"]
    }
  }
}

Tool

Config File

Cursor

~/.cursor/mcp.json or .cursor/mcp.json (project)

Windsurf

~/.codeium/windsurf/mcp_config.json

VS Code

User Settings JSON (Ctrl+Shift+P -> "Open User Settings (JSON)")

{
  "mcpServers": {
    "datadog": {
      "command": "npx",
      "args": ["github:dreamiurg/datadog-mcp", "--apiKey", "YOUR_API_KEY", "--appKey", "YOUR_APP_KEY"]
    }
  }
}

Add to ~/.gemini/settings.json:

{
  "mcpServers": {
    "datadog": {
      "command": "npx",
      "args": ["github:dreamiurg/datadog-mcp", "--apiKey", "YOUR_API_KEY", "--appKey", "YOUR_APP_KEY"]
    }
  }
}

Add to ~/.codex/config.toml:

[mcp_servers.datadog]
command = "npx"
args = ["github:dreamiurg/datadog-mcp", "--apiKey", "YOUR_API_KEY", "--appKey", "YOUR_APP_KEY"]

The Full Arsenal (117 Tools)

Tool

What It Does

Try Asking

search-logs

Search logs with Datadog query syntax

"Find errors in auth service last hour"

aggregate-logs

Compute counts, averages, group-bys on log data

"Count errors by service in the last 24h"

get-log-pipelines

List log pipeline configurations

"How are our logs being processed?"

get-log-indexes

List log indexes and retention settings

"What retention is configured for our logs?"

get-logs-pipeline-order

Get log pipeline processing order

"What order do log pipelines execute in?"

get-logs-archive-order

Get log archive priority order

"Which archives are checked first for rehydration?"

list-logs-metrics

List log-based custom metrics

"What metrics are generated from logs?"

Tool

What It Does

Try Asking

search-spans

Search APM spans with query syntax

"Find slow requests in payment service"

aggregate-spans

Compute APM statistics (p99, error rates)

"Show p99 latency by service"

get-services

List APM-instrumented services

"What services are being traced?"

get-trace

Get a full distributed trace by ID

"Show all spans for trace abc123"

search-apm-events

Search raw APM events

"Find APM events with errors in checkout"

list-active-apm-events

List currently active APM events

"What APM events are happening right now?"

list-spans-metrics

List span-based APM metrics

"What custom span metrics are configured?"

Tool

What It Does

Try Asking

query-metrics

Query timeseries metric data

"Show CPU usage for web hosts last 4 hours"

get-metrics

List available metrics

"What metrics are available?"

get-metric-metadata

Get metric metadata and descriptions

"Describe the system.cpu.user metric"

search-metric-volumes

Search metrics by name with volume data

"Which metrics matching 'aws.' have the highest volume?"*

get-metric-tag-config

Get tag configuration for a specific metric

"What tags are indexed for system.cpu.user?"

list-metric-tag-configs

List metric tag configurations

"Which metrics have custom tag configurations?"

Tool

What It Does

Try Asking

get-monitors

List monitors (filter by state, tags)

"Show all alerting monitors"

get-monitor

Get monitor details by ID

"Get details for monitor 12345"

search-monitors

Search monitors by query

"Find monitors related to database"

get-monitor-config-policies

Get monitor configuration policies

"What monitor config policies are enforced?"

Tool

What It Does

Try Asking

get-dashboards

List all dashboards

"What dashboards do we have?"

get-dashboard

Get dashboard details and widgets

"Show the API metrics dashboard"

list-dashboard-lists

List dashboard collections

"What dashboard lists are organized?"

Tool

What It Does

Try Asking

get-slos

List Service Level Objectives

"Which SLOs are breaching?"

get-slo

Get SLO details by ID

"Show error budget for SLO xyz"

get-slo-history

Get historical SLO performance

"How has our API SLO trended this month?"

get-slo-corrections

List SLO correction periods

"What SLO corrections have been applied?"

search-slos

Search SLOs with query filters

"Find all SLOs with error budget below 10%"

Tool

What It Does

Try Asking

get-synthetic-tests

List synthetic tests

"What synthetic checks do we have?"

get-synthetic-results

Get results for a specific test

"Show recent results for the checkout test"

list-synthetics-global-variables

List Synthetics global variables

"What global variables are available for tests?"

list-synthetics-locations

List available Synthetics testing locations

"Where can I run Synthetics tests from?"

list-synthetics-private-locations

List Synthetics private locations

"What private locations are configured for testing?"

Tool

What It Does

Try Asking

search-rum-events

Search RUM events with filters

"Find RUM errors on the checkout page"

list-rum-applications

List registered RUM applications

"What apps have RUM enabled?"

aggregate-rum-events

Analytics on RUM data (counts, averages, group-by)

"Average page load time by country"

Tool

What It Does

Try Asking

get-hosts

List infrastructure hosts

"Show all production hosts"

get-host-tags

Get tags for all hosts

"What tags are on our hosts?"

get-active-hosts-count

Get total active/up host count

"How many hosts are running?"

list-host-totals

Get total active and up host counts

"Show me the total host count breakdown"

list-network-devices

List NDM network devices

"Show network device status"

list-fleet-agents

List Datadog agents across fleet

"Which agents are outdated?"

get-containers

List running containers

"Show containers filtered by image"

list-processes

List running processes

"Find java processes across hosts"

Tool

What It Does

Try Asking

list-service-definitions

List all service definitions

"What services are in the catalog?"

get-service-definition

Get a single service definition

"Who owns the auth service?"

get-service-dependencies

Get service dependency map

"What does the payment service depend on?"

Tool

What It Does

Try Asking

list-ci-pipelines

List CI pipeline events

"Show recent CI pipeline runs"

get-ci-pipeline-events

Aggregate CI pipeline analytics

"Average pipeline duration by repo"

list-ci-tests

List CI test events

"Show failed tests in the last hour"

search-ci-test-events

Search CI test events with filters

"Find flaky tests in the checkout service"

Tool

What It Does

Try Asking

search-security-findings

Search Cloud Security findings

"Find high-severity security findings"

get-security-finding

Get a specific security finding

"Get finding abc123"

list-posture-findings

List compliance/posture findings

"Show failed compliance checks"

search-security-signals

Search security monitoring signals

"Recent threat detections"

get-csm-coverage

Get CSM coverage across cloud accounts

"Which AWS accounts lack security coverage?"

list-vulnerabilities

List vulnerability findings (SAST, SCA, IAST, Infra)

"Show open SAST vulnerabilities in production"

list-csm-threats-agent-rules

List CSM Threats agent rules

"What workload security rules are enabled?"

list-security-rules

List security monitoring rules

"What detection rules are active?"

list-security-monitoring-rules

List security monitoring detection rules

"What security detection rules are configured?"

get-sensitive-data-scanner-config

Get Sensitive Data Scanner configuration

"What sensitive data scanning rules are active?"

Tool

What It Does

Try Asking

get-organization

Get Datadog organization info

"Show organization details and settings"

list-teams

List Datadog teams

"What teams exist in our org?"

list-team-members

List members of a Datadog team

"Who is on the platform team?"

list-users

List Datadog users

"Who has access to Datadog?"

list-authn-mappings

List SAML/OIDC authentication mappings

"How do IdP groups map to Datadog roles?"

Tool

What It Does

Try Asking

get-events

Fetch events in a time range

"What events happened today?"

get-downtimes

List scheduled maintenance

"Any active downtimes?"

list-downtime-schedules

List scheduled downtimes (v2)

"What downtimes are scheduled?"

get-dbm-samples

Get Database Monitoring query samples

"Show slow postgres queries"

get-dbm-query-metrics

Get Database Monitoring query metrics

"Which queries have the highest latency?"

get-ip-ranges

Get Datadog IP ranges for firewall config

"What IPs should I allowlist for Datadog?"

Tool

What It Does

Try Asking

search-audit-logs

Search audit trail with filters

"Who changed configs in the last hour?"

get-hourly-usage

Get hourly usage metering by product

"Show log ingestion usage trends"

get-top-avg-metrics

Get top custom metrics by hourly average

"Which custom metrics drive cardinality costs?"

get-estimated-cost

Get estimated usage cost data

"What's our projected Datadog bill this month?"

Tool

What It Does

Try Asking

list-notebooks

List Datadog notebooks with filtering

"Find investigation notebooks"

get-notebook

Get a specific notebook by ID

"Show notebook 12345"

Tool

What It Does

Try Asking

list-containers

List containers with tag filtering

"Show running containers in us-east-1"

list-processes

List processes across hosts

"Find Java processes with high memory"

Tool

What It Does

Try Asking

list-network-devices

List NDM network devices

"Show network device status"

aggregate-network-connections

Aggregate network flow analytics

"Top network flows by bandwidth"

Tool

What It Does

Try Asking

list-security-rules

List security monitoring rules

"What detection rules are active?"

search-error-tracking-issues

Search error tracking issues

"Top errors by volume in production"

get-error-tracking-issue

Get error tracking issue details by ID

"Show details for issue abc123"

get-csm-coverage

Get CSM coverage across cloud accounts

"Which AWS accounts lack security coverage?"

list-vulnerabilities

List vulnerability findings (SAST, SCA, IAST, Infra)

"Show open SAST vulnerabilities in production"

list-csm-threats-agent-rules

List CSM Threats agent rules

"What workload security rules are enabled?"

Tool

What It Does

Try Asking

search-incidents

Search incidents with advanced filters

"Find P1 incidents related to database"

get-incident-todos

Get action items for an incident

"What's pending for this P0?"

get-incident-timeline

Get timeline events for an incident

"Show the timeline for incident xyz"

get-incident-services

List incident services

"What services are configured for incident management?"

Tool

What It Does

Try Asking

list-aws-accounts

List integrated AWS accounts

"Which AWS accounts are connected?"

list-gcp-integration

List GCP integration accounts

"Which GCP projects are integrated?"

list-azure-integration

List Azure integration accounts

"Which Azure subscriptions are connected?"

list-cloudflare-accounts

List Cloudflare accounts

"What Cloudflare accounts are integrated?"

list-confluent-accounts

List Confluent Cloud accounts

"Which Confluent Cloud accounts are connected?"

list-webhooks

List webhook integrations

"What webhooks are configured?"

list-api-keys

List Datadog API keys

"What API keys are active?"

Tool

What It Does

Try Asking

list-dora-deployments

List DORA deployment events

"Show deployment frequency for web service"

list-workflows

List workflow automations

"What incident response workflows exist?"

list-workflow-executions

List execution instances for a workflow

"Show run history for the incident workflow"

list-fleet-agents

List Datadog agents across fleet

"Which agents are outdated?"

list-monitor-notification-rules

List monitor notification routing

"Who gets alerted for this monitor?"

list-cost-budgets

List cloud cost budgets

"Are any teams over budget?"

Tool

What It Does

Try Asking

list-restriction-policies

Get restriction policy for a resource

"What access restrictions are configured?"

list-app-keys

List application keys for the current user

"What application keys do I have?"

list-authn-mappings

List authentication mappings

"How do SAML groups map to Datadog roles?"


The Competitive Landscape (We Did the Research So You Don't Have To)

There are approximately seven thousand Datadog MCP servers on GitHub. We counted. Then we lost count. Then we counted again. Here's how they stack up:

Capability

Us

Project 1

Project 2

Project 3

Project 4

Total tools

117

~20

~10

~13

~29

Read-only by design

Yes

No

Yes

Yes

No

Can mute your hosts

No

Yes

No

No

No

Can delete your dashboards

No

No

No

No

Yes

Can schedule downtimes

No

Yes

No

No

Yes

Test suite

570 tests

-

-

-

-

Last meaningful update

Today

Recent

Dec 2025

Jan 2026

Dec 2025

A note on write operations: Some servers let your AI create monitors, delete dashboards, and schedule downtimes. That's a feature. It's also the plot of every "AI gone wrong" movie ever made. We chose the boring path: read everything, touch nothing. Our therapist says this is healthy.

What They Have That We Don't

In the interest of full transparency (and because our lawyers said we had to):

  • Some servers can mute/unmute hosts and schedule downtimes (write operations we intentionally excluded because we enjoy sleeping)

  • Some servers can CRUD monitors and dashboards (see above re: AI movies, and also re: sleeping)

  • Some servers have unique metric field exploration tools

We sleep extremely well at night.


Configuration Reference

Regional Endpoints

Set --site for your Datadog region:

Region

Site Value

US (default)

datadoghq.com

EU

datadoghq.eu

US3 (GovCloud)

ddog-gov.com

US5

us5.datadoghq.com

AP1

ap1.datadoghq.com

Environment Variables

Alternative to command-line arguments:

DD_API_KEY=your_api_key
DD_APP_KEY=your_app_key
DD_SITE=datadoghq.com          # Optional, defaults to datadoghq.com
DD_LOGS_SITE=logs.datadoghq.com # Optional, override for logs API
DD_METRICS_SITE=api.datadoghq.com # Optional, override for metrics API

Logging

Variable

Values

Default

Description

LOG_LEVEL

debug, info, warn, error

info

Minimum log level

LOG_FORMAT

json, pretty

json

Output format (pretty for local dev)

# Pretty logs for development
LOG_FORMAT=pretty npx github:dreamiurg/datadog-mcp --apiKey ... --appKey ...

Create an Application Key with only the scopes you need:

Scope

Tools Unlocked

monitors_read

get-monitors, get-monitor, search-monitors, get-monitor-config-policies, list-monitor-notification-rules

dashboards_read

get-dashboards, get-dashboard, list-dashboard-lists

metrics_read

get-metrics, get-metric-metadata, query-metrics, search-metric-volumes, get-metric-tag-config, list-metric-tag-configs

events_read

get-events

logs_read_data

search-logs, aggregate-logs, get-log-pipelines, get-log-indexes, get-logs-pipeline-order, get-logs-archive-order, list-logs-metrics

hosts_read

get-hosts, get-host-tags, get-active-hosts-count, list-host-totals

containers_read

list-containers, get-containers

monitors_downtime

get-downtimes, list-downtime-schedules

slos_read

get-slos, get-slo, get-slo-history, get-slo-corrections, search-slos

apm_read

search-spans, aggregate-spans, get-trace, search-apm-events, list-active-apm-events, list-spans-metrics

apm_service_catalog_read

get-services, get-service-dependencies, list-service-definitions, get-service-definition

rum_read

search-rum-events, list-rum-applications, aggregate-rum-events

synthetics_read

get-synthetic-tests, get-synthetic-results, list-synthetics-global-variables, list-synthetics-locations, list-synthetics-private-locations

security_monitoring_findings_read

search-security-findings, get-security-finding, list-posture-findings, search-security-signals, list-vulnerabilities

security_monitoring_rules_read

list-security-rules, list-security-monitoring-rules

csm_agents_read

get-csm-coverage, list-csm-threats-agent-rules

teams_read

list-teams, list-team-members

user_access_read

list-users

notebooks_read

list-notebooks, get-notebook

ci_visibility_pipelines_read

list-ci-pipelines, get-ci-pipeline-events

ci_visibility_read

list-ci-tests, search-ci-test-events

error_tracking_read

search-error-tracking-issues, get-error-tracking-issue

audit_trail_read

search-audit-logs

dbm_read

get-dbm-samples, get-dbm-query-metrics

usage_read

get-hourly-usage, get-top-avg-metrics, get-estimated-cost

ndm_read

list-network-devices, aggregate-network-connections

aws_configuration_read

list-aws-accounts

api_keys_read

list-api-keys, list-app-keys

auth_n_mappings_read

list-authn-mappings

incident_read

search-incidents, get-incident-todos, get-incident-timeline, get-incident-services

dora_deployment_read

list-dora-deployments

workflows_read

list-workflows, list-workflow-executions

fleet_read

list-fleet-agents

cost_management_read

list-cost-budgets

Create a scoped key: Organization Settings -> Application Keys -> New Key -> Select scopes


Troubleshooting

  1. Verify API key and Application key are correct

  2. Check your Application Key has required scopes

  3. Confirm you're using the correct regional endpoint

# Check MCP server status
claude mcp list

# View logs (Claude Desktop - macOS)
tail -f ~/Library/Logs/Claude/mcp*.log

# View logs (Claude Desktop - Windows)
Get-Content "$env:APPDATA\Claude\Logs\mcp*.log" -Tail 20 -Wait
LOG_LEVEL=debug LOG_FORMAT=pretty npx github:dreamiurg/datadog-mcp --apiKey ... --appKey ...

Development

git clone https://github.com/dreamiurg/datadog-mcp.git
cd datadog-mcp
npm install
npm run build
npm test

Script

Description

npm run build

Compile TypeScript

npm test

Run tests (570 tests in 120 files)

npm run test:coverage

Run tests with coverage (90%+ enforced)

npm run lint

Run Biome linter

npm run typecheck

Type check

npm run complexity

Check cyclomatic complexity

npm run ci

Run everything (the full gauntlet)

Test with MCP Inspector

npx @modelcontextprotocol/inspector node dist/index.js \
  --apiKey=YOUR_API_KEY \
  --appKey=YOUR_APP_KEY

Contributing

PRs welcome. We have strong opinions about read-only access, 90% test coverage, and cognitive complexity under 15. If that sounds like fun, you'll fit right in.


License

MIT - Use freely in personal and commercial projects.


Disclaimer

In case it wasn't abundantly, blindingly, neon-sign-in-the-desert obvious: the comparison tables above are written with tongue so firmly in cheek it's coming out the other side. This is sarcasm. We are being sarcastic. If you're still not sure, yes, that was also sarcasm.

Every single Datadog MCP server out there was built by engineers who cared enough to ship something real into the world. That's more than most people do on a Saturday. Open source is better when there are options, and the ecosystem is better because all of these projects exist.

If our 117 read-only tools aren't what you need, genuinely and sincerely: go find the one that is. Try them all. Mix and match. Build your own. Fork ours and add write operations if you're feeling brave (and have good backups). The best tool is the one that fits your workflow, not the one with the spiciest README.

Now go build something great. Sleep tight.

Available Tools

117 tools
aggregate-logsA

Compute statistics and aggregations on logs. Use for 'how many errors per service', 'count logs by status', or 'average response time from logs'. Supports count, avg, sum, min, max, percentiles. Use search-logs to see actual log content instead.

ParametersJSON Schema
NameRequiredDescriptionDefault
filterNo
computeNo
groupByNo
optionsNo

TDQS

A3.7/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, and the description lacks behavioral details such as whether the tool modifies data, required permissions, rate limits, or side effects. It only notes supported aggregation functions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three concise sentences: purpose, examples, and alternative. Every sentence adds value; no redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the complex schema with 4 nested parameters and no output schema, the description is too brief. It does not cover parameter usage, return format, or additional context needed for correct invocation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema parameter coverage is 0% and the description does not explain the nested parameters (filter, compute, groupBy, options). It only mentions aggregation types but not how they map to the compute array.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool computes statistics and aggregations on logs with specific examples (e.g., 'how many errors per service'), and distinguishes itself from sibling tool search-logs, which is used for actual log content.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides explicit when-to-use (aggregation scenarios) and when-not-to-use (for log content, use search-logs). It also implies it is for logs vs other data types by naming.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

aggregate_network_connectionsC

Aggregate network connection analytics with grouping and filtering

ParametersJSON Schema
NameRequiredDescriptionDefault
filter_fromNo
filter_toNo
filter_queryNo
group_byNo
aggregateNo

TDQS

C2.6/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries full burden for behavioral disclosure. It only states the core function (aggregation with grouping/filtering) but does not reveal whether the tool is read-only, has side effects, rate limits, or any operational constraints. This is insufficient for safe invocation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise at one sentence, but this brevity sacrifices necessary detail. It is front-loaded with key action and resource, but lacks structure for multiple aspects. For a tool with 5 parameters, more substance is warranted.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the absence of annotations and output schema, the description should provide richer context. It fails to explain return format, aggregation types, valid filter fields, or grouping behavior, leaving significant gaps for complete understanding.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 5 parameters with 0% description coverage, and the tool description adds no parameter details. It mentions 'grouping and filtering' which hints at 'group_by' and filter parameters, but without explaining valid values, formats, or semantics, the agent cannot correctly formulate arguments.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool aggregates network connection analytics, differentiating it from sibling aggregation tools like 'aggregate-logs' and 'aggregate-rum-events' that operate on different data types. The verb 'aggregate' and resource 'network connection analytics' are specific, though 'analytics' is somewhat vague.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus other aggregation tools or alternatives. The description does not mention prerequisites, context, or limitations, leaving the agent to infer usage without decision support.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

aggregate-rum-eventsA

Aggregate RUM events with compute operations (count, avg, sum, min, max, percentile) and group-by facets. Use for 'RUM page load times by country', 'error count by browser', 'average session duration by app version'.

ParametersJSON Schema
NameRequiredDescriptionDefault
computeYesCompute operations to perform
filterNoFilter criteria
group_byNoGroup-by facets

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description bears full responsibility. It describes the aggregation and grouping behavior but does not mention whether the operation is read-only, any side effects, or permissions needed. The description is adequate but not thorough.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences: the first defines functionality, the second provides examples. It is front-loaded and concise with no unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with three nested parameters and no output schema, the description covers the purpose and usage examples. It lacks details on the return format or how filter interacts, but the schema fills many gaps. Adequate for the complexity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the description adds limited value beyond the schema. It lists aggregation types and gives example queries, but does not explain parameter semantics in more depth than the schema already does.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool aggregates RUM events with specific compute operations and group-by facets, and gives concrete examples. It distinguishes from sibling tools by specifying 'RUM events' and the aggregation verbs.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides explicit example use cases ('RUM page load times by country', etc.), which helps the agent decide when to use this tool. While it doesn't explicitly state when not to use it, the examples are clear and differentiate from other tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

aggregate-spansA

Compute statistics on APM spans. Use for 'p99 latency by service', 'error rate per endpoint', 'request count over time'. Supports count, avg, sum, min, max, percentiles (pc75/90/95/99). Use search-spans to see actual span details.

ParametersJSON Schema
NameRequiredDescriptionDefault
filterNo
computeNo
groupByNo

TDQS

A3.6/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so description must compensate. It mentions computing statistics but does not disclose behavioral traits like read-only nature, side effects, rate limits, authorization needs, or performance implications for large datasets.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Extremely concise: two sentences and examples. Front-loaded with purpose, no redundant information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Despite good purpose clarity, the description lacks detail on return structure, behavior with missing parameters, and does not compensate for the absence of output schema. Given the tool's complexity (nested objects, multiple aggregations), more completeness is needed.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% (per context signal), but the description lists supported aggregation types and examples. However, it does not explain the structure of filter, compute, or groupBy parameters nor their nesting, leaving gaps.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly defines the tool: 'Compute statistics on APM spans' with concrete use cases ('p99 latency by service', 'error rate per endpoint', 'request count over time'). Distinguishes from sibling search-spans by contrasting aggregation vs detail retrieval.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicitly states when to use ('Use for ...') and directs to search-spans for detail. Does not list all alternatives but provides clear context for APM span aggregation.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-active-hosts-countB

Get total number of active and up hosts. Use for 'how many hosts are running', 'infrastructure host count', 'active host summary'.

ParametersJSON Schema
NameRequiredDescriptionDefault
fromNoSeconds since Unix epoch to scope the count

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description bears full responsibility. It indicates a read-only, non-destructive operation but does not disclose behavioral traits such as rate limits, authentication requirements, data freshness, or what 'active and up' technically means. The parameter 'from' is mentioned only via schema.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences: a clear purpose statement followed by concise usage examples. It is front-loaded, has no redundant words, and every sentence adds value.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the low complexity (one optional parameter, no output schema), the description gives basic purpose and usage context. However, it lacks explanation of what 'active and up' means, how the count is scoped (e.g., time range, workspace), and whether the result is real-time or historical. This leaves some ambiguity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% (the single 'from' parameter is described in the schema). The tool description does not add any additional meaning beyond what the schema provides, so baseline score of 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb ('Get') and resource ('total number of active and up hosts'), and includes example queries like 'how many hosts are running' that clarify its purpose. It distinguishes from sibling tools like 'get-hosts' (which likely returns host details) by focusing on a count, but does not explicitly differentiate from 'list_host_totals'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides example usage phrases but gives no guidance on when to use this tool vs. alternatives (e.g., 'get-hosts' or 'list_host_totals'), nor does it mention prerequisites or limitations. The examples imply use cases, but not explicit directives.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-audit-eventsA

Search Datadog organization audit events. Use for 'who changed this monitor', 'what config changes happened today', 'audit trail for user X'. Returns timestamped events with actor, action, and affected resource.

ParametersJSON Schema
NameRequiredDescriptionDefault
filterNo
sortNoSort order
pageNo
limitNoMaximum events to return

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must convey behavioral traits. It states 'Returns timestamped events with actor, action, and affected resource', but lacks details on pagination, rate limits, or auth requirements.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three concise sentences: purpose statement, use case list, return value description. No unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema, the description adequately explains return fields. It covers essential information for a search tool, though could expand on pagination and sorting behavior.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 50%; the description adds value by showing filter query format ('@action:modified @resource_type:monitor'), but does not elaborate on sort or pagination parameters beyond the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'Search Datadog organization audit events' and provides specific use cases like 'who changed this monitor', which distinguishes it from sibling search tools for logs, traces, etc.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives explicit usage scenarios ('who changed this monitor', 'what config changes happened today'), but does not mention when not to use it or alternatives among siblings.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-ci-pipeline-eventsC

Aggregate CI pipeline analytics with compute operations. Use for 'average pipeline duration', 'failure rate by pipeline', 'CI performance trends'.

ParametersJSON Schema
NameRequiredDescriptionDefault
computeYesCompute operations
filterNo
group_byNo

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full responsibility. It only describes the tool's function ('aggregate CI pipeline analytics with compute operations') without disclosing behavioral traits like read-only nature, authentication requirements, rate limits, or potential side effects. This leaves the agent uninformed about important usage constraints.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise, consisting of one functional sentence plus a usage tip. It is front-loaded with the core action. However, it could be slightly more structured by separating the purpose from the usage examples, but overall it is appropriately sized for a tool with moderate complexity.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's complexity (nested parameters, no output schema, no annotations), the description is insufficient. It does not explain the return format, how results are grouped, or how to interpret the computed analytics. For an aggregation tool, these details are critical for correct invocation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 3 parameters with only 33% description coverage according to context signals. The description adds minimal information beyond the schema (e.g., 'Compute operations' for the compute parameter). It does not explain valid values for metric or type in the compute array, nor clarify the filter or group_by parameters. The agent has to infer too much.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states that the tool aggregates CI pipeline analytics with compute operations, and provides example use cases like 'average pipeline duration' and 'failure rate by pipeline'. This makes the purpose specific and actionable, though it does not explicitly differentiate from all sibling tools like 'aggregate-logs'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives concrete examples of when to use the tool ('average pipeline duration', 'failure rate by pipeline', 'CI performance trends'), which guides the agent. However, it lacks explicit when-not-to-use guidance or mention of alternative tools for non-aggregation tasks, such as listing individual pipeline events.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-containersA

List containers monitored by Datadog. Use for 'show running containers', 'containers for web service', 'container status by image'. Returns container names, images, tags, state, and start time.

ParametersJSON Schema
NameRequiredDescriptionDefault
filterTagsNoComma-separated tags (e.g., 'env:prod,service:web')
groupByNoGroup by attribute (e.g., 'short_image')
sortNoSort field (e.g., 'name', '-name')
pageSizeNoResults per page
pageCursorNoPagination cursor

TDQS

A3.6/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries full disclosure burden. It only states it lists containers (implying read-only), but omits details on pagination, rate limits, required permissions, or how parameters like sort and filterTags affect behavior.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise with two sentences: first states the purpose, second provides usage examples and return fields. No wasted words, front-loaded with essential information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool has 5 parameters and no output schema, but the description only lists a few return fields without explaining types, format, or behavior like pagination. Important context about parameter effects (sort, filter) is missing.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 100% coverage with descriptions for each parameter, and the tool description adds no additional meaning beyond what the schema already provides, meeting the baseline expectation.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool lists containers monitored by Datadog, provides example use cases, and specifies returned fields (names, images, tags, state, start time), making it easy for an agent to understand exactly what the tool does.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives explicit example queries ('show running containers', 'containers for web service', 'container status by image') indicating when to use this tool, but does not mention how it differs from sibling 'list-containers' or when not to use it.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_csm_coverageC

Get Cloud Security Management coverage across cloud accounts

ParametersJSON Schema
NameRequiredDescriptionDefault
page_sizeNo
page_cursorNo

TDQS

C2.7/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must bear the full burden. It only states the function without disclosing behavioral traits such as pagination, permissions required, whether it is read-only, or what the response contains.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence. However, it is too brief and lacks necessary detail, bordering on under-specification rather than effective conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has 2 optional parameters and no output schema or annotations, the description is incomplete. It fails to explain pagination mechanics, coverage meaning, or what the response contains.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, and the description does not mention either parameter (page_size, page_cursor). It adds no meaning beyond the schema's names and types.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'Get Cloud Security Management coverage across cloud accounts', using a specific verb and resource. It distinguishes itself from sibling tools like 'get-security-finding' or 'list_csm_threats_agent_rules' by targeting CSM coverage specifically.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool vs. alternatives. It does not mention any prerequisites, exclusions, or scenarios where other tools would be more appropriate.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-dashboardA

Get full dashboard definition by ID. Returns all widgets, queries, and layout. Use after get-dashboards to explore a specific dashboard's contents and understand what metrics/data it displays.

ParametersJSON Schema
NameRequiredDescriptionDefault
dashboardIdYes

TDQS

A4.2/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description bears full responsibility. It implies a read operation but does not explicitly state safety (e.g., no side effects). Adequate but not fully transparent.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two efficient sentences with no superfluous information. Front-loaded with action and key details.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a single-parameter tool with no output schema, the description adequately covers purpose, return content, and usage order. Minor gap: does not specify if dashboardId is a UUID or other format.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, and the description mentions 'by ID' but does not explain the format or source of the dashboardId. It adds minimal value beyond the parameter name.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it retrieves the full dashboard definition by ID, specifying it returns widgets, queries, and layout. This distinguishes it from sibling tool 'get-dashboards' which lists dashboards.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicitly instructs to use after 'get-dashboards' to explore a specific dashboard's contents, providing clear context for when this tool is appropriate.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-dashboardsA

List all Datadog dashboards. Use to answer 'what dashboards exist', 'find dashboard for API metrics', or to get dashboard IDs for get-dashboard. Returns dashboard names, IDs, and URLs.

ParametersJSON Schema
NameRequiredDescriptionDefault
limitNo

TDQS

A4.1/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full burden. It states the tool returns dashboard names, IDs, and URLs, which is transparent. However, it does not disclose any additional behavioral traits like rate limits or permissions, but for a simple list operation, this is adequate.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise with three sentences that each add value: stating the action, listing use cases, and describing the return data. No filler or redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool is simple (one optional parameter, no output schema), and the description covers its purpose, typical queries, and return fields. It could mention pagination or behavior when limit is exceeded, but the default and description of 'all dashboards' make it adequate.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

There is one parameter (limit) with 0% schema description coverage. The description does not mention the limit parameter or its default value, leaving the agent to infer its purpose from the schema alone. This is a gap in adding value beyond the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool lists all Datadog dashboards and provides example use cases. It differentiates from get-dashboard by mentioning it returns IDs, indicating how to get a specific dashboard.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives explicit contexts for use (e.g., 'what dashboards exist', 'find dashboard for API metrics') and mentions using it to get IDs for get-dashboard, but does not explicitly state when not to use it or mention alternatives among siblings.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_dbm_query_metricsC

Get Database Monitoring query metrics. Filter by database type, host, query text, and time range.

ParametersJSON Schema
NameRequiredDescriptionDefault
filter_db_typeNo
filter_hostNo
filter_queryNo
filter_fromNo
filter_toNo
page_limitNo
page_cursorNo

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description must disclose behavioral traits, but it only states the action and filter options. It does not indicate whether the operation is read-only, any side effects, pagination behavior, rate limits, or data retention. This lack of transparency could lead to misuse.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is very concise at two sentences, front-loading the purpose. While it is efficient, the brevity sacrifices necessary detail for a tool with 7 parameters and no annotations. It balances well but could be slightly expanded without becoming verbose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description lacks crucial context such as output format, pagination, required permissions, and time range formatting. Without annotations or output schema, the agent is left with insufficient information to invoke the tool correctly, especially given the complexity of 7 parameters.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The description mentions four filter parameters (database type, host, query text, time range) which map to filter_db_type, filter_host, filter_query, filter_from, and filter_to in the schema. However, it omits pagination parameters (page_limit, page_cursor) and does not specify expected formats (e.g., date-time for time range). Given the 0% schema description coverage, it adds some value but is incomplete.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool retrieves 'Database Monitoring query metrics' with filtering by specific attributes. This effectively identifies the resource and action. However, it does not differentiate from sibling tools like 'get-dbm-samples' which also deal with DBM data, so it loses some clarity in distinguishing itself.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives, such as other metrics tools or aggregate functions. It fails to mention prerequisites, context, or exclusions, leaving the agent without decision support for tool selection.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-dbm-samplesA

Get Database Monitoring query samples. Use for 'slow database queries', 'what queries are running on postgres', 'DB performance issues'. Returns query samples with execution time, affected rows, and database context.

ParametersJSON Schema
NameRequiredDescriptionDefault
startNoStart timestamp (Unix seconds)
endNoEnd timestamp (Unix seconds)
sourceNoDatabase type (e.g., 'postgresql', 'mysql')
dbHostNoDatabase hostname filter
dbNameNoDatabase name filter
limitNoMax results to return

TDQS

A3.9/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must disclose behavior. It states it returns query samples with execution time, affected rows, and database context, implying a read-only operation. However, it omits details like authentication requirements, rate limits, or potential side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise with two sentences. The first sentence states the action and resource, and the second provides use cases and return types. No extraneous information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description covers the tool's purpose and return fields but lacks details on default behavior when optional parameters are omitted, pagination, result ordering, or limits on time range. With no output schema, more context on return structure would be beneficial.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema already describes all six parameters, so the baseline is 3. The description adds no additional parameter-specific meaning; it only mentions return fields (execution time, rows, context), which are not in the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool retrieves Database Monitoring query samples, with specific verb 'Get' and resource. It also provides concrete use cases like 'slow database queries' and 'DB performance issues', making the purpose unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives clear example scenarios for when to use this tool, such as investigating slow queries or monitoring current query activity. However, it does not explicitly mention when not to use it or differentiate from sibling tools like 'get_dbm_query_metrics'.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-downtimesA

List scheduled maintenance downtimes in Datadog. Use for 'are there any active downtimes', 'what's scheduled for maintenance', 'why is this monitor muted'. Shows scope, schedule, and duration. Critical for on-call to understand muted monitors.

ParametersJSON Schema
NameRequiredDescriptionDefault
currentOnlyNoReturn only currently active downtimes
includeNoComma-separated list to include (e.g., 'created_by,monitor')
pageOffsetNoPagination offset
pageLimitNoNumber of downtimes to return

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must disclose behavior. It indicates a read operation and mentions output scope/schedule/duration. However, it omits details on auth, rate limits, or pagination behavior beyond parameter hints.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is three sentences, front-loaded with the main action, and each sentence adds value. It is concise and well-structured without unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (list downtimes, 4 optional parameters, no output schema), the description covers purpose, usage, and output contents. It is nearly complete, though pagination behavior and output format are not described.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

All four parameters have descriptions in the input schema (100% coverage). The tool description adds no additional parameter meaning beyond what the schema already provides, meeting the baseline of 3.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it lists scheduled maintenance downtimes and provides specific use cases. It distinguishes from many siblings but does not explicitly differentiate from the similar 'list_downtime_schedules' tool.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly gives usage scenarios (e.g., 'are there any active downtimes') and notes it's critical for on-call. It does not provide exclusions or alternatives, but the guidance is clear and context-rich.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_error_tracking_issueA

Get details of a Datadog error tracking issue (user-facing error/exception) by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
issue_idYesError tracking issue ID

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries full burden. It indicates a read operation and that details are returned, but does not disclose authentication needs, rate limits, or potential side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence with no unnecessary words, front-loading the key information efficiently.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema, the vague 'details' leaves incomplete context about what is returned. However, the tool is simple with one parameter, so it is adequate but not thorough.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% for the single parameter 'issue_id'. The description adds 'by ID' but does not provide additional semantic information beyond what the schema already states.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb ('get details'), resource ('Datadog error tracking issue'), and method ('by ID'). It distinguishes from sibling 'search_error_tracking_issues' which is for searching.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage when you have a specific issue_id, but does not explicitly state when not to use or mention alternatives like search. No guidance on prerequisites.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_estimated_costC

Get estimated cost data for your Datadog usage. Filter by date range and view type (sub_org, summary). Useful for cost monitoring and budget planning.

ParametersJSON Schema
NameRequiredDescriptionDefault
viewNo
start_monthNo
end_monthNo
start_dateNo
end_dateNo

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must convey behavioral traits. It indicates a read-like operation for cost data, but does not disclose idempotency, rate limits, or what happens on invalid input (e.g., malformed dates). The description is vague on side effects and safety.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise with two sentences. The first sentence states the primary purpose, and the second adds context about use case. It is front-loaded and wastes no words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has 5 parameters, no output schema, and no annotations, the description is too brief. It does not explain the difference between start_month/end_month and start_date/end_date, how the view parameter values differ, or the structure of the returned cost data. The description leaves significant gaps for an agent to use the tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, meaning the description adds no parameter-specific details. While it mentions 'date range and view type (sub_org, summary)', it does not map these to the five parameters (view, start_month, end_month, start_date, end_date) or explain their relationships. This is insufficient for a tool with multiple optional parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool retrieves estimated cost data for Datadog usage, with filtering by date range and view type. It specifies the resource (cost data) and actions (get, filter), but does not explicitly differentiate from related siblings like get_hourly_usage or get-usage.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description mentions the tool is useful for cost monitoring and budget planning, providing some context. However, it does not specify when to use this tool over alternatives like get_hourly_usage or get-usage, nor does it provide any exclusions or prerequisites.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-eventsB

Query Datadog events within a time range. Events include deployments, alerts, configuration changes, and comments. Use for 'what happened yesterday', 'show deployment events', or correlating incidents with changes. Requires start/end as Unix timestamps.

ParametersJSON Schema
NameRequiredDescriptionDefault
startYes
endYes
priorityNo
sourcesNo
tagsNo
unaggregatedNo
excludeAggregationNo
limitNo

TDQS

B3.1/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations exist; description carries full burden. It states 'Requires start/end as Unix timestamps' which is useful. However, it does not disclose side effects (though query suggests read-only), rate limits, pagination behavior, or what the response contains. The description is adequate but not thorough.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise with two sentences. It covers purpose, examples, and key requirement. However, it could be more structured (e.g., bullet points) for better scanning. No unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given 8 parameters (2 required) and no output schema, the description is incomplete. It only addresses start/end, ignoring other params and return format. An agent would lack information about filtering and response structure.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0%, so description must explain parameters. Only start and end are mentioned as 'Unix timestamps'. The other six parameters (priority, sources, tags, unaggregated, excludeAggregation, limit) have zero explanation. This severely limits an agent's ability to correctly use them.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'Query Datadog events within a time range' and provides examples like 'deployments, alerts, configuration changes, and comments'. It suggests use cases such as 'what happened yesterday'. While it doesn't explicitly differentiate from sibling tools like get-audit-events, the focus on general events is implied. The verb and resource are specific.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides concrete use cases: 'what happened yesterday', 'show deployment events', correlating incidents with changes'. This gives agents good context for when to invoke. However, it does not include when not to use or mention alternative tools for specific event types.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-hostsA

List infrastructure hosts reporting to Datadog. Use for 'show production hosts', 'which hosts are muted', 'hosts running agent version X'. Returns host names, IPs, apps, agent info, and mute status. Essential for infrastructure visibility during incidents.

ParametersJSON Schema
NameRequiredDescriptionDefault
filterNoFilter hosts by name substring
sortFieldNoField to sort by (e.g., 'name', 'apps', 'cpu')
sortDirNoSort direction ('asc' or 'desc')
startNoStarting offset for pagination
countNoNumber of hosts to return (max 1000)
fromNoUnix timestamp to filter hosts seen after
includeMutedHostsDataNoInclude mute status and expiry
includeHostsMetadataNoInclude host metadata (agent version, platform)

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden. It lists the returned fields (host names, IPs, apps, agent info, mute status) and implies a read-only operation. However, it fails to disclose pagination behavior, default sort, or any rate limits, which are important for a list operation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise: three short sentences with no filler. The most critical information (purpose, use cases, output) is front-loaded and easy to parse.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a list tool with no output schema but well-documented parameters, the description covers the essential purpose and output fields. It lacks details on pagination and defaults, but these are partially covered by schema descriptions. Overall, it provides sufficient context for basic usage.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

All 8 parameters have descriptions in the input schema (100% coverage), so the baseline is 3. The description adds no parameter-specific guidance beyond the schema's descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it lists infrastructure hosts from Datadog, with specific example queries that illustrate its scope. It effectively differentiates from siblings like get-active-hosts-count or list-fleet-agents by focusing on host details and mute status.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides concrete usage examples (e.g., 'show production hosts', 'which hosts are muted') that guide an agent on when to invoke this tool. However, it does not mention when not to use it or explicitly name alternative tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-host-tagsA

Get all tags associated with hosts. Use for 'what tags are on my hosts', 'which hosts have team:platform tag', or to understand host groupings. Returns a map of tag names to host lists.

ParametersJSON Schema
NameRequiredDescriptionDefault
host_nameYesHost name to get tags for
sourceNoTag source filter (e.g., 'datadog-agent', 'users', 'chef')

TDQS

A4.1/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided. Description discloses return format ('map of tag names to host lists') but lacks details on read-only nature, permissions, or rate limits. Adequate for a simple read tool.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences with example queries, no filler. Front-loaded with main purpose. Every sentence adds value.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema but description explains return format. Parameter coverage complete. Usage examples provide context. Sufficient for a straightforward tag-listing tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema covers 100% of parameters. Description adds no additional parameter details beyond schema; example queries hint at usage but don't expand on format or constraints.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states 'Get all tags associated with hosts' with specific example queries. Distinguishes from sibling tools like list-hosts by focusing on tags.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Provides explicit use cases like 'what tags are on my hosts' and 'which hosts have team:platform tag'. Does not explicitly state when not to use, but examples cover typical scenarios.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_hourly_usageB

Get Datadog hourly usage by product family for cost analysis

ParametersJSON Schema
NameRequiredDescriptionDefault
filter_timestamp_startYesStart time (ISO 8601, required)
filter_timestamp_endNoEnd time (ISO 8601)
filter_product_familiesYesComma-separated product families (e.g. infra_hosts,logs)
page_limitNoMax results per page
page_next_record_idNoPagination record ID

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must carry the full behavioral burden. It only states the purpose but does not disclose side effects, authentication requirements, rate limits, or data scope. The read-only nature is implied but not explicit.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single concise sentence that is front-loaded with the tool's purpose. No unnecessary words, making it efficient for an agent to parse.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With 5 parameters, no output schema, and no annotations, the description lacks details on return format, pagination behavior, or filtering semantics. It feels incomplete for a data retrieval tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the input schema already explains each parameter. The description adds no further meaning beyond what the schema provides, meeting the baseline but not exceeding it.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool retrieves Datadog hourly usage by product family for cost analysis, with a specific verb and resource. It distinguishes from siblings like get_usage or get_estimated_cost by focusing on hourly granularity and product family breakdown.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives like get_usage or get_estimated_cost. The description does not mention preferred scenarios or exclusions, leaving the agent without decision support.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-incidentsB

List Datadog incidents for incident management. Use for 'show active incidents', 'what incidents happened this week', or 'find incidents related to payments'. Includes severity, status, commander, and timeline.

ParametersJSON Schema
NameRequiredDescriptionDefault
pageSizeNo
pageOffsetNo
queryNo
limitNo

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, so description bears full burden. It only states 'List' (read operation) and mentions included fields, but omits pagination, rate limits, authentication requirements, or any limitations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three sentences, front-loaded with purpose, no redundant information. Efficient and structured for quick comprehension.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Despite moderate complexity (4 params, no annotations, no output schema), description lacks detail on return format, pagination behavior, filtering semantics, and sibling tool distinctions. Incomplete for an agent to use correctly without external knowledge.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%. Description does not explain parameters like pageSize, pageOffset, or limit. Example usage for query is implicit but not explained. Provides minimal added meaning beyond schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clear verb+resource: 'List Datadog incidents for incident management.' Provides specific example use cases that distinguish it from other incident-related tools like get_incident_services or get_incident_timeline.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Gives example phrases like 'show active incidents', but does not contrast with sibling tools such as search_incidents or other listing tools. Usage guidance is implied but not explicit about when to choose this over alternatives.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_incident_servicesA

List incident services used for categorizing and routing incidents. Filter by name and paginate results.

ParametersJSON Schema
NameRequiredDescriptionDefault
page_sizeNo
page_offsetNo
filterNo

TDQS

A3.7/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations exist, so the description must convey behavior. It states the operation (list) but omits details like permissions, rate limits, data freshness, or side effects. It is not contradictory but minimally informative.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences: first defines purpose, second specifies parameters. No redundant or unnecessary words. It is well-structured and front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple list tool with pagination and filter, the description covers the essential functionality. However, it lacks details on output format and default pagination values, leaving minor gaps.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%. The description clarifies only the 'filter' parameter ('Filter by name'), providing no context for page_size or page_offset, such as defaults or boundaries.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'List incident services used for categorizing and routing incidents', specifying the verb 'List', resource 'incident services', and their purpose. It distinguishes from siblings like get-incidents and search_incidents.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The tool's purpose is clear and appropriate for listing incident services; no explicit when-not-to-use or alternatives are mentioned, but the context of sorting through siblings implies it is the only tool for this resource.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_incident_timelineC

Get timeline events for a Datadog incident. Shows status changes, messages, tasks, notifications.

ParametersJSON Schema
NameRequiredDescriptionDefault
incident_idYes
page_sizeNo
page_offsetNo
filter_typeNo

TDQS

C2.8/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden of behavioral disclosure. It notes the types of events shown, but does not mention pagination behavior, rate limits, ordering, or whether the operation is read-only. The listing of event types adds only partial transparency.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise with one brief sentence and a list of event types. It front-loads the purpose, but could be better structured to include parameter usage or example values. Overall, it is fairly efficient but could improve readability.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool retrieves a timeline with four parameters and no output schema, the description is too sparse. It lacks details on response structure, pagination, parameter roles, and how to filter events. The agent cannot confidently use the tool correctly based solely on this description.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% and the description does not explain any of the four parameters (incident_id, page_size, page_offset, filter_type). No meaning is added beyond the schema field names, leaving the agent without guidance on parameter values or usage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool gets timeline events for a Datadog incident, with specific examples like status changes, messages, tasks, and notifications. It uses a specific verb and resource, distinguishing it from siblings such as get-incidents and get_incident_todos.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description does not provide any guidance on when to use this tool versus alternatives, no prerequisites or exclusions. It only states what it shows, leaving the agent to infer usage context without explicit direction.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_incident_todosA

Get action items/todos for a specific Datadog incident

ParametersJSON Schema
NameRequiredDescriptionDefault
incident_idYesIncident ID

TDQS

A3.6/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must disclose behavioral traits. It only states the action (get) without clarifying whether it is read-only, destructive, or requires special permissions. This is minimal disclosure for a retrieval tool.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence of 8 words, with no wasted text. It is front-loaded with the action and resource, achieving maximum conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple tool with one parameter and no output schema, the description is adequate. It explains the tool's purpose and input. However, it omits details about return format or pagination, but these are not critical given the tool's simplicity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema provides a description for the single parameter (incident_id: 'Incident ID'), covering 100% of parameters. The description adds no additional meaning beyond what the schema already states, so a baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool retrieves action items/todos for a specific Datadog incident, with a specific verb and resource. It distinguishes from sibling tools like get_incidents (which retrieves incidents) and get_incident_timeline.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description does not provide explicit guidance on when or when not to use this tool. It implies usage for retrieving incident todos but lacks exclusions or alternatives, leaving the agent to infer context from the tool name.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_ip_rangesA

Get Datadog IP ranges used by agents, APIs, APM, logs, process collection, synthetics, and webhooks. Useful for firewall/allowlist configuration.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A3.8/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description must fully disclose behavior. It states the tool 'gets' IP ranges, implying a read operation, but offers no details on side effects, permissions, or rate limits. Basic transparency is present but lacks depth.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description consists of two concise sentences. The first sentence delivers the core purpose, and the second adds a common use case. No extraneous words, efficiently front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has no parameters, no output schema, and no annotations, the description covers the essential purpose and a typical use case. However, it could be more complete by hinting at the response format (e.g., CIDR blocks) to aid post-invocation handling.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has zero parameters, so schema description coverage is 100%. The description does not need to add parameter meaning; the baseline score of 4 applies. No additional value is required.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly specifies the action ('Get'), the resource ('Datadog IP ranges'), and the scope (agents, APIs, APM, logs, etc.). It distinguishes this tool from siblings by focusing on IP range retrieval, a unique functionality among listed tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides a practical use case ('firewall/allowlist configuration') but does not explicitly state when to use this tool versus alternatives, nor does it mention when not to use it. The context is implied but not fully directive.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-log-indexesA

List all log indexes and their configuration. Use for 'where are logs being stored', 'what retention is configured', 'which logs are being excluded'. Returns index names, filters, retention days, daily limits, and exclusion filters.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A4.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided; description lists return fields but does not disclose side effects, rate limits, or authentication needs. As a simple read operation, it is adequate but not exhaustive.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences front-load the action and usage context, followed by return fields. No unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Despite no output schema or annotations, the description provides action, usage guidance, and return fields, making it self-contained for a simple list tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

There are no parameters; schema coverage is 100%. The description adds no parameter info but meets the baseline for a zero-parameter tool.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it lists all log indexes and their configuration, and provides example queries and return fields, distinguishing it from siblings like search-logs and get-logs-archives.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It gives explicit use cases (e.g., 'where are logs being stored', 'what retention is configured') but does not state when not to use or mention alternatives, though the context is clear.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-log-pipelinesA

List all log processing pipelines. Use for 'how are logs being processed', 'which pipelines are active', 'what parsing rules exist'. Returns pipeline names, filters, processors, and enabled status. Essential for understanding log processing configuration.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A4.4/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries full burden. It states the tool lists all pipelines and returns specific fields (names, filters, processors, enabled status). It does not mention side effects or authorization, but for a read-only list tool, this is sufficient.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description consists of four sentences, each adding value. It is front-loaded with the core action. Slightly redundant in the last sentence ('Essential for understanding...'), but overall concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description is complete for a zero-parameter list tool. It covers the return value ('pipeline names, filters, processors, and enabled status') and provides context for when it's essential. No output schema exists, but the description fills the gap.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

There are zero parameters, so schema coverage is 100%. The description adds no parameter details, but none are needed. Baseline for zero parameters is 4, and the description meets that.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'List all log processing pipelines' with a specific verb and resource. It distinguishes from sibling tools by focusing on pipelines, not indexes or metrics, and provides example queries like 'how are logs being processed'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly lists use cases: 'Use for ...' which gives clear context. However, it does not mention when not to use this tool or name alternatives among siblings like get-log-indexes.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_logs_archive_orderA

Get the ordered list of log archive IDs, showing the priority order for log archiving.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A3.6/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full burden. It states 'Get' implies a read operation, but does not disclose side effects, authentication needs, rate limits, or what 'priority order' means. The behavioral transparency is minimal.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that efficiently conveys the purpose and result. It is front-loaded and contains no unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (zero parameters, no output schema, no annotations), the description is adequate. It explains what is returned and why. However, it could mention that this is a configuration read or that the order reflects processing priority.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool has zero parameters, and schema coverage is 100% (trivially). Per guidelines, baseline is 4. The description adds no parameter information, but none is needed. It does not clarify that no input is required, but this is implied by the empty schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool retrieves an ordered list of log archive IDs and explains it shows priority order. The verb 'Get' and resource 'ordered list of log archive IDs' are specific and distinct from siblings like 'get-logs-archives' which likely returns a list of archives, not an order.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives (e.g., 'get-logs-archives'). The description does not provide context for selection or exclusions, leaving the agent to infer usage from the name alone.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-logs-archivesB

Get log archive configurations showing where logs are stored

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, so description must fully disclose behavior. Only states it is a get (read) operation, but gives no details on response structure, authentication, or whether any side effects exist.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, no wasted words, directly communicates purpose. Front-loaded and efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Describes core function but lacks details on output format, pagination, or exceptions. Given no output schema, more context would be beneficial, but for a simple list operation it is minimally adequate.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema has 0 parameters with 100% coverage. Description adds no parameter info, but baseline is 3 per rules since schema is sufficient.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states verb 'Get', resource 'log archive configurations', and purpose 'showing where logs are stored'. Distinguishes from siblings like get-log-indexes or get-logs-pipelines.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives. Does not mention that it retrieves configurations only, not logs themselves, or that it returns all archives without filtering.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-logs-indexesB

Get log index configurations including retention and exclusion filters

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description only states 'Get', implying a read-only operation, but with no annotations, it fails to disclose any behavioral details such as data freshness, permission requirements, or rate limits. The description does not add value beyond the verb.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that is concise and front-loaded with the key purpose. Every word contributes meaning without redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given zero parameters and no output schema, the description is adequate for a simple retrieval tool. However, it does not mention pagination, sorting, or any constraints, leaving room for improvement in completeness for an agent unfamiliar with the API.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

There are no parameters, so the schema coverage is 100% vacuously. The description adds meaning by specifying that the tool returns configurations including retention and exclusion filters, helping the agent understand the content of the response. This meets the baseline for zero-parameter tools.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'Get log index configurations including retention and exclusion filters', specifying the verb, resource, and what the configurations include. It distinguishes from similar sibling tools like 'get-log-indexes' by adding detail about retention and exclusion filters, but does not explicitly differentiate them.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives like 'get-log-indexes' or other log-related tools. The agent has no context for selection.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-logs-metricsA

Get all log-based metric configurations

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description should disclose behavioral traits. It states 'Get all', but omits whether results are paginated, require authentication, or what happens if no configurations exist. Acceptable for a simple retrieval.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Minimal one-sentence description that conveys purpose without wasted words. Could be slightly expanded to add value, but remains concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the absence of parameters and output schema, the description is moderately complete. However, it lacks context on what log-based metric configurations are or how this tool differs from similar siblings like 'list_logs_metrics'.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

No parameters exist in the schema; baseline for zero parameters is 4. The description adds no param information, which is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb ('Get') and identifies the resource ('all log-based metric configurations'), clearly distinguishing it from sibling tools that retrieve metrics or other entities.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives like 'list_logs_metrics' or 'get-metrics'. The description provides no exclusions or context for appropriate use.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_logs_pipeline_orderA

Get the ordered list of log pipeline IDs, showing the processing order for log pipelines.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description is the sole source. It describes the output (ordered IDs, processing order) but does not disclose potential side effects, permissions needed, or data limitations. For a simple read-only tool with no parameters, this is adequate but not comprehensive.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence with no unnecessary words. It front-loads the core action and result. Every word adds value, making it concise and well-structured.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the low complexity (no parameters, no output schema, no annotations), the description is fairly complete. It specifies what is returned and the key property (order). Minor gaps exist (e.g., no mention of data freshness or sorting direction), but these are not critical for a simple list tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool has no parameters, and schema coverage is 100%. The description does not need to add parameter details. According to guidelines, baseline is 4 for zero parameters, and the description adds no extra parameter semantics beyond the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it retrieves the ordered list of log pipeline IDs, showing processing order. It is specific about the resource ('log pipeline IDs') and the verb ('Get'), and it distinguishes from similar list tools (e.g., 'get-log-pipelines') by emphasizing order.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives. While it implies use when ordering matters, it does not explicitly tell the agent when not to use it or mention sibling tools like 'get-log-pipelines' for unordered lists.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-logs-pipelinesC

Get log processing pipeline configurations

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries full burden but only states 'Get', implying a read operation. It fails to disclose whether all pipelines are returned, if pagination exists, or authentication requirements.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence with no waste, but it is too minimal—essentially just repeating the tool name. It could be more informative without adding length.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema and no parameters, the description is adequate at a basic level but does not specify the return format or scope. It leaves gaps for an agent needing to understand the output.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

No parameters exist, and schema coverage is 100% (trivially). Description adds no parameter info, but baseline is 3 per guidelines when schema coverage is high.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it retrieves 'log processing pipeline configurations' with a specific verb and resource. However, it does not distinguish itself from similar sibling tools like get-log-pipelines or get-log-indexes, lacking differentiation.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No usage guidance is provided. There is no indication of when to use this tool over alternatives, nor any exclusions or prerequisites. The context is purely implied.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-metric-metadataA

Get metadata for a specific metric name. Returns type (gauge/count/rate), unit, description, and integration. Use when you need to understand what a metric measures, e.g., 'what does system.cpu.user mean'.

ParametersJSON Schema
NameRequiredDescriptionDefault
metricNameYes

TDQS

A3.9/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full burden. It states the return fields but does not explicitly disclose that the operation is read-only or safe, nor does it mention authentication, rate limits, or side effects. While the example implies a lookup, the description lacks explicit behavioral guarantees.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences: first states purpose and return fields, second gives usage guidance with an example. Every sentence adds value, no wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (one required parameter, no output schema), the description covers the primary use case, return fields, and provides an example. It is sufficient for an agent to understand and invoke the tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema has 0% description coverage for the single parameter 'metricName'. The description provides an example usage ('what does system.cpu.user mean') which hints at the expected value format, but does not specify syntax, case sensitivity, or constraints beyond the required flag. This adds value but falls short of fully compensating for the lack of schema descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'Get metadata for a specific metric name' and lists the returned fields (type, unit, description, integration). It also provides a concrete example, 'what does system.cpu.user mean', which distinguishes it from sibling tools like 'get-metrics' or 'query-metrics'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description says 'Use when you need to understand what a metric measures' with a usage example, but does not explicitly mention when not to use it or how it differs from siblings like 'get-metrics' (which lists metrics) or 'query-metrics' (which retrieves data). Usage guidance is implied rather than explicit.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-metricsB

Search for available Datadog metrics by name pattern. Use to discover metrics like 'what CPU metrics exist' or 'find metrics for service X'. Parameter q searches metric names (e.g., q='aws.ec2' finds all EC2 metrics).

ParametersJSON Schema
NameRequiredDescriptionDefault
qNo

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden. It mentions the tool searches by name pattern but does not disclose behavioral traits such as whether it is read-only, authentication requirements, rate limits, or pagination behavior. The description lacks sufficient transparency for a tool without annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise, containing two sentences and a parenthetical example. It is front-loaded with the primary purpose and quickly provides usage context. No extraneous information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple tool with one parameter and no output schema, the description covers the main purpose and parameter usage. However, it lacks details on return format, possible empty results, or performance considerations. It is adequate but not comprehensive.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema has 0% description coverage for the single parameter 'q'. The description compensates by explaining that 'q searches metric names' and provides an example. While it adds meaning beyond the schema, it could be more precise about pattern matching (e.g., wildcard support).

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool searches for available Datadog metrics by name pattern, using the verb 'search' and specifying the resource. It provides examples that help distinguish from possible data querying tools like 'query-metrics', though not explicitly differentiating.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description indicates when to use the tool ('to discover metrics') but does not explicitly state when not to use it or mention alternative tools like 'query-metrics' for fetching metric values. The usage context is implied rather than explicit.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_metric_tag_configA

Get tag configuration for a specific metric. Shows which tags are indexed and queryable.

ParametersJSON Schema
NameRequiredDescriptionDefault
metric_nameYes

TDQS

A3.9/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description discloses that the tool shows indexed and queryable tags, which is helpful for understanding the output. It is a read operation, but no annotations exist; the description is adequate for this simple get tool.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences, front-loaded with purpose, no superfluous words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple 1-parameter tool without output schema, the description covers the purpose and result nature. Missing an example or note on metric_name format, but generally complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 0% schema description coverage, the description does not elaborate on the metric_name parameter beyond its name, lacking details on expected format or constraints.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it retrieves tag configuration for a specific metric, distinguishing it from sibling tools like list_metric_tag_configs which list all configurations.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for a specific metric but does not explicitly contrast with alternatives like list_metric_tag_configs or provide when-to-use/not-to-use guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-monitorA

Get full details for a specific monitor by ID. Use after get-monitors to dive deeper into a specific monitor's configuration, thresholds, query, and current state. Returns complete monitor definition.

ParametersJSON Schema
NameRequiredDescriptionDefault
monitorIdYes

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, so description carries full burden. It states returns 'complete monitor definition' implying read-only, but does not explicitly confirm no side effects. Minimum viable for a simple get operation, but could be more explicit about no mutation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences, front-loaded with action and resource, followed by usage context. Every word earns its place. No wasted text.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple tool with one parameter and no output schema, the description is complete: it explains purpose, usage sequence, and return content. No additional information needed.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0% and description only says 'by ID' which adds little beyond schema. The parameter monitorId is a number with no format or source hints. Description could have explained how to obtain the ID from get-monitors, but does not. Minimal semantic help.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Get', the resource 'full details for a specific monitor by ID', and differentiates from sibling 'get-monitors' by specifying it is a follow-up drill-down. It also mentions return content: configuration, thresholds, query, current state.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Provides explicit usage context: 'Use after get-monitors to dive deeper into a specific monitor's configuration...' This clearly indicates it is intended as a follow-up step after listing monitors. While no explicit when-not-to-use or alternatives are given, the context is sufficient for an AI agent.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_monitor_config_policiesA

Get monitor configuration policies that enforce tag and setting requirements on monitors across your organization.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A3.8/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, and the description does not disclose behavioral traits such as read-only nature, authentication requirements, or side effects. For a tool with no annotations, the description should compensate but only states basic functionality.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence that conveys the purpose efficiently without extra words. Every part is meaningful for understanding the tool's function.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the simplicity (no parameters, no output schema), the description adequately explains what the tool retrieves. Lacks details on output structure or scope, but sufficient for basic understanding.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool has zero parameters with 100% schema coverage. Since there are no parameters to document, the description naturally adds no parameter information. Baseline for no parameters is 4.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states verb 'Get' and specific resource 'monitor configuration policies' with explanation of their purpose (enforce tag and setting requirements). Distinct from sibling tools like get-monitor, which retrieves individual monitors rather than policies.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit when-to-use or alternatives are provided. Usage is implied by the tool's purpose, but there is no guidance on when not to use this tool or how it relates to similar tools like get-monitor or get-downtimes.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-monitorsA

List Datadog monitors with filtering. Use for questions like 'show alerting monitors', 'what monitors are in warning state', or 'monitors tagged with team:platform'. Filter by groupStates: 'alert', 'warn', 'no data', 'ok'. Use get-monitor for a single monitor's full details.

ParametersJSON Schema
NameRequiredDescriptionDefault
groupStatesNo
tagsNo
monitorTagsNo
limitNo

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full burden. It mentions filtering but does not disclose behavioral traits such as authentication needs, rate limits, pagination behavior, or whether the operation is read-only. For a list operation, this is adequate but not comprehensive.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is very concise with three sentences. It front-loads the main action, provides examples, and directs to the sibling tool. No extraneous information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the lack of annotations and output schema, the description covers core purpose and usage but omits details on return format, pagination, and behavior of all parameters. It is functional but not fully complete for a listing tool with 4 parameters.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate. It adds meaning for groupStates by listing possible values, but tags, monitorTags, and limit are not described beyond the schema examples. The limit parameter's default is not mentioned. This is insufficient for a 4-parameter tool with no schema descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'List Datadog monitors with filtering' and distinguishes from sibling 'get-monitor' by noting it is for a single monitor's full details. The verb 'list' and resource 'monitors' are specific, and the differentiation from the alternative tool is explicit.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides explicit usage examples like 'show alerting monitors' and 'monitors tagged with team:platform', and advises to use 'get-monitor' for single monitor details. This offers clear when-to-use and when-not-to-use guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_notebookA

Get a specific Datadog notebook by ID with all cells and content

ParametersJSON Schema
NameRequiredDescriptionDefault
notebook_idYesNotebook ID

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden of behavioral disclosure. It adds the detail that the tool returns 'all cells and content', which is useful. However, it does not mention any side effects, authentication needs, or limitations. For a read operation, this is adequate but minimal.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence that efficiently conveys the tool's purpose. No extraneous words or unnecessary details. Ideal for quick parsing by an AI agent.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the simple tool (one required parameter, no output schema), the description is fairly complete. It specifies what the tool does and what it returns. It could mention output format or error handling but is sufficient for an agent to understand the basic function.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% for the single parameter 'notebook_id', with a description 'Notebook ID'. The description adds no additional meaning beyond what the schema provides. Baseline score of 3 is appropriate as the schema already documents the parameter sufficiently.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('Get'), the resource ('a specific Datadog notebook'), and the scope ('by ID with all cells and content'). It distinguishes from sibling tools like 'get-notebooks' which likely list notebooks. The specificity of 'by ID' and 'all cells and content' provides high clarity.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage context: use when you have a specific notebook ID and need full content. However, it lacks explicit guidance on when to use this tool vs. alternatives like 'get-notebooks' or 'list_notebooks'. The sibling list includes many similar tools but no exclusions are mentioned.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-notebooksB

List Datadog notebooks. Use for 'show investigation notebooks', 'find notebooks by team', or 'recent notebooks about outage'. Notebooks are collaborative documents used during incidents and investigations.

ParametersJSON Schema
NameRequiredDescriptionDefault
authorHandleNoFilter by author's email handle
excludeAuthorHandleNoExclude specific author
countNoNumber of notebooks to return
startNoPagination offset
sortFieldNoSort field ('modified' or 'name')
sortDirNoSort direction ('asc' or 'desc')
queryNoSearch notebooks by text
includeCellsNoInclude notebook cell content
isTemplateNoFilter by template status
typeNoFilter by notebook type

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must fully disclose behavior. It only states 'List...' and defines notebooks as collaborative documents. It fails to mention pagination (start, count), sorting effects, rate limits, or authentication requirements. The agent gets minimal behavioral context.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences with zero waste. The first sentence immediately states the primary action. The second sentence provides context. Every word earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With 10 parameters, no output schema, and no annotations, the description is too brief. It does not explain pagination, sorting, filtering, or the structure of the response. A more detailed description is warranted given the tool's complexity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

All 10 parameters have descriptions in the input schema, providing full coverage. The description does not add any additional meaning beyond what the schema already offers. Baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'List Datadog notebooks' and provides example use cases like 'show investigation notebooks'. It is specific and actionable, but does not differentiate from the sibling tool 'list_notebooks' which would perform a similar function.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description includes example queries when to use ('show investigation notebooks', 'find notebooks by team', 'recent notebooks about outage'), but does not explicitly contrast with the sibling 'list_notebooks' or other listing tools. Guidance is present but lacks exclusionary information.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_organizationA

Get your Datadog organization info including name, plan, public ID, and settings. Essential for understanding account configuration.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A3.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full burden. It only states that it retrieves info, but does not mention behavioral traits like read-only nature, idempotency, authentication requirements, or rate limits.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences with no wasted words. It front-loads the action and resource, making it easy to scan.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has no parameters and returns organization info, the description is fairly complete. It covers what is retrieved and its purpose. However, it could mention response format since there is no output schema.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

There are zero parameters, and the schema coverage is 100% (empty). The description adds value by listing the specific information returned (name, plan, public ID, settings), which goes beyond the empty schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('Get...org info') and specifies what is included (name, plan, public ID, settings). Among siblings, there is no other tool that retrieves organization information, so it is distinct.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description says it's 'essential for understanding account configuration' but does not explicitly state when to use this tool versus alternatives or when not to use it. No mention of exclusions or alternatives.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-powerpacksC

Get reusable dashboard widget templates (Powerpacks)

ParametersJSON Schema
NameRequiredDescriptionDefault
page_limitNoMaximum number of results
page_offsetNoPage offset

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, so description must disclose behavior. It only says 'Get', implying a read operation, but does not confirm read-only behavior, pagination details, permissions needed, or the form of the result. Minimal transparency.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, front-loaded with verb and resource. No fluff, but could provide slightly more detail without losing conciseness. Efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Tool is simple with 2 params and no output schema. Description explains what it fetches but not the return format (list of objects?), pagination behavior, or how results are ordered. Leaves questions for the agent.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, with both page_limit and page_offset described. The description adds no extra meaning beyond the schema. Baseline 3 is appropriate since schema fully documents parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states verb 'Get' and resource 'reusable dashboard widget templates (Powerpacks)'. It distinguishes from sibling tools as no other powerpack-related tool exists. However, it could elaborate on what a Powerpack is (e.g., a dashboard template).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool vs alternatives. No mention of prerequisites, filtering, or context where this might be preferred over other get/list tools. The description solely explains what it does without usage context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-security-findingA

Get a legacy CSPM/CIEM finding by ID (posture_management). Note: this endpoint uses the legacy data model. Requires the security_monitoring_findings_read scope.

ParametersJSON Schema
NameRequiredDescriptionDefault
findingIdYes

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description partially covers behavior by mentioning the legacy data model and required scope ('security_monitoring_findings_read'). However, it lacks details on potential errors, idempotency, or response structure, leaving gaps in transparency.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise with two sentences, front-loading the core action and resource. Every word adds value, making it efficient and easy to parse.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple get-by-ID tool with one parameter and no output schema, the description covers the key aspects: purpose, legacy model, and required scope. It does not explicitly state the return format, but this is implied. Adequate for the complexity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0%, but the description adds meaning by clarifying that 'findingId' is the ID of a legacy CSPM/CIEM finding. This gives context beyond the bare parameter name in the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('Get'), the resource ('legacy CSPM/CIEM finding'), and the method ('by ID'). It distinguishes from sibling tools like 'list-posture-findings' and 'search-security-findings' by specifying retrieval of a single finding by identifier.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for fetching a specific finding by ID and notes the legacy data model, but does not explicitly state when to use alternatives or provide exclusion criteria. Siblings like 'search-security-findings' are not mentioned.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_sensitive_data_scanner_configA

Get Sensitive Data Scanner configuration including scanning groups and rules for PII/sensitive data detection.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A3.6/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must carry the full burden. It only states the tool retrieves configuration, with no mention of read-only behavior, authentication needs, rate limits, or side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, informative sentence that is front-loaded and contains no redundant or extraneous words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no parameters and no output schema, the description adequately covers the tool's purpose and scope. It could mention that the return value includes scanning groups and rules, which it does.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has no parameters (100% coverage), so the description does not need to add parameter details. The baseline is 4, and the description does not detract.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Get', the resource 'Sensitive Data Scanner configuration', and specifies what it includes ('scanning groups and rules for PII/sensitive data detection'). It is distinct from sibling get tools as it targets a specific configuration.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool vs alternatives, no exclusions, and no context about prerequisites or typical use cases.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-service-definitionA

Get a single service definition by name from the Service Catalog. Use for 'show service X details', 'what team owns service Y', 'service definition for Z'.

ParametersJSON Schema
NameRequiredDescriptionDefault
serviceNameYesThe service name to look up
schemaVersionNoSchema version: v1, v2, v2.1, or v2.2

TDQS

A3.9/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full burden. It correctly indicates a read operation (getting a definition) but lacks details on side effects, permissions, or rate limits. It is minimally adequate.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise: one sentence plus example phrases. Every part is useful, no wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema is provided, and the description does not describe the return value structure. While the tool is simple, a mention of the response format would improve completeness.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so baseline is 3. The description and schema both describe 'serviceName' and 'schemaVersion' clearly, but the description adds no extra meaning or context beyond what the schema already provides.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it gets a single service definition by name, with example queries like 'show service X details' and 'what team owns service Y'. This distinguishes it from sibling tools such as 'list-service-definitions' which would list all.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides explicit use cases ('Use for...'), giving clear context. It does not explicitly state when not to use or alternatives, but the examples imply appropriate scenarios.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-service-dependenciesA

Get service dependency graph for APM services in a given environment

ParametersJSON Schema
NameRequiredDescriptionDefault
envYesEnvironment name (e.g. production, staging)

TDQS

A3.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, and the description does not disclose behavioral traits such as read-only nature, permissions required, rate limits, or return value characteristics. The name suggests a read operation but lacks explicit disclosure.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence of 12 words, efficiently conveying the purpose without unnecessary detail. It is appropriately front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's low complexity, the description is adequate but does not mention the return format or output structure. It tells what the tool does but not what the response will contain, leaving some gaps.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema covers the single parameter 'env' with a clear description. The tool description does not add additional meaning beyond what the schema already provides, so baseline score of 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Get', the resource 'service dependency graph', and the scope 'for APM services in a given environment'. It distinguishes from sibling tools like 'get-services' and 'get-service-definition'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for retrieving dependency graphs but provides no explicit guidance on when to use this tool versus alternatives, nor any exclusions or prerequisites.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-servicesA

List all APM-instrumented services. Use to discover traced services, find service names for span queries, or get an overview of your distributed system. Returns service names and their environments.

ParametersJSON Schema
NameRequiredDescriptionDefault
envNoFilter services by environment

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations exist. The description discloses read-only trait (lists services) and return values (names and environments). It does not mention pagination, rate limits, or authentication needs, but for a simple list tool, this is adequate.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is three concise sentences: what it does, when to use it, what it returns. No extraneous content.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema exists, but the description mentions return values (service names and environments). It lacks mention of pagination or limits, and does not guide users to related tools like get-service-definition for detailed info. Still, it covers the essential context for a simple list operation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema has one optional parameter 'env' with description. The description adds no additional semantics beyond what the schema provides. With 100% schema coverage, baseline 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it lists all APM-instrumented services and mentions use cases like discovering traced services and getting an overview. It distinguishes from siblings like get-service-definitions, which return detailed metadata, but does not explicitly contrast with list-service-definitions.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides usage context (discover services, find names for span queries), but does not specify when to avoid this tool or mention alternatives. Implicit guidance is present but lacking explicit exclusion criteria.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-sloA

Get detailed SLO information by ID. Returns error budget remaining, burn rate, target vs actual, thresholds, and configured alerts. Use after get-slos to understand a specific SLO's health and history.

ParametersJSON Schema
NameRequiredDescriptionDefault
sloIdYesThe ID of the SLO to retrieve
withConfiguredAlertIdsNoInclude IDs of monitors configured as SLO alerts

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, so description carries full burden. Lists returned fields but does not disclose read-only behavior, idempotency, or error conditions. Adequate but could be more transparent.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Extremely concise: two sentences, front-loaded with purpose. Every word adds value, no redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema, description enumerates key return fields. Includes usage context. Lacks error handling details, but sufficient for typical use.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with descriptions for both parameters. The description adds no additional parameter semantics beyond the schema, so baseline score is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states it retrieves detailed SLO information by ID, listing specific fields like error budget remaining and burn rate. Distinguishes from sibling 'get-slos' by advising use after that tool.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Provides clear sequential usage guidance ('Use after get-slos'). However, does not explicitly mention when not to use or compare with alternatives like get-slo-history or search_slos.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_slo_correctionsC

List all SLO corrections (status adjustments) across your organization. Shows maintenance windows and planned downtime exclusions that affect SLO calculations.

ParametersJSON Schema
NameRequiredDescriptionDefault
offsetNo
limitNo

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must convey behavioral traits. It describes the tool as listing corrections affecting SLO calculations, but does not disclose response format, pagination behavior, permission requirements, or whether it is read-only. This is minimal disclosure.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences, front-loaded with the main action. It is concise and directly states the tool's purpose. No unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has 2 parameters with no descriptions, no output schema, and no annotations, the description covers the basic purpose but lacks detail on response shape, pagination, and parameter usage. It is adequate but incomplete for optimal agent usage.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0% and the description does not mention the parameters offset and limit. The schema provides no descriptions, so the agent relies entirely on inference. The description adds no semantic value for parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool lists all SLO corrections (status adjustments) across the organization, specifying it includes maintenance windows and planned downtime exclusions. It distinguishes itself from sibling tools like get-slo and get-slo-history by focusing specifically on corrections.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives. The description does not mention prerequisites, limitations, or when not to use it. Sibling tools exist (e.g., search_slos) but no comparison is provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-slo-historyA

Get historical SLO data over a time range. Use after get-slo to see 'SLO performance last 30 days', 'error budget consumption over time', or 'SLI trend for checkout service'. Returns SLI values, thresholds, and time range data.

ParametersJSON Schema
NameRequiredDescriptionDefault
sloIdYesThe SLO ID
fromTsYesStart time as Unix epoch seconds
toTsYesEnd time as Unix epoch seconds
targetNoSLO target percentage for calculations

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, so description must disclose behavior. It mentions return data (SLI values, thresholds, time range) but does not cover side effects (none expected, as read-only), rate limits, or detailed behavior like whether it aggregates data. Adequate but minimal.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences: first states the core function, second adds usage examples and output summary. No unnecessary words, front-loaded, efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Lacks output schema, so description should clarify return format. Mentions SLI values, thresholds, and time range, which covers key elements. For a simple historical query, this is reasonably complete, though details on data points or aggregation could improve completeness.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Input schema already describes all 4 parameters with 100% coverage (e.g., 'Start time as Unix epoch seconds'). Description adds contextual usage ('Use after get-slo') but no additional parameter meaning beyond schema. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states it retrieves historical SLO data over a time range, with specific example queries (e.g., 'SLO performance last 30 days'). Distinguishes from sibling 'get-slo' which gets a single SLO's details and 'get-slos' which lists SLOs.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Suggests using it after get-slo, providing context for typical use cases. However, lacks explicit when-not-to-use or alternative tools (e.g., when to use search_slos instead). The guidance is helpful but not exhaustive.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-slosA

List Service Level Objectives (SLOs). Use for 'show all SLOs', 'SLOs for team platform', 'which SLOs are at risk'. Returns SLO names, targets, and current status. Use get-slo for detailed error budget and history of a specific SLO.

ParametersJSON Schema
NameRequiredDescriptionDefault
idsNoComma-separated list of SLO IDs to fetch
queryNoSearch SLOs by name
tagsQueryNoFilter by tags (e.g., 'team:platform,env:prod')
metricsQueryNoFilter by metrics used in SLO
limitNoNumber of SLOs to return
offsetNoPagination offset

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description bears full responsibility. It implies a read-only list operation but does not disclose pagination behavior, rate limits, or any other constraints. The mention of returned fields (names, targets, status) adds some transparency but leaves gaps.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences totaling about 30 words, front-loading the purpose and then providing behavioral cues and sibling reference. Every sentence adds value, and there is no superfluous content.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the 6 parameters and no output schema, the description provides a reasonable overview of functionality and return content. It mentions query examples and a sibling for detail, but lacks details on pagination (limit/offset) and response format, leaving minor gaps.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% as all parameters have descriptions. The tool description does not add significant meaning beyond the schema, such as default values or formatting details. Baseline of 3 is appropriate given the schema already covers parameter semantics.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it lists SLOs with specific examples of queries ('show all SLOs', 'SLOs for team platform', 'which SLOs are at risk'). It also mentions what information is returned (names, targets, current status) and distinguishes from sibling 'get-slo' for detailed info.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides example use cases and explicitly references an alternative tool ('get-slo') for detailed error budget and history. However, it does not mention other sibling tools like 'search_slos' or provide explicit when-not-to-use guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-spans-metricsA

Get all span-based metric configurations from APM

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A3.6/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are present, and the description fails to disclose any behavioral traits such as read-only nature, side effects, or permissions. The verb 'Get' implies reading, but explicit confirmation is missing.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise with a single, front-loaded sentence. Every word serves the purpose, with no extraneous information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the absence of parameters and output schema, the description adequately conveys the tool's function. However, it could mention the expected return format or that it returns a list.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

There are no parameters, and schema coverage is 100%. The description implicitly conveys that no input is required, which aligns with the baseline for zero-parameter tools.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the specific verb 'Get', the resource 'span-based metric configurations', and the source 'from APM'. It distinguishes from siblings like 'get-logs-metrics' and 'list_spans_metrics' by focusing on span-based metrics.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives. There is no mention of prerequisites, context, or exclusions, leaving the agent without decision-making support.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-synthetic-resultsA

Get execution results for a specific Synthetic test. Use after get-synthetic-tests to see pass/fail history, response times, and probe locations. Returns individual check results with timing data.

ParametersJSON Schema
NameRequiredDescriptionDefault
publicIdYesThe synthetic test's public ID
fromTsNoStart timestamp (Unix epoch milliseconds)
toTsNoEnd timestamp (Unix epoch milliseconds)
probeDcNoFilter by probe datacenter locations

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are present, so the description must carry the behavioral information. It mentions returning 'individual check results with timing data' and 'pass/fail history' but does not disclose authentication needs, rate limits, or whether it is read-only. This is adequate but not thorough.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is three sentences, each adding distinct value: stating purpose, usage context, and return contents. No redundancy; perfectly front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema, the description adequately explains what is returned (pass/fail, response times, probe locations). It also provides usage context. Minor gaps like pagination or limits prevent a perfect score.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

All 4 parameters have descriptions in the input schema (100% coverage). The description adds no additional parameter meaning beyond the schema, so it meets the baseline of 3.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action (Get), the resource (execution results for a specific Synthetic test), and differentiates from siblings like get-synthetic-tests by specifying it returns results for one test.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly says 'Use after get-synthetic-tests to see pass/fail history...', providing clear usage context and ordering. It does not list alternatives or when not to use, but the guidance is helpful.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-synthetic-testsA

List Datadog Synthetic tests (API and browser). Use for 'show all synthetic tests', 'what API tests exist', or 'which tests are failing'. Returns test names, types, status, locations, and tags.

ParametersJSON Schema
NameRequiredDescriptionDefault
pageSizeNoNumber of tests per page
pageNumberNoPage number for pagination
typeNoFilter by test type ('api' or 'browser')
locationsNoComma-separated location filter

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description partially covers behavior by listing returned fields (names, types, status, locations, tags), but lacks detail on pagination, ordering, or read-only nature. It neither contradicts nor fully discloses behavioral traits.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences long, front-loads the core purpose, and includes example queries without unnecessary words, making it highly concise and structured.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema, the description explains returned fields (names, types, status, locations, tags). It implicitly covers filtering by type and locations but omits pagination behavior and error cases, which are minor gaps for a listing tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with descriptions for all 4 parameters. The description adds no new parameter-level semantics beyond what the schema provides, so baseline 3 is appropriate; the mention of returned fields improves overall understanding but does not directly enhance parameter semantics.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'List Datadog Synthetic tests' with specific verb and resource, and includes examples like 'show all synthetic tests' and 'which tests are failing', distinguishing it from sibling tools that focus on different resources.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides explicit usage examples ('show all synthetic tests', 'what API tests exist', 'which tests are failing') but does not mention when to avoid using this tool or suggest alternatives, which is acceptable given its distinct purpose.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_top_avg_metricsC

Get top custom metrics by average hourly count for cost and cardinality analysis

ParametersJSON Schema
NameRequiredDescriptionDefault
monthNo
dayNo
namesNo
limitNo
next_record_idNo

TDQS

C2.6/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided; description only states purpose without detailing behavioral traits such as pagination (next_record_id), read-only nature, or rate limits. Agent cannot infer important behavior.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, no unnecessary words; adequate conciseness but could benefit from structured clarity given parameter complexity.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given complexity of 5 undocumented parameters and no output schema, the description is insufficient for agent to use correctly. Missing parameter semantics and output details.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Input schema has 5 parameters with 0% schema description coverage, and description adds no parameter explanations. Agent lacks guidance on how to use month, day, names, limit, next_record_id.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the tool retrieves top custom metrics by average hourly count for cost and cardinality analysis, but does not differentiate from sibling tools like get-metrics, query-metrics, etc.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives; lacks context on appropriate scenarios or prerequisites.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-traceA

Get all spans for a specific trace ID. Use after search-spans to see the full request flow across services. Returns all spans in the trace with timing, service, resource, and error information.

ParametersJSON Schema
NameRequiredDescriptionDefault
traceIdYesThe trace ID to retrieve (hexadecimal string)
fromNoStart time (defaults to 'now-1h')
toNoEnd time (defaults to 'now')

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Describes return content ('timing, service, resource, and error information') but does not disclose potential behavioral traits like pagination, limits, or side effects. With no annotations, the description provides adequate but not comprehensive transparency.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two concise sentences: first states purpose, second provides usage context and return information. No redundant or unnecessary text.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given 3 parameters and no output schema, the description explains what is returned and when to use. It leverages schema descriptions for parameters. Could mention ordering or limits, but overall complete for typical use.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% and each parameter has a description in the schema. The description does not add further meaning to the parameters (e.g., explains traceId is required, from/to are optional with defaults). Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states 'Get all spans for a specific trace ID.' and distinguishes from sibling search-spans by explaining it is used after search-spans to see the full request flow. Defines specific verb and resource.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicitly tells when to use: 'Use after search-spans to see the full request flow across services.' Provides clear context, though it does not explicitly mention when not to use or list alternatives beyond search-spans.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-usageA

Get hourly usage data by product family. Use for 'how many infra hosts this month', 'log ingestion volume', 'APM usage trends'. Returns usage records with timestamps for billing and capacity planning.

ParametersJSON Schema
NameRequiredDescriptionDefault
startHrYesStart time ISO8601 (e.g., '2024-01-01T00:00:00+00:00')
endHrNoEnd time ISO8601
productFamiliesNoComma-separated families (e.g., 'infra_hosts,logs,apm')
pageLimitNoMax records to return
pageNextRecordIdNoPagination cursor

TDQS

A3.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, yet the description does not disclose behavioral traits such as read-only nature, pagination behavior, rate limits, or authentication requirements. It only mentions return of timestamps for billing.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two concise sentences: the first states the core action, the second provides examples and return context. No extraneous information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description hints at return values (timestamps for billing) but does not explain pagination parameters or response structure. Given 5 parameters and no output schema, more detail would be beneficial.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the description adds minimal value beyond the schema. It mentions 'by product family' but that is already covered by the 'productFamilies' parameter.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool retrieves hourly usage data by product family, with concrete examples like 'how many infra hosts this month' and 'APM usage trends'. It effectively distinguishes from siblings by specifying the scope and return value.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides explicit use cases but does not differentiate from the similar sibling 'get_hourly_usage'. No when-not-to-use guidance is given, which may cause confusion among similar tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_api_keysC

List Datadog API keys for key management and security audit

ParametersJSON Schema
NameRequiredDescriptionDefault
page_sizeNoNumber of keys per page
page_numberNoPage number
filterNoFilter by key name
sortNoSort field

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description must convey behavioral traits. It only says 'List' and 'for key management and security audit', implying a read operation but omitting specifics such as authentication requirements, pagination behavior, or any potential side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence, concise and front-loaded. While it could include more detail, it efficiently conveys the tool's purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the absence of an output schema, the description should clarify what is returned. It does not mention the response format or that API keys are sensitive. Additionally, it fails to differentiate from many similar sibling list tools.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so baseline is 3. The description adds no additional meaning to the parameters (page_size, page_number, filter, sort) beyond what the schema already provides.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool lists Datadog API keys, with a specific purpose of key management and security audit. However, it does not differentiate from the sibling tool 'list_app_keys', which is similar but for application keys.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives like list_app_keys or other list tools. The description only states the purpose, leaving the agent to infer usage context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_app_keysC

List application keys for the current user. Shows key names, scopes, and creation dates.

ParametersJSON Schema
NameRequiredDescriptionDefault
page_sizeNo
page_numberNo
sortNo
filter_nameNo

TDQS

C2.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must fully disclose behavioral traits. It states what is shown (key names, scopes, creation dates) but omits important details like whether it is read-only, pagination behavior, authentication requirements, or if it lists only active keys. The description is too sparse for a tool with no annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is very short (two sentences) and front-loads the purpose. However, it omits critical information, making it under-specified rather than efficiently concise. A bit more detail could be added without sacrificing conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has 4 optional parameters and no output schema, the description should cover pagination, filtering, sorting, and return structure. It mentions the fields returned but misses pagination details and parameter usage. Incomplete for a list tool of moderate complexity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 4 parameters (page_size, page_number, sort, filter_name) with 0% description coverage, and the description provides no guidance on their meaning or usage. The agent receives no help on how to correctly invoke the parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool lists application keys for the current user, specifying the resource (application keys) and scope (current user). However, it does not explicitly differentiate from the sibling tool 'list_api_keys', which could cause confusion.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool vs alternatives, such as when to use list_app_keys over list_api_keys or search tools. There are no exclusions or best practices mentioned.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_authn_mappingsB

List authentication mappings (SAML/OIDC). Shows how identity provider attributes map to Datadog roles.

ParametersJSON Schema
NameRequiredDescriptionDefault
page_sizeNo
page_numberNo
sortNo
filter_queryNo

TDQS

B3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full burden. It only states 'List' which implies read-only, but does not disclose pagination behavior, authentication requirements, rate limits, or any side effects. Additional behavioral context is needed.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is very concise with two short sentences, no unnecessary words. However, it sacrifices completeness for brevity, missing parameter and behavioral details.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no annotations, no output schema, and 0% schema parameter coverage, the description is insufficient. It does not explain return values, pagination, or parameter roles, making it incomplete for a tool with 4 parameters.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema has 4 parameters (page_size, page_number, sort, filter_query) with 0% description coverage. The tool description does not mention any parameters or explain their semantics, leaving the agent without guidance on how to use them.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'List' and the resource 'authentication mappings' with specific context (SAML/OIDC) and explains what they are (maps identity provider attributes to Datadog roles). It distinguishes from sibling list tools which cover different resources.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool vs alternatives, nor any when-not-to-use advice. The purpose implies usage for viewing auth mappings, but lacks comparative context with other list tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_aws_accountsB

List AWS accounts integrated with Datadog

ParametersJSON Schema
NameRequiredDescriptionDefault
aws_account_idNoFilter by AWS account ID

TDQS

B3.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, and the description lacks details such as authentication requirements, rate limits, or whether it returns all accounts or supports pagination.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single, clear sentence that is appropriately sized for a simple list tool; no wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple list tool with one optional parameter and no output schema, the description lacks information on return format or pagination, but is minimally adequate.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description covers the parameter fully ('Filter by AWS account ID'), and the tool description adds no additional meaning; baseline score of 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states action (List) and resource (AWS accounts integrated with Datadog), distinguishing it from other list tools targeting different integrations.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool vs. alternatives like list_azure_integration or list_gcp_integration; usage is implied by the name but not stated.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_azure_integrationA

List Azure integration accounts connected to Datadog.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A3.9/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must disclose behavior. It implies a read-only list operation but doesn't explicitly state side effects, authentication needs, or outcome details. Adequate for a simple list with no parameters.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that directly conveys the purpose without any redundant words. It is front-loaded and efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with no parameters and no output schema, the description is complete. It clearly identifies the resource type and action, and the sibling list tools provide context for differentiation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool has zero parameters, and the input schema is fully covered (100%). The description adds no parameter information, which is acceptable since there are none. Baseline 4 applies for zero-parameter tools.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action 'List' and the specific resource 'Azure integration accounts connected to Datadog', distinguishing it from siblings like list_aws_accounts or list_gcp_integration.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus similar list tools. The description doesn't mention when-not or prerequisites, leaving the agent to infer from the name alone.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-ci-pipelinesB

List CI pipeline events (pipeline runs/executions). Use for 'recent CI builds', 'failed pipelines', 'CI pipeline status', 'deployment history'.

ParametersJSON Schema
NameRequiredDescriptionDefault
filterQueryNoQuery to filter pipeline events
filterFromNoStart time (ISO 8601)
filterToNoEnd time (ISO 8601)
pageLimitNoMax results per page
pageCursorNoPagination cursor
sortNoSort field

TDQS

B3.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided. The description does not disclose behavioral traits such as whether the operation is read-only, pagination behavior, rate limits, or side effects. Only a list of example queries is given.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise: one sentence defining the tool plus a list of example use cases. No redundant information, though the use cases could be integrated into a single sentence for tighter structure.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Covers the core purpose and example queries but lacks details on behavior such as pagination (despite pageLimit and pageCursor), sorting, or the difference from similar tools. Missing output schema and annotations leave gaps.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with all six parameters described in the input schema. The description does not add any extra meaning or context beyond what the schema already provides (e.g., filterQuery, filterFrom, filterTo, pageLimit, pageCursor, sort).

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states the verb 'List' and resource 'CI pipeline events' (pipeline runs/executions). Provides specific use cases like 'recent CI builds' and 'failed pipelines', distinguishing it from sibling tools such as 'get-ci-pipeline-events' (likely single event) and 'list_ci_tests'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Lists example use cases (e.g., 'recent CI builds', 'failed pipelines') indicating when to use. However, it does not provide when-not-to-use guidance or mention alternative tools like 'get-ci-pipeline-events' for single-pipeline queries or 'search_ci_test_events' for test-specific filtering.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_ci_testsA

List CI test events from Datadog CI Visibility. Filter by query, time range. Use for 'show failed tests', 'test results for service X'.

ParametersJSON Schema
NameRequiredDescriptionDefault
filter_queryNo
filter_fromNo
filter_toNo
page_limitNo
page_cursorNo
sortNo

TDQS

A3.6/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, so the description must carry the full burden. It mentions listing and filtering but omits behavioral traits such as pagination, rate limits, or read-only nature. The description lacks depth on how the tool behaves.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two efficient sentences with front-loaded purpose. Every sentence adds value, no fluff.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Covers basic purpose and use cases, but with 6 parameters, no output schema, and no annotation support, it leaves gaps in pagination, sorting, and output details. Adequate for a simple list tool but not fully complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%. The description adds meaning for 'filter_query', 'filter_from', and 'filter_to' by referencing 'query' and 'time range', but does not explain 'page_limit', 'page_cursor', or 'sort'. Given low coverage, more detail is needed.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states the action (List), resource (CI test events from Datadog CI Visibility), and filtering capabilities. The mention of use cases like 'show failed tests' differentiates from sibling tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Provides explicit use cases ('show failed tests', 'test results for service X'), giving clear context. However, it does not specify when to avoid this tool or mention alternatives like search_ci_test_events.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_cloudflare_accountsA

List Cloudflare accounts integrated with Datadog for monitoring CDN and edge performance.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A3.8/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must carry the full burden of behavioral disclosure. It only states the tool 'lists accounts', but does not mention return format, schema, pagination, rate limits, or whether the operation is read-only. Important behavioral details are omitted.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, grammatically complete sentence that immediately conveys the tool's purpose. It is front-loaded and contains no superfluous words, earning a high conciseness score.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a parameterless tool with no output schema, the description adequately explains what the tool does and the context (Cloudflare accounts integrated with Datadog, for CDN/edge monitoring). It could optionally mention that the output is likely a list of account IDs/names, but the current level is sufficient for a simple list operation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

There are zero parameters, and schema coverage is 100% (trivially). Per guidelines, baseline is 4. The description adds value by specifying the integration context and monitoring purpose, which complements the empty schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly specifies the tool lists Cloudflare accounts integrated with Datadog for monitoring CDN and edge performance. It uses a specific verb ('list') and resource ('Cloudflare accounts'), and distinguishes from sibling tools like list_aws_accounts or list_azure_integration by naming the integration partner.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for retrieving Cloudflare account listings, but does not provide explicit guidance on when to use this tool versus alternatives (e.g., list_aws_accounts) or specify prerequisites (e.g., Datadog-Cloudflare integration must be configured). No when-not-to-use or exclusion criteria are stated.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_confluent_accountsA

List Confluent Cloud accounts integrated with Datadog for monitoring Kafka clusters.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, and the description does not disclose any behavioral traits such as authentication needs, rate limits, or side effects. For a read operation, it adds minimal context beyond the obvious.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

One sentence, 13 words, front-loaded with verb and resource. No wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple parameterless list tool, the description is sufficient to understand what is returned. Could mention prerequisites, but not strictly necessary.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With zero parameters, the description implicitly states no filtering is needed. Baseline for 0 params is 4, and the description adds clarity by specifying 'integrated with Datadog'.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'list' and the resource 'Confluent Cloud accounts integrated with Datadog for monitoring Kafka clusters', making the tool's purpose specific and distinct from sibling tools like list_aws_accounts.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The context is clear: use to list Confluent Cloud accounts. However, no explicit guidance on when not to use or alternatives, though the tool's specificity implies its niche.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_containersC

List Datadog-monitored containers with their metadata and health status

ParametersJSON Schema
NameRequiredDescriptionDefault
filter_tagsNoFilter by tags (e.g. env:prod)
group_byNoGroup results by field
sortNoSort field
page_sizeNoPage size
page_cursorNoPagination cursor

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must disclose behavioral traits, but it only states the action and output. It does not mention pagination, read-only nature, or any side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that conveys the core function without unnecessary words. It is appropriately concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has 5 parameters and no output schema or annotations, the description is incomplete. It lacks details on filtering, pagination, typical use cases, and output format.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the schema provides sufficient parameter descriptions. The description adds no additional context beyond the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it lists Datadog-monitored containers with metadata and health status. However, it does not differentiate from the sibling tool 'get-containers', leaving ambiguity about when to use which.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives like get-containers or other list tools. There is no mention of prerequisites or context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_cost_budgetsC

List cloud cost management budgets for tracking team spending

ParametersJSON Schema
NameRequiredDescriptionDefault
page_sizeNo
page_offsetNo

TDQS

C2.8/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, and description only states it 'lists' budgets. No disclosure of return format, pagination behavior, permissions needed, or whether it supports filtering. Minimal behavioral info.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence is concise and front-loaded with purpose. However, could be slightly expanded to include parameter hints without becoming verbose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a list tool with two optional parameters and no output schema, description omits return type, pagination explanation, and prerequisites. Incomplete for an agent to use effectively without additional context.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, and description does not mention the two pagination parameters (page_size, page_offset). The agent gets no parameter guidance beyond the schema itself, which lacks descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states verb 'List' and specific resource 'cloud cost management budgets', distinguishing it from sibling tools like get_estimated_cost which deals with cost estimation, not budgets.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives, such as when to list budgets vs. get estimated costs. Context of use is implied but not explicit.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_csm_threats_agent_rulesC

List CSM Threats agent rules for workload security monitoring

ParametersJSON Schema
NameRequiredDescriptionDefault
page_sizeNo
page_numberNo

TDQS

C2.7/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided. The description does not disclose whether the operation is read-only, safe, or what the return format is. No mention of rate limits, ordering, or default values for parameters.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence and front-loaded. It is concise but lacks explanatory depth. There is no waste, but it fails to provide sufficient detail for effective tool use.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema and minimal parameter info, the description is incomplete. It does not explain what the output contains, how pagination works, or any specifics about the agent rules. For a simple list tool, more detail is needed.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% with two parameters (page_size, page_number) lacking any description. The tool description adds no explanation of these parameters, their valid ranges, or defaults.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action 'List' and the resource 'CSM Threats agent rules' with context 'for workload security monitoring'. It distinguishes from other list tools by specifying a unique resource type, which is not repeated among siblings.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives. No mention of prerequisites, default behavior, or pagination limits. The description lacks context for when to choose this over other list tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-dashboard-listsA

List all custom dashboard lists. Use for 'what dashboard lists exist', 'organized dashboards', 'dashboard collections'.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, and the description lacks any behavioral details such as read-only nature, performance characteristics, or permissions required.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two concise sentences with no redundant information, front-loading the core purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (no parameters, no output schema), the description covers the essential information adequately.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has no properties, so the description adds context that the tool lists custom dashboard lists, which is helpful beyond the empty schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states the tool lists all custom dashboard lists, with specific example queries. It clearly identifies the resource and action.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides example use cases, helping the agent know when to invoke. However, it does not differentiate from other list-* siblings explicitly.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_dora_deploymentsB

List DORA metric deployments for tracking deployment frequency and lead time

ParametersJSON Schema
NameRequiredDescriptionDefault
filter_fromNo
filter_toNo
filter_serviceNo
filter_envNo
page_sizeNo
page_cursorNo

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must disclose behavioral traits. It only states the tool lists deployments, without mentioning read-only nature, authentication requirements, rate limits, or any side effects. This leaves the agent uninformed about safe usage.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence of 10 words, efficiently conveying the purpose. No fluff or redundancy exists; every word adds value.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has 6 parameters, no output schema, and no annotations, the description is too sparse. It does not explain pagination, filtering, or what the return data looks like. More context is needed for an agent to use it effectively.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 6 parameters with 0% schema description coverage. The description adds no information about parameters, such as expected formats, valid values, or purposes. The parameter names (e.g., filter_from, page_cursor) are suggestive but insufficient for correct invocation.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the tool lists DORA metric deployments for tracking deployment frequency and lead time. It specifies both the action (list) and the resource (DORA deployments), distinguishing it from other list tools in the sibling set.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit when-to-use or when-not-to-use guidance is given. The description implies usage for DORA metric tracking, but lacks exclusions or alternatives. Since no sibling tool covers DORA deployments, the context is understood but not stated.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_downtime_schedulesC

List scheduled downtimes (v2 API). Filter by current/upcoming schedules. Shows muted monitors, scopes, and schedule details.

ParametersJSON Schema
NameRequiredDescriptionDefault
page_limitNo
page_offsetNo
current_onlyNo

TDQS

C2.7/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must convey behavioral traits. It mentions the API version and filtering, but does not disclose side effects, authentication requirements, rate limits, or pagination behavior. The read-only nature is implied but not explicit.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise with two sentences: the first states the primary function, the second adds key features. No unnecessary words or fluff.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema, no annotations, and three parameters, the description is incomplete. It lacks parameter documentation, return format details, and differentiation from similar tools like get-downtimes. The context of pagination is hinted but not explained.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0% and the description does not explain any of the three parameters (page_limit, page_offset, current_only). The mention of 'filter by current/upcoming schedules' loosely maps to current_only but lacks detail. The description adds no value for parameter understanding.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'List' and resource 'scheduled downtimes' (v2 API), and indicates what information is provided (muted monitors, scopes, schedule details). However, it does not explicitly differentiate from the sibling tool 'get-downtimes', which may cause confusion.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description mentions filtering by 'current/upcoming schedules' but provides no guidance on when to use this tool versus alternatives like 'get-downtimes'. No explicit when-to-use or when-not-to-use context is given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_fleet_agentsC

List Datadog fleet agents with version, OS, and status information

ParametersJSON Schema
NameRequiredDescriptionDefault
page_sizeNo
page_cursorNo
filter_queryNo

TDQS

C2.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, and the description does not disclose behavioral traits such as read-only nature, rate limits, or data scoping. The agent cannot infer safety or side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence and not verbose, but it lacks necessary details. It is concise but at the expense of completeness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With 3 optional parameters and no output schema, the description is too brief. It does not explain pagination, structure of results, or edge cases, leaving the agent underinformed.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, yet the description adds no explanation for the three parameters (page_size, page_cursor, filter_query). The agent must guess their semantics, which is insufficient.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'List Datadog fleet agents with version, OS, and status information', specifying both the action (list) and the resource (fleet agents) along with returned fields. It differentiates from many sibling tools that target different resources, though it does not explicitly exclude similar list tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives, nor does it mention pagination, filtering, or any prerequisites. It simply states the function without usage context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_gcp_integrationA

List Google Cloud Platform integration accounts connected to Datadog.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A3.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden. It only states the tool lists accounts, but does not disclose behavior like pagination, ordering, result format, or whether the list is complete. This is insufficient for an agent to fully understand the tool's behavior.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence with no wasted words. It is front-loaded and efficiently communicates the tool's purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description is brief but covers the core purpose. However, given no output schema and many similar list tools, it lacks details on what fields are returned or any limitations (e.g., only active accounts). Still, for a simple list operation, it is minimally adequate.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

There are zero parameters, and schema description coverage is 100% (vacuous). The description adds no parameter info because none exist. Baseline for zero parameters is 4, and the description is adequate for a no-param tool.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'List' and the specific resource 'Google Cloud Platform integration accounts connected to Datadog'. It distinguishes from siblings like list_aws_accounts and list_azure_integration by explicitly naming GCP.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool vs alternatives. With many sibling list_* tools, the description does not provide context such as prerequisites, permissions, or scenarios where this tool is preferred.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_host_totalsA

Get the total number of active and up hosts in your Datadog account. Quick health check for infrastructure scale.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A3.7/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must carry the full burden. It mentions 'active and up hosts' but does not disclose read-only nature, data freshness, or performance characteristics. Minimal behavioral context.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences, front-loaded with the main action. No redundant words. Efficient and clear.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Adequately describes purpose and scope but lacks details on output format (e.g., returns JSON with active and up counts). No disambiguation from sibling get-active-hosts-count. Could be more complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Input schema has zero parameters with 100% coverage. Description adds value by clarifying that the counts are for 'active and up hosts', but no additional parameter explanation needed. Baseline 4.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it gets the total number of active and up hosts, serving as a quick health check. It uses specific verb 'Get' and resource 'total hosts', differentiating from siblings like get-hosts which returns detailed host lists.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies use for quick health checks ('Quick health check for infrastructure scale') but does not explicitly contrast with alternatives like get-active-hosts-count. No guidance on when not to use.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_logs_metricsB

List all log-based metrics configured for generating custom metrics from log data.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

There are no annotations, and the description does not disclose any behavioral traits such as permissions, rate limits, or side effects. It only states the basic action.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence, which is concise and front-loaded. It could benefit from additional structure or bullet points, but it is efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (no parameters, no output schema), the description provides the essential purpose. However, it lacks any details about return format or potential limitations, which would be helpful.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool has 0 parameters, so the description naturally cannot add parameter details. According to guidelines, the baseline is 4, which is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it lists all log-based metrics with added context about generating custom metrics. However, it does not distinguish from the sibling tool 'get-logs-metrics' which likely retrieves a single metric.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives, especially the closely named 'get-logs-metrics'. No when-not or exclusions are mentioned.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_metric_tag_configsC

List metric tag configurations. Filter by configured status, tags, activity window.

ParametersJSON Schema
NameRequiredDescriptionDefault
filter_configuredNo
filter_tags_configuredNo
filter_metricNo
filter_active_withinNo
window_secondsNo
page_sizeNo
page_cursorNo

TDQS

C2.7/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are present. The description only mentions filtering, omitting details like pagination, idempotency, or response structure. Behavioral traits such as whether the list is paginated or ordered are left unspecified.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence that efficiently states the core function. It is front-loaded with the verb 'List' and resource, but could benefit from a bit more structure (e.g., bullet points for filters).

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema and no annotations, the description is incomplete. It overlooks pagination parameters, the filter_metric parameter, and does not indicate the output format or any constraints. For a 7-parameter tool, more context is needed.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 0% schema coverage, the description adds some meaning by mentioning 'configured status, tags, activity window', which loosely map to parameters like filter_configured, filter_tags_configured, and filter_active_within. However, it does not explain all 7 parameters (e.g., filter_metric, window_seconds, page_size, page_cursor) and lacks detail.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'List metric tag configurations' with filtering options, distinguishing it from sibling tools like 'get_metric_tag_config' (singular) which retrieves a single config. However, the exact nature of 'metric tag configurations' is not further explained.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives (e.g., get_metric_tag_config for a single config). The mention of filtering is implied but no explicit when-to-use or when-not-to-use advice.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_monitor_notification_rulesC

List monitor notification routing rules showing who gets alerted

ParametersJSON Schema
NameRequiredDescriptionDefault
page_sizeNo
page_offsetNo

TDQS

C2.8/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries full burden for behavioral traits but fails to mention pagination, ordering, rate limits, or authentication. The existence of pagination parameters in the schema is not acknowledged.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence with no redundancy. However, it could be slightly expanded to include parameter context without sacrificing conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema and a simple list operation, the description should at least mention that the tool returns a paginated list of rules. It lacks completeness for effective use.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% and the description does not explain the parameters. Agents cannot infer the meaning of page_size and page_offset from the description alone.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action (List) and the resource (monitor notification routing rules) and specifies the outcome (showing who gets alerted). It distinguishes this tool from sibling tools like list_monitors or list_downtime_schedules.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives. Sibling tools include many list tools, but no comparisons or exclusions are mentioned.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_network_devicesB

List network devices monitored by Datadog NDM with filtering and pagination

ParametersJSON Schema
NameRequiredDescriptionDefault
page_sizeNo
page_numberNo
filter_tagNo
sortNo

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must disclose behavioral traits. It mentions filtering and pagination but does not elaborate on how they work, what happens with large result sets, rate limits, or that the operation is read-only (implicit but not stated). The description is too terse to provide adequate transparency.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence with no filler words. It is front-loaded with the verb and resource and efficiently conveys the core purpose and features. Every word earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema is provided, and the description does not mention return format, field details, or usage examples. For a list tool with four optional parameters and no required fields, the description lacks enough context to fully specify tool behavior. It leaves agents guessing about how to effectively use filtering and pagination.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate. It connects 'filtering' to filter_tag and 'pagination' to page_size/page_number, and implies sort is used for sorting. This adds some meaning beyond bare names, but does not explain valid values, format, or default behavior. A score of 3 reflects marginal added value.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'List', the specific resource 'network devices monitored by Datadog NDM', and mentions key features 'filtering and pagination'. It effectively distinguishes from the many sibling list tools that target different resources (e.g., list_containers, list_workflows).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives. While the resource name implies its domain, there is no mention of prerequisites, when not to use it, or comparison with other list tools. The description is purely declarative.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_notebooksC

List Datadog notebooks (investigation documents, runbooks, postmortems)

ParametersJSON Schema
NameRequiredDescriptionDefault
queryNoSearch query for notebook name
countNoNumber of notebooks to return
startNoOffset for pagination
sort_fieldNoField to sort by (e.g. modified)
sort_dirNoSort direction (asc or desc)
author_handleNoFilter by author handle

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must cover behavior. It only says 'List', without disclosing pagination, filtering behavior, or any side effects. The agent is left to infer from the schema.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence with no wasted words, including helpful parenthetical context. It is front-loaded and efficient, though very brief.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With 6 parameters, no output schema, and no annotations, the description is incomplete. It fails to explain return values, pagination behavior, or how parameters interact, leaving significant gaps for the agent.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the schema already describes all parameters. The description adds no additional meaning beyond the schema. Baseline 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool lists Datadog notebooks and defines what notebooks are (investigation documents, runbooks, postmortems). However, it does not differentiate from the sibling tool 'get-notebooks', which may perform a similar function.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives like 'get-notebooks' or other listing tools. There is no mention of prerequisites, use cases, or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-permissionsB

List all available permissions in Datadog

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description should disclose behavioral traits such as read-only status, authentication requirements, or rate limits. It states only 'List all available permissions', which implies a read operation but lacks explicit confirmation or any behavioral caveats.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise with a single sentence and four words. It is front-loaded with the action and resource, but could benefit from slightly more context without sacrificing brevity.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple list tool with no parameters and no annotations, the description provides the minimum viable information. It does not describe output format or any side effects, but given the simplicity, it is adequate yet leaves room for improvement.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has no parameters (100% coverage), so the description does not need to add parameter details. The baseline for zero parameters is 4, and the description meets that expectation.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'List' and the resource 'all available permissions', distinguishing it from sibling list tools for other resources like users or roles. However, it does not explicitly differentiate its scope from similar permissions-related tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when or why to use this tool over alternatives. The description only states the function, leaving it to the agent to infer usage context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-posture-findingsC

List legacy CSPM/CIEM posture management findings (misconfigurations and identity risks). Useful for compliance use-cases. Requires the security_monitoring_findings_read scope.

ParametersJSON Schema
NameRequiredDescriptionDefault
filterNo
pageNo
snapshotTimestampNo
detailedFindingsNo
limitNo

TDQS

C2.7/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, so description must fully disclose behavior. It only mentions the required scope and that findings are 'legacy'. Does not mention pagination, rate limits, idempotency, or error scenarios, leaving significant gaps for an agent.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three sentences, each serving a distinct purpose: what it does, when to use it, and a requirement. No fluff, front-loaded with the core action.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the complexity (5 parameters, nested filter object, no output schema, no annotations), the description is too sparse. It lacks details on filtering options, pagination, output format, and behavioral implications, making it incomplete for an agent to use effectively.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% and the description does not explain any of the 5 parameters (filter, page, snapshotTimestamp, detailedFindings, limit). The description adds no meaning beyond the schema structure.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states it lists legacy CSPM/CIEM findings (misconfigurations and identity risks) and mentions compliance use-cases. Differentiates from siblings like 'search-security-findings' by implying this is a list operation, but does not explicitly contrast.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Only provides vague usage advice ('useful for compliance use-cases') and a scope requirement. No explicit guidance on when to use this vs alternatives (e.g., 'search-security-findings'), no when-not-to-use, and no prerequisites beyond the scope.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-processesA

List running processes with optional filtering by search term or tags. Use for 'what processes are running', 'find java processes', 'process list for host'.

ParametersJSON Schema
NameRequiredDescriptionDefault
searchNoSearch term to filter processes
tagsNoComma-separated tags to filter
fromNoStart timestamp (Unix seconds)
toNoEnd timestamp (Unix seconds)
pageLimitNoMax results per page
pageCursorNoPagination cursor

TDQS

A3.9/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description states 'List running processes', indicating a read operation. No annotations are provided, so the description carries the full burden. It does not mention auth requirements, side effects, or the scope of processes (e.g., all hosts vs current host). The example 'process list for host' implies host filtering, but no host parameter exists, which could be misleading.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence followed by a list of three concrete example use cases. Every part is informative without redundancy, and the examples are front-loaded for quick understanding. No wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description explains the core function and provides examples, but given the tool has 6 optional parameters, no output schema, and no annotations, more detail is needed. It omits what is returned, the default scope (e.g., all processes on the current host?), and how pagination works. The sibling list includes many similar list tools, so differentiation could be stronger.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema covers all 6 parameters with descriptions (100% coverage), so the schema already details each parameter. The description adds value by highlighting the primary filter capabilities ('search term or tags'), but does not explain time range or pagination parameters. This provides marginal additional context beyond schema, resulting in a baseline score of 3.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb ('List'), resource ('running processes'), and scope ('with optional filtering by search term or tags'). Examples like 'what processes are running' and 'find java processes' further clarify the function, distinguishing it from sibling list tools like list-containers or list-hosts.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description includes practical example queries ('what processes are running', 'find java processes', 'process list for host'), which implicitly guide when to use the tool. However, it lacks explicit instructions on when not to use it or alternatives, such as using get-hosts for host-level information.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_restriction_policiesC

Get restriction policy for a specific resource. Shows access control bindings and principals.

ParametersJSON Schema
NameRequiredDescriptionDefault
resource_idYes

TDQS

C2.8/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Without annotations, the description only implies a read operation. No disclosure of authentication needs, rate limits, or other behavioral traits beyond 'Get'.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two concise sentences that front-load the core purpose without any wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple single-parameter tool, the description covers the basic functionality but omits details on output format, pagination, or necessary permissions, leaving some gaps.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 0% schema description coverage and a single string parameter, the description adds no meaning beyond the schema. It does not explain the format or expected values of 'resource_id'.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool retrieves a restriction policy for a specific resource and shows access control bindings and principals. It uses a specific verb and resource, but does not differentiate from sibling tools like 'get_monitor_config_policies'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool over alternatives, no exclusions or context provided. The agent must infer usage from the name alone.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-rolesB

List RBAC roles in your Datadog organization

ParametersJSON Schema
NameRequiredDescriptionDefault
page_sizeNoNumber of roles per page
page_numberNoPage number
filterNoFilter roles by name

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description fully bears the burden of behavioral disclosure. It fails to mention pagination (page_size/page_number), filtering behavior, or the return format, leaving critical details unspecified.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise and front-loaded, stating the purpose in one sentence. However, it could include more useful information (e.g., pagination hints) without becoming verbose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple list tool without an output schema, the description should at least indicate that the result is a list or mention pagination behavior. It lacks sufficient context for an agent to fully understand the tool's output and usage.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the parameters are adequately documented in the schema. The description adds no extra meaning, but the baseline of 3 is appropriate given high coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action (List) and the resource (RBAC roles) within the Datadog organization. It is specific and distinct from sibling list tools that target other entities like users or permissions.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus other list tools (e.g., list-users, list-permissions) or alternative methods for retrieving roles. The agent must infer usage without context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-rum-applicationsA

List all RUM applications configured in Datadog. Use to discover which frontend apps are monitored, get application IDs for RUM queries, or see who created them. Companion to search-rum-events.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A3.8/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided; description does not disclose pagination, rate limits, or whether listing is complete in one call. For a list tool with no annotations, this is a significant gap.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three sentences with clear front-loading of purpose. No wasted words, but could include behavioral notes concisely.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Covers purpose and high-level output, but missing details on pagination, sorting, or any constraints. Adequate for simple list, but not fully comprehensive.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Input schema has zero parameters, so no param info needed. Description adds value by mentioning output fields (application IDs, creators), compensating for lack of output schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it lists all RUM applications in Datadog and provides specific use cases (discover monitored apps, get application IDs, see creators). It distinguishes from sibling 'search-rum-events' by calling itself a companion.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicitly describes when to use (discovery, obtaining IDs) and implies alternative via 'companion to search-rum-events'. Lacks explicit 'when not to use' but covers main use cases.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-scorecard-outcomesB

List scorecard rule evaluation outcomes for services

ParametersJSON Schema
NameRequiredDescriptionDefault
page_sizeNoNumber of results per page
page_offsetNoPage offset
filter_rule_idNoFilter by rule ID
filter_service_nameNoFilter by service name

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must disclose behavioral traits. It only states 'List' implying a read operation, but does not mention pagination, data freshness, permissions, or any side effects. This is insufficient for safe invocation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, well-structured sentence that front-loads the verb and resource. Every word is necessary and there is no fluff.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity and complete schema, the description is adequate but lacks any explanation of what a 'scorecard rule evaluation outcome' is or the typical usage pattern. No output schema exists, so more context on return format would be helpful.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 100% description coverage, so the baseline is 3. The description adds no additional parameter semantics beyond what the schema provides; it does not elaborate on how the filters affect results or the meaning of page size/offset.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states the verb 'List' and resource 'scorecard rule evaluation outcomes for services', clearly indicating what the tool does. It implicitly differentiates from sibling tool 'list-scorecard-rules' by specifying 'outcomes' rather than 'rules', but lacks explicit disambiguation.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool over alternatives, nor any context about prerequisites or typical use cases. The description is purely declarative without usage direction.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-scorecard-rulesC

List service scorecard rules for evaluating service quality

ParametersJSON Schema
NameRequiredDescriptionDefault
page_sizeNoNumber of results per page
page_offsetNoPage offset
filter_rule_idNoFilter by rule ID
filter_rule_nameNoFilter by rule name

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must carry the full burden of behavioral disclosure. It does not mention pagination behavior (though parameters hint at it), rate limits, ordering, or whether all rules are returned. The description is too brief.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence that directly states the purpose. It is not verbose, but could benefit from more structure or additional information without sacrificing brevity.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema and four parameters, the description is insufficient. It does not explain what is returned, how results are paginated, or any constraints. The sibling tool 'list-scorecard-outcomes' suggests a related resource but guidance is missing.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%; all four parameters have clear descriptions in the schema (page_size, page_offset, filter_rule_id, filter_rule_name). The tool description adds no additional meaning beyond these, so baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'List service scorecard rules for evaluating service quality', specifying the verb (list) and resource (scorecard rules). It distinguishes from the sibling tool 'list-scorecard-outcomes' implicitly by focusing on rules, but does not explicitly differentiate from other list tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives like 'list-scorecard-outcomes' or other list tools. There is no mention of prerequisites, filters, or context for usage, leaving the agent with implied usage only.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_security_monitoring_rulesB

List security monitoring detection rules with pagination. Shows enabled/disabled rules, names, and types.

ParametersJSON Schema
NameRequiredDescriptionDefault
page_sizeNo
page_numberNo

TDQS

B3.1/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description adds some behavioral context by stating the output includes status and types, but it omits details about permissions, pagination defaults, or limits. Adequate but not comprehensive.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two concise sentences, front-loaded with key action and resource. No unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple list tool with two parameters and no output schema, the description provides basic context but lacks details on filtering, sorting, or return format. Sufficient for simple use but not fully complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, and the description only mentions pagination without explaining the specific parameters (page_size, page_number). The description fails to compensate for the missing parameter documentation.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool lists security monitoring detection rules with pagination, specifying what is shown (enabled/disabled, names, types). It differentiates from the sibling 'list_security_rules' which likely covers all security rules.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives like search-security-findings or search-security-signals. The description does not provide context for selection.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_security_rulesC

List Datadog security monitoring detection rules

ParametersJSON Schema
NameRequiredDescriptionDefault
page_sizeNoNumber of rules per page
page_numberNoPage number

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are present, and the description does not disclose key behavioral traits such as pagination behavior, rate limits, data freshness, or whether the list is ordered. The minimal description leaves the agent uninformed.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence that front-loads the key action and resource. It is efficient with no unnecessary words, though slightly lacking in depth.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (two optional params, no output schema), the description is incomplete. It does not cover pagination, return format, or how to handle large result sets, which are essential for effective use.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 100% description coverage for both parameters, so the schema already explains their meaning. The description adds no additional value beyond the schema, resulting in a baseline score of 3.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description specifies the verb 'List' and the resource 'Datadog security monitoring detection rules' clearly. However, it does not differentiate from the sibling tool 'list_security_monitoring_rules', which appears to be nearly identical.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives, nor any mention of pagination handling or best practices. The description offers no context for appropriate use.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-service-definitionsB

List service definitions from the Datadog Service Catalog. Use for 'what services exist', 'service catalog', 'list all registered services'.

ParametersJSON Schema
NameRequiredDescriptionDefault
pageSizeNoNumber of results per page
pageNumberNoPage number
schemaVersionNoSchema version: v1, v2, v2.1, or v2.2

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, and the description does not disclose behavioral traits such as pagination, rate limits, or that it is a read-only operation. The burden falls on the description, which only states the basic action.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Description is concise with a single sentence and example phrases. No unnecessary words, but could be slightly more structured.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema is provided, and the description does not explain what fields are returned (e.g., service names, metadata). It lacks context on filtering, sorting, or pagination behavior, making it incomplete for a listing tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already documents parameters. The description adds no additional meaning about pageSize/pageNumber behavior or schemaVersion values.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states it lists service definitions from Datadog Service Catalog and provides example queries. However, it does not explicitly differentiate from sibling tools like 'get-service-definition', though the distinction is implicit.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Description provides example use cases ('what services exist', etc.) implying when to use, but no guidance on when not to use or alternatives among sibling tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_spans_metricsA

List all span-based metrics (APM custom metrics) configured for generating metrics from APM spans.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A3.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full burden. It only states it lists metrics, but omits details like pagination, read-only nature, or permissions. Minimal transparency beyond the action.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence with no wasted words. Clearly communicates purpose and scope.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given zero parameters, no output schema, and no annotations, the description is minimal but adequate for a simple list operation. However, it lacks details about return format or potential filters, leaving some uncertainty for the agent.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

No parameters exist; schema coverage is 100%. The description adds no param-specific info but correctly indicates 'all' metrics, which is sufficient for a parameterless tool. Baseline score 4 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool lists 'span-based metrics (APM custom metrics) configured for generating metrics from APM spans.' The verb 'List' and resource are specific, and the phrase differentiates it from siblings like 'get-metrics' or 'list_logs_metrics'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives like 'get-spans-metrics' or 'list_logs_metrics'. Usage is implied (when needing all span-based metric configurations) but no exclusions or context provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_synthetics_global_variablesA

List all Synthetics global variables used across synthetic tests for shared configuration like URLs, credentials, and test data.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A3.9/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Description implies a read-only operation with no side effects, but lacks details on scope (e.g., whether it lists variables across all accounts) or return format. Without annotations, this is minimally adequate for a list tool.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single concise sentence that conveys purpose and examples without redundancy. No unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a parameterless tool with no output schema, the description fully explains what the tool does and why it's useful. No gaps given the simplicity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

No parameters exist; schema coverage is 100%. According to guidelines, baseline is 4 for zero parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the tool lists all Synthetics global variables and provides concrete examples (URLs, credentials, test data), distinguishing it from sibling list tools like list_synthetics_locations.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives or prerequisites. The description only states what it does without context about appropriate use cases.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_synthetics_locationsA

List available Synthetics testing locations (both managed by Datadog and private). Useful for configuring where synthetic tests run.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A4.5/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided. Description honestly presents a read-only list operation with no destructive actions. Lacks details on pagination or rate limits, but for a parameterless list, these are likely minimal.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two concise sentences stating purpose and usage context. No redundant information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple parameterless list with no output schema, the description provides all necessary context: what it lists, types of locations, and when to use it.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

No parameters in the input schema. Description adds no parameter info, but baseline is 4 for zero-parameter tools as per guidelines.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states it lists Synthetics testing locations, both managed and private. Differentiates from sibling list_synthetics_private_locations by explicitly including both types.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

States 'Useful for configuring where synthetic tests run,' providing clear context for when to use. No explicit when-not-to-use, but the purpose is sufficiently clear for a straightforward list tool.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_synthetics_private_locationsA

List Synthetics private locations for internal testing. Shows private location IDs, names, and tags.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden. It states that the tool shows private location IDs, names, and tags, implying a read-only operation. However, it does not disclose any behavioral traits like auth requirements, rate limits, or whether it returns all locations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two short sentences, front-loaded with the core purpose. No extraneous words; every sentence adds value.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description covers the key outputs (IDs, names, tags) and purpose. Given no output schema and no parameters, it is mostly complete. Minor improvement could mention if results are paginated or if any filtering is available.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool has no parameters, and schema coverage is 100%. According to the rubric, baseline is 4 for zero parameters. The description adds no parameter information, but it is not needed.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'List' and the resource 'Synthetics private locations', specifying that it shows IDs, names, and tags. This distinguishes it from sibling tools like list_synthetics_locations and list_synthetics_global_variables.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description mentions 'for internal testing', providing some context, but does not specify when to use this tool vs alternatives or any prerequisites. For a simple list tool with no parameters, this is adequate but lacking explicit guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_team_membersC

List members of a Datadog team. Shows user roles and membership details.

ParametersJSON Schema
NameRequiredDescriptionDefault
team_idYes
page_sizeNo
page_numberNo
sortNo
filter_keywordNo

TDQS

C2.8/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description should disclose behavioral traits but only generically mentions 'shows user roles'. Does not address pagination, sorting, filtering, or error handling. Incomplete for an agent.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences with no waste, front-loaded with the core purpose. Could be slightly more structured but acceptable.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given 5 parameters, no output schema, and no annotations, the description is too sparse. Does not cover pagination, sorting, filtering, or return format, leaving significant gaps for an agent.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0%, and the description provides no explanation of parameters like page_size, page_number, sort, or filter_keyword. Fails to add meaning beyond parameter names.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool lists members of a Datadog team and shows roles and membership details, distinguishing it from sibling tools like list-teams which list teams themselves.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool vs alternatives (e.g., list-teams) or when not to use it. Missing context for prerequisites or edge cases.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-teamsA

List teams in the Datadog organization. Use for 'what teams exist', 'team structure', 'find team by name'.

ParametersJSON Schema
NameRequiredDescriptionDefault
pageNumberNoPage number
pageSizeNoResults per page
sortNoSort field: name, -name, user_count, -user_count
filterKeywordNoFilter teams by keyword

TDQS

A3.7/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description bears full responsibility for behavioral disclosure. It only states 'List teams' with no mention of read-only nature, pagination, authentication requirements, rate limits, or performance implications. The description is insufficient to make behavioral traits transparent.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise: a single sentence with a short usage hint. No redundant information; every phrase adds value. It is front-loaded with the core purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple list tool with 4 optional parameters and no output schema, the description provides the essential purpose. However, it lacks details about return values (e.g., what fields are returned) and pagination behavior. This is adequate but not comprehensive.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 100% description coverage, with each parameter (pageNumber, pageSize, sort, filterKeyword) having a clear description. The tool description does not add further meaning beyond the schema, but the schema itself is adequate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('List teams') and the specific resource ('in the Datadog organization'). It provides usage examples like 'what teams exist', 'team structure', 'find team by name', making it distinct from sibling list tools for other resources.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives concrete usage scenarios ('what teams exist', 'team structure', 'find team by name'), indicating when to use this tool. However, it does not explicitly state when not to use it or mention alternative tools (e.g., list_team_members), but the context of siblings makes the purpose clear.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-usersA

List users in the Datadog organization. Use for 'who has access', 'list all users', 'find user by email'.

ParametersJSON Schema
NameRequiredDescriptionDefault
pageSizeNoResults per page
pageNumberNoPage number
sortNoSort field
sortDirNoSort direction: asc or desc
filterNoFilter by name or email
filterStatusNoFilter by status: Active, Pending, Disabled

TDQS

A3.7/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, and the description does not disclose behavioral traits like pagination behavior, rate limits, authentication requirements, or implications of filters. The description is too minimal for a tool with no annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence with examples, no wasted words. Extremely concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema and 6 optional parameters with no description of pagination, sorting, or filtering behavior. The description is adequate but leaves gaps in understanding the tool's full behavior.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with all parameters described. The description adds no additional meaning beyond the schema, so baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'List users in the Datadog organization' with specific examples ('who has access', 'list all users', 'find user by email'), making the purpose unambiguous and distinguishing it from sibling list tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Provides explicit use cases ('who has access', 'list all users', 'find user by email'), giving clear context for when to use this tool. Does not mention alternatives or when not to use, but the usage context is clear.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_vulnerabilitiesC

List security vulnerability findings with filtering by tool, type, severity, and status

ParametersJSON Schema
NameRequiredDescriptionDefault
page_tokenNoPagination token from previous response links.next
page_numberNoPage number (>= 1)
filter_typeNoVulnerability type (e.g. SqlInjection, Xss, CommandInjection, ComponentWithKnownVulnerability)
filter_toolNoDetection tool: SAST, SCA, IAST, or Infra
filter_statusNoStatus: Open, Muted, Remediated, InProgress, or AutoClosed
filter_cvss_base_severityNoBase severity: Unknown, None, Low, Medium, High, or Critical
filter_cvss_datadog_severityNoDatadog-adjusted severity: Unknown, None, Low, Medium, High, or Critical
filter_languageNoProgramming language filter
filter_ecosystemNoEcosystem: PyPI, Maven, NuGet, Npm, RubyGems, Go, Packagist, Deb, Rpm, Apk, etc.
filter_code_location_file_pathNoFilter by file path in source code
filter_fix_availableNoFilter by fix availability
filter_asset_nameNoAsset name (supports wildcards *)
filter_asset_typeNoAsset type: Repository, Service, Host, HostImage, or Image
filter_asset_environmentsNoFilter by asset environments
filter_asset_repository_urlNoFilter by repository URL
filter_asset_risks_in_productionNoFilter assets in production
filter_asset_risks_under_attackNoFilter assets under active attack

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided; the description does not disclose behavioral traits such as pagination, rate limits, permissions, or data freshness. It only states the basic listing capability.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence, concise and front-loaded. However, it may be too brief given the tool's complexity, missing critical details like output format.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With 17 parameters, no output schema, and no annotations, the description is insufficient. It does not explain pagination, output structure, or common usage scenarios, leaving significant gaps for an agent.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the baseline is 3. The description does not add extra meaning beyond what each parameter's description already provides, and it omits mention of pagination parameters (page_token, page_number) which could benefit from context.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('list') and resource ('security vulnerability findings'), and mentions key filtering dimensions. It is distinct from sibling tools like 'get-security-finding' or 'search-security-findings' but does not explicitly differentiate.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool vs. alternatives (e.g., 'search-security-findings'), nor any prerequisites or exclusions. The description only implies usage for listing with filters.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_webhooksA

List all configured webhook integrations. Useful for auditing alert routing and notification channels.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A3.7/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description bears the full burden of disclosing behavior. It only states that the tool 'List all configured webhook integrations,' which is a read operation, but it does not mention permissions, rate limits, whether it returns only a list of IDs or full details, or any side effects. Given the lack of annotations, this is insufficient.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise, consisting of two short sentences. Every word serves a purpose: stating the function and providing a use case. No fluff or redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given that there are no parameters and no output schema, the description is minimally adequate. It tells the agent what the tool does and a use case, but it omits details about the structure of the response (e.g., fields returned, pagination). For a simple list tool, this might be acceptable, but richer context would improve it.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has zero parameters, so there is no need for the description to explain parameters. The absence of parameters is implicit, and the description does not need to add value here.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'List all configured webhook integrations,' specifying a concrete verb and resource. It distinguishes itself from sibling tools by explicitly naming 'webhook integrations,' which is a distinct resource among many list_* tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides context: 'Useful for auditing alert routing and notification channels.' This implies when the tool might be used, but it does not explicitly state when to use this tool versus alternatives or when not to use it. No comparison or exclusion criteria are given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_workflow_executionsB

List execution instances for a Datadog workflow. Shows run history, status, and timing.

ParametersJSON Schema
NameRequiredDescriptionDefault
workflow_idYes
page_sizeNo
page_numberNo

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description bears full responsibility. It mentions the tool shows run history, status, and timing, but does not disclose read-only nature, authentication needs, rate limits, or other behavioral traits. Minimal disclosure.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two succinct sentences: first states the action, second describes the output. No waste, front-loaded with purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple list tool, the description covers basic purpose and output content but lacks parameter explanations and usage context. With no output schema and no annotations, it is minimally adequate but leaves gaps.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, and the description provides no explanation for the three parameters (workflow_id, page_size, page_number) beyond the tool name. The agent receives no additional meaning beyond the raw schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'List' and the resource 'execution instances for a Datadog workflow', distinguishing it from sibling tool 'list_workflows' which lists the workflows themselves.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool vs alternatives; the description implies usage by requiring a workflow_id, but does not explain when to choose this over 'list_workflows' or other listing tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_workflowsB

List Datadog workflow automations for incident response and remediation

ParametersJSON Schema
NameRequiredDescriptionDefault
page_sizeNo
page_numberNo
filter_nameNo

TDQS

B3.1/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, so description must convey behavior. It implies a read-only listing operation scoped to incident workflows, but does not mention authentication, rate limits, or if it returns all workflows regardless of scope. Adequate for a simple list tool but lacks depth.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence of 11 words, front-loaded with verb and resource. No wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema, no parameter descriptions, and no usage guidelines. For a tool with three parameters and no schema documentation, the description is insufficient for an agent to use it effectively without additional context.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% and the description omits any mention of the three parameters (page_size, page_number, filter_name). The agent receives no guidance on how to use these parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states it lists Datadog workflow automations, specifically for incident response and remediation. This distinguishes it from sibling tools like list_workflow_executions.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives (e.g., list_workflow_executions, get-workflows?). Only states what it does, not the context or exclusion criteria.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

query-metricsA

Query time-series metric data from Datadog. The backbone of observability — use for 'CPU usage over last hour', 'request rate for web service', or any metric query. Query syntax: 'avg:system.cpu.user{host:web-1}'. Returns data points with timestamps.

ParametersJSON Schema
NameRequiredDescriptionDefault
queryYesMetrics query (e.g., 'avg:system.cpu.user{host:web-1}')
fromYesStart time as Unix epoch seconds
toYesEnd time as Unix epoch seconds

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries full weight. It states the tool returns data points with timestamps, which is helpful. However, it lacks details on rate limits, error behavior, pagination, or any destructive implications. The description is adequate but not comprehensive.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise (4 sentences) and front-loaded with the core purpose. The second sentence is slightly marketing-like but does not detract significantly. Every sentence adds value.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple 3-parameter tool with no output schema, the description covers the essential: purpose, query syntax, and return type. However, it omits details like response format (e.g., array of data points) or potential limitations (e.g., query range limits). It is adequate but not fully complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so parameters are already documented. The description adds value by providing query syntax examples and real-world use cases ('request rate for web service'), which helps the agent understand parameter semantics beyond the schema descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it queries time-series metric data from Datadog, provides concrete examples ('CPU usage over last hour'), and gives query syntax, distinguishing it from sibling tools like get-metrics or get-metric-metadata which likely list metrics rather than query data points.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for metric queries and gives examples, but does not explicitly state when to use this tool versus alternatives like get-metrics or search-metric-volumes. No when-not-to-use or comparison is provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search_audit_logsC

Search Datadog audit logs for configuration changes, user actions, and API calls

ParametersJSON Schema
NameRequiredDescriptionDefault
filter_queryNoAudit log search query
filter_fromNoStart time (ISO 8601)
filter_toNoEnd time (ISO 8601)
page_limitNoMax results per page
page_cursorNoPagination cursor
sortNoSort order (timestamp or -timestamp)

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations available. Description does not disclose behavioral traits such as pagination, rate limits, or result format. Schema parameters like page_limit and page_cursor imply pagination, but description omits this.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, no redundancy. Front-loaded with key purpose. Could include more detail without being verbose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Despite high schema coverage, the description lacks details on time range usage, pagination, and output. For a tool with 6 parameters and no output schema, this is insufficient.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with descriptions for all 6 parameters. Description adds no additional meaning beyond 'search' context. Baseline 3 maintained.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description specifies verb 'Search' and resource 'Datadog audit logs' with clear scope (configuration changes, user actions, API calls). However, sibling tool 'get-audit-events' also deals with audit logs, and the description does not differentiate.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool vs. alternatives like 'get-audit-events' or other search tools. No prerequisites or context provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search-casesC

Search Datadog cases for incident investigation

ParametersJSON Schema
NameRequiredDescriptionDefault
page_sizeNoNumber of results per page
page_offsetNoPage offset
sort_fieldNoField to sort by
filterNoFilter expression
sort_ascNoSort ascending

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, and the description does not disclose behavioral traits such as pagination (page_size, page_offset), rate limits, authentication, or return format. For a search tool with 5 optional parameters, the absence of behavioral context limits transparency.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence with no extraneous information, making it concise. However, it could be slightly more structured by including a brief usage note, but it is not overly lengthy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With 5 parameters, no output schema, and no annotations, the description is insufficiently complete. It does not explain return format, pagination behavior, or how to construct an effective filter expression, leaving gaps for an agent to infer.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so each parameter already has a meaningful description. The tool description adds no extra context beyond what the schema provides, meeting the baseline of 3 for high coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool searches Datadog cases for incident investigation, identifying the specific resource (cases) and purpose. However, it could be more precise about what 'cases' refers to, and it does not explicitly distinguish from sibling tools like search_incidents.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives like search_incidents or get-incidents. The description implies usage for investigating incidents, but does not specify prerequisites, exclusions, or context that would help an agent decide.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search_ci_test_eventsB

Search CI test events with filters. Use for 'find flaky tests', 'test failures in last hour', 'test duration analysis'.

ParametersJSON Schema
NameRequiredDescriptionDefault
filterNo
sortNo
pageNo

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, and the description only says 'search with filters' without disclosing behavioral traits like read-only nature, authentication, rate limits, or pagination behavior.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Extremely concise: one sentence of purpose followed by three usage examples. No wasted words, and front-loaded with key information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Lacks essential details for a search tool with 3 parameters and nested objects: no explanation of how to use filters, sort, pagination, or what the response looks like (no output schema).

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, and the tool description does not explain any of the parameters (filter, sort, page) beyond the generic phrase 'with filters'.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states the action (search) and resource (CI test events), with specific example use cases that distinguish it from sibling tools like 'list_ci_tests' or other search tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Provides explicit scenarios for use ('find flaky tests', 'test failures in last hour'), giving clear context, but does not mention when not to use or direct alternatives.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search-error-tracking-eventsA

Search Error Tracking events across services. Use for 'what errors are happening in production', 'error groups for payment service', 'new errors this week'. Returns error groups with counts, first/last seen, and affected services.

ParametersJSON Schema
NameRequiredDescriptionDefault
filterNo
sortNoSort order
pageNo
limitNoMaximum events to return

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description discloses the return structure (error groups with counts, first/last seen, affected services), which is helpful. However, it does not mention pagination, rate limits, or authentication, and there are no annotations to supplement these aspects. The transparency is adequate but not comprehensive.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is very concise with three sentences, front-loading the purpose, followed by use cases and output description. Every sentence is informative and without redundancy, achieving high efficiency.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

While the description covers the main purpose and output, it lacks details on parameter usage, pagination, and differentiation from similar tools. Given the tool has nested parameters and no output schema, the description leaves some gaps for a complete understanding.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 50% schema description coverage, the description adds minimal parameter insight beyond the schema. It provides example queries but does not explain how to construct the filter or handle pagination, so it does not significantly enhance understanding of the parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'Search Error Tracking events across services' and provides concrete examples, making the purpose clear. However, it does not differentiate from the sibling tool 'search_error_tracking_issues', which likely focuses on a different aspect, thus not achieving a top score.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives practical use case examples ('what errors are happening in production', 'error groups for payment service'), which provide context. However, it does not mention when not to use this tool or alternatives, missing explicit exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search_error_tracking_issuesB

Search Datadog error tracking issues for user-facing errors and exceptions

ParametersJSON Schema
NameRequiredDescriptionDefault
filter_queryNoError tracking search query
filter_fromNoStart time (ISO 8601)
filter_toNoEnd time (ISO 8601)
page_limitNoMax results per page
page_cursorNoPagination cursor
sortNoSort order

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must disclose behavioral traits. It only states 'search,' implying read-only but does not detail what constitutes an 'issue,' whether the operation is idempotent, requires any permissions, or has rate limits. Significant behavioral gaps remain.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence that immediately conveys the tool's purpose. It is front-loaded and wastes no words. However, it could slightly expand without becoming verbose, resulting in a 4 rather than a 5.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema, the description should clarify what the tool returns (e.g., list of issues with structure). It does not. Also, with 6 parameters, the description fails to explain how parameters interact (e.g., does filter_query search issue titles or stack traces?). The tool is underspecified for effective use.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Input schema has 100% coverage, so each parameter has a description (e.g., 'Error tracking search query', 'Start time (ISO 8601)'). The description adds no further meaning beyond the schema, which already sufficiently defines parameter purposes. Baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's function with a specific verb ('Search'), resource ('Datadog error tracking issues'), and scope ('user-facing errors and exceptions'). It distinguishes itself from sibling tools like search-error-tracking-events by focusing on aggregated issues rather than raw events.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no guidance on when to use this tool versus alternatives. With many sibling search tools (e.g., search-error-tracking-events, search-logs), the description should clarify that this is for error tracking issues specifically and not for other error-related searches, but it does not provide any such direction.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search_incidentsC

Search Datadog incidents with advanced filtering by severity, status, and time range

ParametersJSON Schema
NameRequiredDescriptionDefault
queryYes
filter_created_startNo
filter_created_endNo
page_sizeNo
page_offsetNo
sortNo

TDQS

C2.8/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must carry the burden of behavioral disclosure. It mentions filtering but does not disclose whether the operation is read-only, rate limits, pagination behavior, or result limits. For a search tool, this is insufficient.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence that is front-loaded with the verb and resource. No unnecessary words. Perfectly concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With 6 parameters, no annotations, and no output schema, the description should provide more context about pagination, sorting, and the structure of returned data. The description is too brief for a search tool with advanced filters.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema has 0% description coverage, meaning the description must compensate. The description mentions filtering by severity, status, and time range, which are not explicitly in the parameters (except filter_created_start/end for time range). Severity and status are likely part of the query string, but this is not clarified. The description adds some meaning but leaves ambiguity.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states verb 'Search', resource 'Datadog incidents', and mentions advanced filtering by severity, status, and time range. However, it does not differentiate from sibling tools like get-incidents or other search tools, which may have similar functionality.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives, such as get-incidents or other search tools. No prerequisites or when-not-to-use conditions are provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search-logsA

Search and retrieve log entries from Datadog. Use for 'find errors in auth service', 'show logs from last hour', or investigating issues. Query syntax: 'service:web-app status:error', time range: 'now-15m' to 'now'. Returns actual log messages. Use aggregate-logs for counts/stats instead.

ParametersJSON Schema
NameRequiredDescriptionDefault
filterNo
sortNo
pageNo
limitNo

TDQS

A4.1/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries full burden. It mentions that returns actual log messages, which is useful. However, it does not disclose behavioral traits like pagination limits, cursor usage, or rate limiting. The parameters page and limit are present in schema but not explained, leaving gaps.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise—two sentences that front-load the purpose and then deliver usage guidelines and alternative. No redundancy or irrelevant information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema and 4 parameters with nested objects, the description covers purpose and usage but lacks details on pagination, result limits, and output format. For a search tool, it is adequate but not comprehensive.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate. It provides query syntax examples and time range format for the filter sub-properties, but does not explain sort, page, cursor, or limit parameters. Partial coverage, baseline 3.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'search and retrieve', the resource 'log entries from Datadog', and provides specific example use cases. It distinguishes from the sibling tool 'aggregate-logs' by mentioning its alternative use.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicit guidance is provided with concrete examples ('find errors in auth service', 'show logs from last hour'), query syntax, and time range format. It also explicitly states when to use an alternative ('Use aggregate-logs for counts/stats instead'), offering clear decision support.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search-metric-volumesA

Search metrics by name pattern with volume and ingestion data. Use for 'find metrics matching pattern', 'metric ingestion volume', 'what metrics are configured'.

ParametersJSON Schema
NameRequiredDescriptionDefault
filterMetricNoMetric name filter with wildcard support
filterConfiguredNoOnly show configured metrics
filterTagsConfiguredNoFilter by tag configuration
filterActiveWithinNoOnly metrics active within N hours
windowSecondsNoTime window for volume data

TDQS

A3.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, description carries full burden. It states the tool searches with volume and ingestion data but gives no details on pagination, rate limits, side effects, or interpretation of volume. Minimal behavioral context.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two concise sentences: first states function, second lists use cases. No fluff, front-loaded with key information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Adequate for a search tool with 5 parameters but no output schema or annotations. Lacks details on parameter interactions (e.g., AND/OR logic, defaults, pagination). Could be more complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so baseline is 3. Description does not add additional meaning beyond the schema; it only mentions 'metric name pattern' which maps to filterMetric. No extra parameter insights.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the verb (search) and resource (metrics by name pattern with volume and ingestion data), and provides example use cases. It distinguishes from siblings like 'query-metrics' by mentioning volume data, but lacks explicit differentiation.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicitly lists use cases: 'find metrics matching pattern', 'metric ingestion volume', 'what metrics are configured'. However, it does not specify when not to use or mention alternatives.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search-rum-eventsA

Search Real User Monitoring (RUM) events. Use for 'frontend errors in production', 'slow page loads', 'user session analysis'. Query syntax similar to logs: '@type:error @application.id:abc'. Returns user sessions, views, actions, and errors.

ParametersJSON Schema
NameRequiredDescriptionDefault
filterNo
sortNoSort order ('timestamp' or '-timestamp')
pageNo
limitNoMaximum events to return

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the burden. It implies a read-only search operation and lists return types (sessions, views, actions, errors). However, it does not explicitly state side effects, permissions, or rate limits.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is three sentences: purpose, use cases, and output + example. It is front-loaded and contains no extraneous information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema, the description explains return types. It covers key aspects but does not mention pagination details or differentiate from aggregate-rum-events.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 50%, and the description adds a query syntax example for the filter parameter. This adds some value but does not fully compensate for missing schema descriptions on nested properties.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it searches RUM events, provides example use cases, and mentions query syntax. However, it does not explicitly differentiate from siblings like aggregate-rum-events or search-logs.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives explicit use cases ('frontend errors', 'slow page loads', 'user session analysis') and hints at query syntax. But it does not mention when to avoid this tool or provide alternatives among siblings.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search-security-findingsA

List or search Datadog security findings (Cloud Security Management). Use to retrieve findings with a query and optional pagination cursor. Requires security_monitoring_findings_read or appsec_vm_read (OAuth apps still require security_monitoring_findings_read).

ParametersJSON Schema
NameRequiredDescriptionDefault
filterNo
pageNo
limitNo

TDQS

A3.5/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must disclose behavioral traits. It mentions optional pagination cursor and permission requirements, including a note about OAuth apps. However, it does not clarify pagination behavior, rate limits, or what happens when no results are found, leaving gaps.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise: two sentences, front-loaded with the core purpose, and every sentence adds necessary context. No wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description covers the basic purpose and permissions but lacks details on pagination behavior, return structure, and full parameter explanations. Without output schema or annotations, it is not fully complete for a tool with nested objects and 3 parameters.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The description adds meaning by explaining that 'filter.query' is for querying and 'page.cursor' is for pagination, but it omits the 'limit' parameter and does not describe nested object structures. Given 0% schema description coverage, it partially compensates but not fully.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb ('List or search') and the resource ('Datadog security findings (Cloud Security Management)'), making the tool's purpose specific and easily distinguishable from siblings like 'list-posture-findings' or 'get-security-finding'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description mentions required permissions but provides no guidance on when to use this tool versus alternatives (e.g., when to search vs. list, or how it differs from 'search-security-signals'). There is no explicit when-to-use or when-not-to-use advice.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search-security-signalsC

Search security monitoring signals (threat detections, security alerts). Use for 'recent security alerts', 'threat detections', 'security signal search'.

ParametersJSON Schema
NameRequiredDescriptionDefault
filterNo
sortNoSort order
pageNo

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must fully disclose behavioral traits. It only says 'search' without mentioning read-only nature, permission requirements, or pagination behavior. This is insufficient for a search tool.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise with two sentences. It is front-loaded with the core purpose and adds example usage. However, it could be slightly more structured to improve readability.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the complexity (3 top-level parameters with nested objects, no output schema, many siblings), the description is incomplete. It does not explain pagination, sorting, or filtering details, nor does it describe what the response contains.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage for top-level parameters is low (33%). The description does not add meaning beyond what is in the schema for parameters like 'filter', 'sort', and 'page'. It fails to compensate for the schema gaps.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's purpose: 'Search security monitoring signals (threat detections, security alerts)'. It uses a specific verb and resource, and provides example usage phrases that help differentiate from siblings like 'search-security-findings'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives example use cases ('recent security alerts', 'threat detections', 'security signal search') but does not specify when not to use this tool or compare it to alternatives. More explicit guidance would be beneficial given the many sibling tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search_slosB

Search and filter SLOs by query string. Supports pagination and faceted search for finding specific SLOs by name, tags, or other attributes.

ParametersJSON Schema
NameRequiredDescriptionDefault
queryNo
page_sizeNo
page_numberNo
include_facetsNo

TDQS

B3.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are present, so the description carries full burden. It mentions pagination and faceted search but does not disclose whether the operation is read-only, destructive, or its side effects. Missing details on auth requirements, rate limits, or error handling.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise with two sentences. The first sentence defines the core purpose, and the second adds key features. No redundant or unnecessary information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description lacks critical details about return format, pagination specifics, query syntax, and output structure. Given the lack of output schema and annotations, the description does not sufficiently equip an agent to use the tool effectively for complex queries.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 0% schema description coverage, the description adds meaning by linking parameters to features: 'query string' for query parameter, 'pagination' for page_size/page_number, 'faceted search' for include_facets. However, it lacks details on parameter formats, constraints, or defaults.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool searches and filters SLOs by query string, with specific features like pagination and faceted search. It specifies the resource (SLOs) and the action (search/filter), distinguishing it from general list tools like 'get-slos'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for finding specific SLOs by query, but does not explicitly state when to use this tool over siblings like 'get-slos' or when not to use it. No guidance on prerequisites or alternatives is provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search-spansA

Search APM spans/traces. Use for 'find slow requests', 'show errors in payment service', or investigating latency. Query syntax: 'service:web status:error @duration:>1s'. Returns individual spans with trace IDs. Use get-trace for full trace context.

ParametersJSON Schema
NameRequiredDescriptionDefault
filterNo
sortNoSort order ('timestamp' or '-timestamp')
pageNo
limitNoMaximum spans to return

TDQS

A4.4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full burden. It states the tool returns 'individual spans with trace IDs', but does not disclose pagination behavior, rate limits, authentication needs, or that it is a read-only operation. More transparency would be beneficial.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise: three sentences covering purpose, use cases, query syntax, output, and sibling reference. Every sentence adds value without redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema, the description mentions 'Returns individual spans with trace IDs', which is helpful but not fully comprehensive. It properly references sibling tool 'get-trace' for context. Could include more about time range or pagination, but overall adequate.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 50%, but the description adds significant value by explaining the query syntax with an example ('service:web status:error @duration:>1s'). This helps agents understand how to construct the query parameter beyond the schema's simple description.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's purpose: 'Search APM spans/traces'. It provides specific use cases like 'find slow requests' and 'show errors in payment service', and explicitly distinguishes from sibling tool 'get-trace' by directing users to use that for full trace context.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives explicit when-to-use guidance with example queries and use cases. It also provides an alternative: 'Use get-trace for full trace context', helping agents choose correctly.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections. Dates show when Glama detected each change.

  1. 117 tool updatesv1.11.0
    • First observedaggregate_network_connections
    • First observedaggregate-logs
    • First observedaggregate-rum-events
    • First observedaggregate-spans
    • First observedget_csm_coverage
    • First observedget_dbm_query_metrics
    • First observedget_error_tracking_issue
    • First observedget_estimated_cost
    • First observedget_hourly_usage
    • First observedget_incident_services
    • First observedget_incident_timeline
    • First observedget_incident_todos
    • First observedget_ip_ranges
    • First observedget_logs_archive_order
    • First observedget_logs_pipeline_order
    • First observedget_metric_tag_config
    • First observedget_monitor_config_policies
    • First observedget_notebook
    • First observedget_organization
    • First observedget_sensitive_data_scanner_config
    • First observedget_slo_corrections
    • First observedget_top_avg_metrics
    • First observedget-active-hosts-count
    • First observedget-audit-events
    • First observedget-ci-pipeline-events
    • First observedget-containers
    • First observedget-dashboard
    • First observedget-dashboards
    • First observedget-dbm-samples
    • First observedget-downtimes
    • First observedget-events
    • First observedget-host-tags
    • First observedget-hosts
    • First observedget-incidents
    • First observedget-log-indexes
    • First observedget-log-pipelines
    • First observedget-logs-archives
    • First observedget-logs-indexes
    • First observedget-logs-metrics
    • First observedget-logs-pipelines
    • First observedget-metric-metadata
    • First observedget-metrics
    • First observedget-monitor
    • First observedget-monitors
    • First observedget-notebooks
    • First observedget-powerpacks
    • First observedget-security-finding
    • First observedget-service-definition
    • First observedget-service-dependencies
    • First observedget-services
    • First observedget-slo
    • First observedget-slo-history
    • First observedget-slos
    • First observedget-spans-metrics
    • First observedget-synthetic-results
    • First observedget-synthetic-tests
    • First observedget-trace
    • First observedget-usage
    • First observedlist_api_keys
    • First observedlist_app_keys
    • First observedlist_authn_mappings
    • First observedlist_aws_accounts
    • First observedlist_azure_integration
    • First observedlist_ci_tests
    • First observedlist_cloudflare_accounts
    • First observedlist_confluent_accounts
    • First observedlist_containers
    • First observedlist_cost_budgets
    • First observedlist_csm_threats_agent_rules
    • First observedlist_dora_deployments
    • First observedlist_downtime_schedules
    • First observedlist_fleet_agents
    • First observedlist_gcp_integration
    • First observedlist_host_totals
    • First observedlist_logs_metrics
    • First observedlist_metric_tag_configs
    • First observedlist_monitor_notification_rules
    • First observedlist_network_devices
    • First observedlist_notebooks
    • First observedlist_restriction_policies
    • First observedlist_security_monitoring_rules
    • First observedlist_security_rules
    • First observedlist_spans_metrics
    • First observedlist_synthetics_global_variables
    • First observedlist_synthetics_locations
    • First observedlist_synthetics_private_locations
    • First observedlist_team_members
    • First observedlist_vulnerabilities
    • First observedlist_webhooks
    • First observedlist_workflow_executions
    • First observedlist_workflows
    • First observedlist-ci-pipelines
    • First observedlist-dashboard-lists
    • First observedlist-permissions
    • First observedlist-posture-findings
    • First observedlist-processes
    • First observedlist-roles
    • First observedlist-rum-applications
    • First observedlist-scorecard-outcomes
    • First observedlist-scorecard-rules
    • First observedlist-service-definitions
    • First observedlist-teams
    • First observedlist-users
    • First observedquery-metrics
    • First observedsearch_audit_logs
    • First observedsearch_ci_test_events
    • First observedsearch_error_tracking_issues
    • First observedsearch_incidents
    • First observedsearch_slos
    • First observedsearch-cases
    • First observedsearch-error-tracking-events
    • First observedsearch-logs
    • First observedsearch-metric-volumes
    • First observedsearch-rum-events
    • First observedsearch-security-findings
    • First observedsearch-security-signals
    • First observedsearch-spans

TDQS

C2.7/5.0
Disambiguation2/5

Many tools have overlapping purposes; for example, multiple list_* tools for cloud integrations and duplicate-like tools such as get-log-indexes and get-logs-indexes. Confusion likely between similar queries like aggregate-logs and search-logs.

Naming Consistency2/5

Mixed naming conventions: some use kebab-case (e.g., get-active-hosts-count), others snake_case (e.g., aggregate_network_connections). No consistent pattern, making it hard to predict tool names.

Tool Count1/5

117 tools is excessive for a single server, far beyond typical scopes. This overwhelms agents and makes selection inefficient.

Completeness3/5

Covers many Datadog domains (logs, metrics, APM, RUM, security, synthetics), but the organization is messy with redundancies, leaving gaps in tool discovery and usability.

Maintenance

ActivityActive
ResponsivenessNo issues

Resources

Unclaimed servers have limited discoverability.

Looking for Admin?

If you are the server author, to access and configure the admin panel.

Related MCP Connectors

Related MCP Servers

  • A
    license
    B
    quality
    D
    maintenance
    Enables interaction with Datadog's monitoring and observability platform through the MCP protocol. Supports incident management, monitor status checks, log searches, metrics queries, APM traces, dashboard access, RUM analytics, host management, and downtime scheduling.
    13
    21
    Apache 2.0
  • A
    license
    C
    quality
    D
    maintenance
    A read-only MCP server that enables users to query Databricks SQL, browse metadata, and monitor Delta Lake tables. It also supports tracking Databricks Jobs, DLT Pipelines, and cluster metrics through natural language interfaces.
    25
    4
    MIT
  • F
    license
    Not graded
    quality
    D
    maintenance
    A Model Context Protocol (MCP) server that provides comprehensive Datadog monitoring capabilities, enabling Claude to manage CI/CD pipelines, analyze logs, query metrics, and handle monitors and SLOs.
    -
  • A
    license
    Not graded
    quality
    D
    maintenance
    An MCP server that provides comprehensive read/write access to Datadog APIs, enabling management of monitors, dashboards, logs, incidents, and more via natural language commands.
    MIT

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/dreamiurg/datadog-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server