Datadog MCP Server
Enables querying Cloudflare integration data within Datadog, allowing users to retrieve Cloudflare-related metrics and configurations.
Provides read-only access to Datadog's observability platform, including logs, APM, metrics, monitors, dashboards, SLOs, synthetics, incidents, infrastructure, security, network, cloud integrations, service catalog, CI visibility, and more, with over 117 tools.
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@Datadog MCP Servershow me the top errors in the last hour"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
Datadog MCP Server
The Datadog MCP server your AI deserves. 117 read-only tools. Every observability pillar. Zero writes. Zero regrets.
Why This One?
Look, we get it. You searched "datadog mcp server" and got seven results. You're wondering which one to pick. Let us save you approximately forty-five seconds of reading other READMEs that say "supports monitors and dashboards" like that's supposed to impress someone.
Feature | Us (117 tools) | Project 1 | Project 2 | Project 3 |
Observability Core | ||||
Logs (search + aggregate + pipelines + indexes) | 7 tools | 1 tool | 0-1 tool | 0-1 tool |
APM (traces, spans, services, dependencies) | 7 tools | 1 tool | 0 tools | 0 tools |
Metrics (query, metadata, volumes, tags) | 6 tools | 1 tool | 0-1 tool | 0 tools |
RUM (events, apps, aggregation) | 3 tools | 3 tools | 0 tools | 0 tools |
Alerting & Reliability | ||||
Monitors (list, get, search) | 4 tools | 1 tool | 0-1 tool | 0-1 tool |
Dashboards (get, list, collections) | 3 tools | 1 tool | 0-1 tool | 0-1 tool |
SLOs (list, get, history, search, corrections) | 5 tools | 0 tools | 0-1 tool | 0-1 tool |
Synthetics (tests, results, locations) | 5 tools | 0 tools | 0-1 tool | 0 tools |
Events & Incidents | 7 tools | 2 tools | 0-1 tool | 0 tools |
Downtimes | 2 tools | 1 tool | 0-1 tool | 0 tools |
Infrastructure & Security | ||||
Infrastructure (hosts, tags, containers, processes) | 8 tools | 2 tools | 0-1 tool | 0-1 tool |
Security (findings, posture, signals, rules, scanning) | 10 tools | 0 tools | 0-1 tool | 0 tools |
Network Monitoring | 2 tools | 0 tools | 0 tools | 0 tools |
Cloud Integrations (AWS/GCP/Azure/Cloudflare/Confluent) | 5 tools | 0 tools | 0 tools | 0 tools |
Platform & DevOps | ||||
Service Catalog | 3 tools | 0 tools | 0-1 tool | 0 tools |
CI Visibility (pipelines + tests) | 4 tools | 0 tools | 0-1 tool | 0 tools |
Organization (teams, users, auth) | 5 tools | 0 tools | 0-1 tool | 0 tools |
Error Tracking | 3 tools | 0 tools | 0 tools | 0 tools |
Database Monitoring | 2 tools | 0 tools | 0 tools | 0 tools |
Workflows & Automation | 2 tools | 0 tools | 0 tools | 0 tools |
DORA Metrics | 1 tool | 0 tools | 0 tools | 0 tools |
Governance & Cost | ||||
Audit Trail | 2 tools | 0 tools | 0 tools | 0 tools |
Usage & Billing | 4 tools | 0 tools | 0 tools | 0 tools |
Cloud Cost Management | 1 tool | 0 tools | 0 tools | 0 tools |
Access Control (keys, mappings, policies) | 4 tools | 0 tools | 0 tools | 0 tools |
Notebooks | 3 tools | 0 tools | 0 tools | 0 tools |
Fleet Management | 1 tool | 0 tools | 0 tools | 0 tools |
Webhooks | 1 tool | 0 tools | 0 tools | 0 tools |
Monitor Notifications | 1 tool | 0 tools | 0 tools | 0 tools |
IP Ranges & Config | 1 tool | 0 tools | 0 tools | 0 tools |
Total | 117 | ~20 | ~13 | ~29 |
Accidentally deletes your monitors | No | No | No | No |
Can mute your hosts at 3 AM | No | No | No | Yes |
Test coverage | 90%+ | Unknown | Unknown | Unknown |
We're not saying the other MCP servers are bad. That would be rude, and also legally questionable. They're all built by talented engineers who are contributing to open source and making the ecosystem better. Some of them have features we don't, like the ability to write to your Datadog account from an AI chat window. We chose not to include those. On purpose. You're welcome.
The Philosophy
Read everything. Write nothing.
Your AI assistant should be able to see all of Datadog. It should not be able to silence your pager at 3 AM because it decided your alerts were "probably fine." That's not a hypothetical scenario. That's a Tuesday. We have opinions about this, and they are all correct.
Related MCP server: databricks-mcp
Quick Start
npx github:dreamiurg/datadog-mcp --helpThat's it. No installation required. Node.js 20+. Works in 8 seconds. We timed it.
Setup
1. Get Datadog Credentials
You need two keys from your Datadog Organization Settings:
Credential | Where to Find | Difficulty |
API Key | Organization Settings -> API Keys -> New Key | Easy |
Application Key | Organization Settings -> Application Keys -> New Key | Also easy |
Tip: For least-privilege access, scope your Application Key to only the permissions you need. Or give it everything. We won't judge. (We will judge a little.)
2. Configure Your AI Tool
claude mcp add datadog -- npx github:dreamiurg/datadog-mcp \
--apiKey YOUR_API_KEY \
--appKey YOUR_APP_KEY \
--site datadoghq.comOr add to ~/.claude.json:
{
"mcpServers": {
"datadog": {
"command": "npx",
"args": ["github:dreamiurg/datadog-mcp", "--apiKey", "YOUR_API_KEY", "--appKey", "YOUR_APP_KEY"]
}
}
}Add to your config file:
macOS:
~/Library/Application Support/Claude/claude_desktop_config.jsonWindows:
%APPDATA%/Claude/claude_desktop_config.json
{
"mcpServers": {
"datadog": {
"command": "npx",
"args": ["github:dreamiurg/datadog-mcp", "--apiKey", "YOUR_API_KEY", "--appKey", "YOUR_APP_KEY"]
}
}
}Tool | Config File |
Cursor |
|
Windsurf |
|
VS Code | User Settings JSON ( |
{
"mcpServers": {
"datadog": {
"command": "npx",
"args": ["github:dreamiurg/datadog-mcp", "--apiKey", "YOUR_API_KEY", "--appKey", "YOUR_APP_KEY"]
}
}
}Add to ~/.gemini/settings.json:
{
"mcpServers": {
"datadog": {
"command": "npx",
"args": ["github:dreamiurg/datadog-mcp", "--apiKey", "YOUR_API_KEY", "--appKey", "YOUR_APP_KEY"]
}
}
}Add to ~/.codex/config.toml:
[mcp_servers.datadog]
command = "npx"
args = ["github:dreamiurg/datadog-mcp", "--apiKey", "YOUR_API_KEY", "--appKey", "YOUR_APP_KEY"]The Full Arsenal (117 Tools)
Tool | What It Does | Try Asking |
| Search logs with Datadog query syntax | "Find errors in auth service last hour" |
| Compute counts, averages, group-bys on log data | "Count errors by service in the last 24h" |
| List log pipeline configurations | "How are our logs being processed?" |
| List log indexes and retention settings | "What retention is configured for our logs?" |
| Get log pipeline processing order | "What order do log pipelines execute in?" |
| Get log archive priority order | "Which archives are checked first for rehydration?" |
| List log-based custom metrics | "What metrics are generated from logs?" |
Tool | What It Does | Try Asking |
| Search APM spans with query syntax | "Find slow requests in payment service" |
| Compute APM statistics (p99, error rates) | "Show p99 latency by service" |
| List APM-instrumented services | "What services are being traced?" |
| Get a full distributed trace by ID | "Show all spans for trace abc123" |
| Search raw APM events | "Find APM events with errors in checkout" |
| List currently active APM events | "What APM events are happening right now?" |
| List span-based APM metrics | "What custom span metrics are configured?" |
Tool | What It Does | Try Asking |
| Query timeseries metric data | "Show CPU usage for web hosts last 4 hours" |
| List available metrics | "What metrics are available?" |
| Get metric metadata and descriptions | "Describe the system.cpu.user metric" |
| Search metrics by name with volume data | "Which metrics matching 'aws.' have the highest volume?"* |
| Get tag configuration for a specific metric | "What tags are indexed for system.cpu.user?" |
| List metric tag configurations | "Which metrics have custom tag configurations?" |
Tool | What It Does | Try Asking |
| List monitors (filter by state, tags) | "Show all alerting monitors" |
| Get monitor details by ID | "Get details for monitor 12345" |
| Search monitors by query | "Find monitors related to database" |
| Get monitor configuration policies | "What monitor config policies are enforced?" |
Tool | What It Does | Try Asking |
| List all dashboards | "What dashboards do we have?" |
| Get dashboard details and widgets | "Show the API metrics dashboard" |
| List dashboard collections | "What dashboard lists are organized?" |
Tool | What It Does | Try Asking |
| List Service Level Objectives | "Which SLOs are breaching?" |
| Get SLO details by ID | "Show error budget for SLO xyz" |
| Get historical SLO performance | "How has our API SLO trended this month?" |
| List SLO correction periods | "What SLO corrections have been applied?" |
| Search SLOs with query filters | "Find all SLOs with error budget below 10%" |
Tool | What It Does | Try Asking |
| List synthetic tests | "What synthetic checks do we have?" |
| Get results for a specific test | "Show recent results for the checkout test" |
| List Synthetics global variables | "What global variables are available for tests?" |
| List available Synthetics testing locations | "Where can I run Synthetics tests from?" |
| List Synthetics private locations | "What private locations are configured for testing?" |
Tool | What It Does | Try Asking |
| Search RUM events with filters | "Find RUM errors on the checkout page" |
| List registered RUM applications | "What apps have RUM enabled?" |
| Analytics on RUM data (counts, averages, group-by) | "Average page load time by country" |
Tool | What It Does | Try Asking |
| List infrastructure hosts | "Show all production hosts" |
| Get tags for all hosts | "What tags are on our hosts?" |
| Get total active/up host count | "How many hosts are running?" |
| Get total active and up host counts | "Show me the total host count breakdown" |
| List NDM network devices | "Show network device status" |
| List Datadog agents across fleet | "Which agents are outdated?" |
| List running containers | "Show containers filtered by image" |
| List running processes | "Find java processes across hosts" |
Tool | What It Does | Try Asking |
| List all service definitions | "What services are in the catalog?" |
| Get a single service definition | "Who owns the auth service?" |
| Get service dependency map | "What does the payment service depend on?" |
Tool | What It Does | Try Asking |
| List CI pipeline events | "Show recent CI pipeline runs" |
| Aggregate CI pipeline analytics | "Average pipeline duration by repo" |
| List CI test events | "Show failed tests in the last hour" |
| Search CI test events with filters | "Find flaky tests in the checkout service" |
Tool | What It Does | Try Asking |
| Search Cloud Security findings | "Find high-severity security findings" |
| Get a specific security finding | "Get finding abc123" |
| List compliance/posture findings | "Show failed compliance checks" |
| Search security monitoring signals | "Recent threat detections" |
| Get CSM coverage across cloud accounts | "Which AWS accounts lack security coverage?" |
| List vulnerability findings (SAST, SCA, IAST, Infra) | "Show open SAST vulnerabilities in production" |
| List CSM Threats agent rules | "What workload security rules are enabled?" |
| List security monitoring rules | "What detection rules are active?" |
| List security monitoring detection rules | "What security detection rules are configured?" |
| Get Sensitive Data Scanner configuration | "What sensitive data scanning rules are active?" |
Tool | What It Does | Try Asking |
| Get Datadog organization info | "Show organization details and settings" |
| List Datadog teams | "What teams exist in our org?" |
| List members of a Datadog team | "Who is on the platform team?" |
| List Datadog users | "Who has access to Datadog?" |
| List SAML/OIDC authentication mappings | "How do IdP groups map to Datadog roles?" |
Tool | What It Does | Try Asking |
| Fetch events in a time range | "What events happened today?" |
| List scheduled maintenance | "Any active downtimes?" |
| List scheduled downtimes (v2) | "What downtimes are scheduled?" |
| Get Database Monitoring query samples | "Show slow postgres queries" |
| Get Database Monitoring query metrics | "Which queries have the highest latency?" |
| Get Datadog IP ranges for firewall config | "What IPs should I allowlist for Datadog?" |
Tool | What It Does | Try Asking |
| Search audit trail with filters | "Who changed configs in the last hour?" |
| Get hourly usage metering by product | "Show log ingestion usage trends" |
| Get top custom metrics by hourly average | "Which custom metrics drive cardinality costs?" |
| Get estimated usage cost data | "What's our projected Datadog bill this month?" |
Tool | What It Does | Try Asking |
| List Datadog notebooks with filtering | "Find investigation notebooks" |
| Get a specific notebook by ID | "Show notebook 12345" |
Tool | What It Does | Try Asking |
| List containers with tag filtering | "Show running containers in us-east-1" |
| List processes across hosts | "Find Java processes with high memory" |
Tool | What It Does | Try Asking |
| List NDM network devices | "Show network device status" |
| Aggregate network flow analytics | "Top network flows by bandwidth" |
Tool | What It Does | Try Asking |
| List security monitoring rules | "What detection rules are active?" |
| Search error tracking issues | "Top errors by volume in production" |
| Get error tracking issue details by ID | "Show details for issue abc123" |
| Get CSM coverage across cloud accounts | "Which AWS accounts lack security coverage?" |
| List vulnerability findings (SAST, SCA, IAST, Infra) | "Show open SAST vulnerabilities in production" |
| List CSM Threats agent rules | "What workload security rules are enabled?" |
Tool | What It Does | Try Asking |
| Search incidents with advanced filters | "Find P1 incidents related to database" |
| Get action items for an incident | "What's pending for this P0?" |
| Get timeline events for an incident | "Show the timeline for incident xyz" |
| List incident services | "What services are configured for incident management?" |
Tool | What It Does | Try Asking |
| List integrated AWS accounts | "Which AWS accounts are connected?" |
| List GCP integration accounts | "Which GCP projects are integrated?" |
| List Azure integration accounts | "Which Azure subscriptions are connected?" |
| List Cloudflare accounts | "What Cloudflare accounts are integrated?" |
| List Confluent Cloud accounts | "Which Confluent Cloud accounts are connected?" |
| List webhook integrations | "What webhooks are configured?" |
| List Datadog API keys | "What API keys are active?" |
Tool | What It Does | Try Asking |
| List DORA deployment events | "Show deployment frequency for web service" |
| List workflow automations | "What incident response workflows exist?" |
| List execution instances for a workflow | "Show run history for the incident workflow" |
| List Datadog agents across fleet | "Which agents are outdated?" |
| List monitor notification routing | "Who gets alerted for this monitor?" |
| List cloud cost budgets | "Are any teams over budget?" |
Tool | What It Does | Try Asking |
| Get restriction policy for a resource | "What access restrictions are configured?" |
| List application keys for the current user | "What application keys do I have?" |
| List authentication mappings | "How do SAML groups map to Datadog roles?" |
The Competitive Landscape (We Did the Research So You Don't Have To)
There are approximately seven thousand Datadog MCP servers on GitHub. We counted. Then we lost count. Then we counted again. Here's how they stack up:
Capability | Us | Project 1 | Project 2 | Project 3 | Project 4 |
Total tools | 117 | ~20 | ~10 | ~13 | ~29 |
Read-only by design | Yes | No | Yes | Yes | No |
Can mute your hosts | No | Yes | No | No | No |
Can delete your dashboards | No | No | No | No | Yes |
Can schedule downtimes | No | Yes | No | No | Yes |
Test suite | 570 tests | - | - | - | - |
Last meaningful update | Today | Recent | Dec 2025 | Jan 2026 | Dec 2025 |
A note on write operations: Some servers let your AI create monitors, delete dashboards, and schedule downtimes. That's a feature. It's also the plot of every "AI gone wrong" movie ever made. We chose the boring path: read everything, touch nothing. Our therapist says this is healthy.
What They Have That We Don't
In the interest of full transparency (and because our lawyers said we had to):
Some servers can mute/unmute hosts and schedule downtimes (write operations we intentionally excluded because we enjoy sleeping)
Some servers can CRUD monitors and dashboards (see above re: AI movies, and also re: sleeping)
Some servers have unique metric field exploration tools
We sleep extremely well at night.
Configuration Reference
Regional Endpoints
Set --site for your Datadog region:
Region | Site Value |
US (default) |
|
EU |
|
US3 (GovCloud) |
|
US5 |
|
AP1 |
|
Environment Variables
Alternative to command-line arguments:
DD_API_KEY=your_api_key
DD_APP_KEY=your_app_key
DD_SITE=datadoghq.com # Optional, defaults to datadoghq.com
DD_LOGS_SITE=logs.datadoghq.com # Optional, override for logs API
DD_METRICS_SITE=api.datadoghq.com # Optional, override for metrics APILogging
Variable | Values | Default | Description |
|
|
| Minimum log level |
|
|
| Output format ( |
# Pretty logs for development
LOG_FORMAT=pretty npx github:dreamiurg/datadog-mcp --apiKey ... --appKey ...Create an Application Key with only the scopes you need:
Scope | Tools Unlocked |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Create a scoped key: Organization Settings -> Application Keys -> New Key -> Select scopes
Troubleshooting
Verify API key and Application key are correct
Check your Application Key has required scopes
Confirm you're using the correct regional endpoint
# Check MCP server status
claude mcp list
# View logs (Claude Desktop - macOS)
tail -f ~/Library/Logs/Claude/mcp*.log
# View logs (Claude Desktop - Windows)
Get-Content "$env:APPDATA\Claude\Logs\mcp*.log" -Tail 20 -WaitLOG_LEVEL=debug LOG_FORMAT=pretty npx github:dreamiurg/datadog-mcp --apiKey ... --appKey ...Development
git clone https://github.com/dreamiurg/datadog-mcp.git
cd datadog-mcp
npm install
npm run build
npm testScript | Description |
| Compile TypeScript |
| Run tests (570 tests in 120 files) |
| Run tests with coverage (90%+ enforced) |
| Run Biome linter |
| Type check |
| Check cyclomatic complexity |
| Run everything (the full gauntlet) |
Test with MCP Inspector
npx @modelcontextprotocol/inspector node dist/index.js \
--apiKey=YOUR_API_KEY \
--appKey=YOUR_APP_KEYContributing
PRs welcome. We have strong opinions about read-only access, 90% test coverage, and cognitive complexity under 15. If that sounds like fun, you'll fit right in.
License
MIT - Use freely in personal and commercial projects.
Disclaimer
In case it wasn't abundantly, blindingly, neon-sign-in-the-desert obvious: the comparison tables above are written with tongue so firmly in cheek it's coming out the other side. This is sarcasm. We are being sarcastic. If you're still not sure, yes, that was also sarcasm.
Every single Datadog MCP server out there was built by engineers who cared enough to ship something real into the world. That's more than most people do on a Saturday. Open source is better when there are options, and the ecosystem is better because all of these projects exist.
If our 117 read-only tools aren't what you need, genuinely and sincerely: go find the one that is. Try them all. Mix and match. Build your own. Fork ours and add write operations if you're feeling brave (and have good backups). The best tool is the one that fits your workflow, not the one with the spiciest README.
Now go build something great. Sleep tight.
Available Tools
117 toolsaggregate-logsA
Compute statistics and aggregations on logs. Use for 'how many errors per service', 'count logs by status', or 'average response time from logs'. Supports count, avg, sum, min, max, percentiles. Use search-logs to see actual log content instead.
| Name | Required | Description | Default |
|---|---|---|---|
| filter | No | ||
| compute | No | ||
| groupBy | No | ||
| options | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided, and the description lacks behavioral details such as whether the tool modifies data, required permissions, rate limits, or side effects. It only notes supported aggregation functions.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Three concise sentences: purpose, examples, and alternative. Every sentence adds value; no redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the complex schema with 4 nested parameters and no output schema, the description is too brief. It does not cover parameter usage, return format, or additional context needed for correct invocation.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema parameter coverage is 0% and the description does not explain the nested parameters (filter, compute, groupBy, options). It only mentions aggregation types but not how they map to the compute array.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool computes statistics and aggregations on logs with specific examples (e.g., 'how many errors per service'), and distinguishes itself from sibling tool search-logs, which is used for actual log content.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides explicit when-to-use (aggregation scenarios) and when-not-to-use (for log content, use search-logs). It also implies it is for logs vs other data types by naming.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
aggregate_network_connectionsC
Aggregate network connection analytics with grouping and filtering
| Name | Required | Description | Default |
|---|---|---|---|
| filter_from | No | ||
| filter_to | No | ||
| filter_query | No | ||
| group_by | No | ||
| aggregate | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries full burden for behavioral disclosure. It only states the core function (aggregation with grouping/filtering) but does not reveal whether the tool is read-only, has side effects, rate limits, or any operational constraints. This is insufficient for safe invocation.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise at one sentence, but this brevity sacrifices necessary detail. It is front-loaded with key action and resource, but lacks structure for multiple aspects. For a tool with 5 parameters, more substance is warranted.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the absence of annotations and output schema, the description should provide richer context. It fails to explain return format, aggregation types, valid filter fields, or grouping behavior, leaving significant gaps for complete understanding.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 5 parameters with 0% description coverage, and the tool description adds no parameter details. It mentions 'grouping and filtering' which hints at 'group_by' and filter parameters, but without explaining valid values, formats, or semantics, the agent cannot correctly formulate arguments.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool aggregates network connection analytics, differentiating it from sibling aggregation tools like 'aggregate-logs' and 'aggregate-rum-events' that operate on different data types. The verb 'aggregate' and resource 'network connection analytics' are specific, though 'analytics' is somewhat vague.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus other aggregation tools or alternatives. The description does not mention prerequisites, context, or limitations, leaving the agent to infer usage without decision support.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
aggregate-rum-eventsA
Aggregate RUM events with compute operations (count, avg, sum, min, max, percentile) and group-by facets. Use for 'RUM page load times by country', 'error count by browser', 'average session duration by app version'.
| Name | Required | Description | Default |
|---|---|---|---|
| compute | Yes | Compute operations to perform | |
| filter | No | Filter criteria | |
| group_by | No | Group-by facets |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description bears full responsibility. It describes the aggregation and grouping behavior but does not mention whether the operation is read-only, any side effects, or permissions needed. The description is adequate but not thorough.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two sentences: the first defines functionality, the second provides examples. It is front-loaded and concise with no unnecessary words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a tool with three nested parameters and no output schema, the description covers the purpose and usage examples. It lacks details on the return format or how filter interacts, but the schema fills many gaps. Adequate for the complexity.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the description adds limited value beyond the schema. It lists aggregation types and gives example queries, but does not explain parameter semantics in more depth than the schema already does.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool aggregates RUM events with specific compute operations and group-by facets, and gives concrete examples. It distinguishes from sibling tools by specifying 'RUM events' and the aggregation verbs.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides explicit example use cases ('RUM page load times by country', etc.), which helps the agent decide when to use this tool. While it doesn't explicitly state when not to use it, the examples are clear and differentiate from other tools.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
aggregate-spansA
Compute statistics on APM spans. Use for 'p99 latency by service', 'error rate per endpoint', 'request count over time'. Supports count, avg, sum, min, max, percentiles (pc75/90/95/99). Use search-spans to see actual span details.
| Name | Required | Description | Default |
|---|---|---|---|
| filter | No | ||
| compute | No | ||
| groupBy | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so description must compensate. It mentions computing statistics but does not disclose behavioral traits like read-only nature, side effects, rate limits, authorization needs, or performance implications for large datasets.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Extremely concise: two sentences and examples. Front-loaded with purpose, no redundant information.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Despite good purpose clarity, the description lacks detail on return structure, behavior with missing parameters, and does not compensate for the absence of output schema. Given the tool's complexity (nested objects, multiple aggregations), more completeness is needed.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0% (per context signal), but the description lists supported aggregation types and examples. However, it does not explain the structure of filter, compute, or groupBy parameters nor their nesting, leaving gaps.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly defines the tool: 'Compute statistics on APM spans' with concrete use cases ('p99 latency by service', 'error rate per endpoint', 'request count over time'). Distinguishes from sibling search-spans by contrasting aggregation vs detail retrieval.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Explicitly states when to use ('Use for ...') and directs to search-spans for detail. Does not list all alternatives but provides clear context for APM span aggregation.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-active-hosts-countB
Get total number of active and up hosts. Use for 'how many hosts are running', 'infrastructure host count', 'active host summary'.
| Name | Required | Description | Default |
|---|---|---|---|
| from | No | Seconds since Unix epoch to scope the count |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description bears full responsibility. It indicates a read-only, non-destructive operation but does not disclose behavioral traits such as rate limits, authentication requirements, data freshness, or what 'active and up' technically means. The parameter 'from' is mentioned only via schema.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two sentences: a clear purpose statement followed by concise usage examples. It is front-loaded, has no redundant words, and every sentence adds value.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the low complexity (one optional parameter, no output schema), the description gives basic purpose and usage context. However, it lacks explanation of what 'active and up' means, how the count is scoped (e.g., time range, workspace), and whether the result is real-time or historical. This leaves some ambiguity.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100% (the single 'from' parameter is described in the schema). The tool description does not add any additional meaning beyond what the schema provides, so baseline score of 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb ('Get') and resource ('total number of active and up hosts'), and includes example queries like 'how many hosts are running' that clarify its purpose. It distinguishes from sibling tools like 'get-hosts' (which likely returns host details) by focusing on a count, but does not explicitly differentiate from 'list_host_totals'.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides example usage phrases but gives no guidance on when to use this tool vs. alternatives (e.g., 'get-hosts' or 'list_host_totals'), nor does it mention prerequisites or limitations. The examples imply use cases, but not explicit directives.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-audit-eventsA
Search Datadog organization audit events. Use for 'who changed this monitor', 'what config changes happened today', 'audit trail for user X'. Returns timestamped events with actor, action, and affected resource.
| Name | Required | Description | Default |
|---|---|---|---|
| filter | No | ||
| sort | No | Sort order | |
| page | No | ||
| limit | No | Maximum events to return |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description must convey behavioral traits. It states 'Returns timestamped events with actor, action, and affected resource', but lacks details on pagination, rate limits, or auth requirements.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Three concise sentences: purpose statement, use case list, return value description. No unnecessary words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no output schema, the description adequately explains return fields. It covers essential information for a search tool, though could expand on pagination and sorting behavior.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 50%; the description adds value by showing filter query format ('@action:modified @resource_type:monitor'), but does not elaborate on sort or pagination parameters beyond the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states 'Search Datadog organization audit events' and provides specific use cases like 'who changed this monitor', which distinguishes it from sibling search tools for logs, traces, etc.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives explicit usage scenarios ('who changed this monitor', 'what config changes happened today'), but does not mention when not to use it or alternatives among siblings.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-ci-pipeline-eventsC
Aggregate CI pipeline analytics with compute operations. Use for 'average pipeline duration', 'failure rate by pipeline', 'CI performance trends'.
| Name | Required | Description | Default |
|---|---|---|---|
| compute | Yes | Compute operations | |
| filter | No | ||
| group_by | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries full responsibility. It only describes the tool's function ('aggregate CI pipeline analytics with compute operations') without disclosing behavioral traits like read-only nature, authentication requirements, rate limits, or potential side effects. This leaves the agent uninformed about important usage constraints.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise, consisting of one functional sentence plus a usage tip. It is front-loaded with the core action. However, it could be slightly more structured by separating the purpose from the usage examples, but overall it is appropriately sized for a tool with moderate complexity.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's complexity (nested parameters, no output schema, no annotations), the description is insufficient. It does not explain the return format, how results are grouped, or how to interpret the computed analytics. For an aggregation tool, these details are critical for correct invocation.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 3 parameters with only 33% description coverage according to context signals. The description adds minimal information beyond the schema (e.g., 'Compute operations' for the compute parameter). It does not explain valid values for metric or type in the compute array, nor clarify the filter or group_by parameters. The agent has to infer too much.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states that the tool aggregates CI pipeline analytics with compute operations, and provides example use cases like 'average pipeline duration' and 'failure rate by pipeline'. This makes the purpose specific and actionable, though it does not explicitly differentiate from all sibling tools like 'aggregate-logs'.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives concrete examples of when to use the tool ('average pipeline duration', 'failure rate by pipeline', 'CI performance trends'), which guides the agent. However, it lacks explicit when-not-to-use guidance or mention of alternative tools for non-aggregation tasks, such as listing individual pipeline events.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-containersA
List containers monitored by Datadog. Use for 'show running containers', 'containers for web service', 'container status by image'. Returns container names, images, tags, state, and start time.
| Name | Required | Description | Default |
|---|---|---|---|
| filterTags | No | Comma-separated tags (e.g., 'env:prod,service:web') | |
| groupBy | No | Group by attribute (e.g., 'short_image') | |
| sort | No | Sort field (e.g., 'name', '-name') | |
| pageSize | No | Results per page | |
| pageCursor | No | Pagination cursor |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries full disclosure burden. It only states it lists containers (implying read-only), but omits details on pagination, rate limits, required permissions, or how parameters like sort and filterTags affect behavior.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise with two sentences: first states the purpose, second provides usage examples and return fields. No wasted words, front-loaded with essential information.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The tool has 5 parameters and no output schema, but the description only lists a few return fields without explaining types, format, or behavior like pagination. Important context about parameter effects (sort, filter) is missing.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 100% coverage with descriptions for each parameter, and the tool description adds no additional meaning beyond what the schema already provides, meeting the baseline expectation.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool lists containers monitored by Datadog, provides example use cases, and specifies returned fields (names, images, tags, state, start time), making it easy for an agent to understand exactly what the tool does.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives explicit example queries ('show running containers', 'containers for web service', 'container status by image') indicating when to use this tool, but does not mention how it differs from sibling 'list-containers' or when not to use it.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_csm_coverageC
Get Cloud Security Management coverage across cloud accounts
| Name | Required | Description | Default |
|---|---|---|---|
| page_size | No | ||
| page_cursor | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must bear the full burden. It only states the function without disclosing behavioral traits such as pagination, permissions required, whether it is read-only, or what the response contains.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, concise sentence. However, it is too brief and lacks necessary detail, bordering on under-specification rather than effective conciseness.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool has 2 optional parameters and no output schema or annotations, the description is incomplete. It fails to explain pagination mechanics, coverage meaning, or what the response contains.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, and the description does not mention either parameter (page_size, page_cursor). It adds no meaning beyond the schema's names and types.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states 'Get Cloud Security Management coverage across cloud accounts', using a specific verb and resource. It distinguishes itself from sibling tools like 'get-security-finding' or 'list_csm_threats_agent_rules' by targeting CSM coverage specifically.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool vs. alternatives. It does not mention any prerequisites, exclusions, or scenarios where other tools would be more appropriate.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-dashboardA
Get full dashboard definition by ID. Returns all widgets, queries, and layout. Use after get-dashboards to explore a specific dashboard's contents and understand what metrics/data it displays.
| Name | Required | Description | Default |
|---|---|---|---|
| dashboardId | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description bears full responsibility. It implies a read operation but does not explicitly state safety (e.g., no side effects). Adequate but not fully transparent.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two efficient sentences with no superfluous information. Front-loaded with action and key details.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a single-parameter tool with no output schema, the description adequately covers purpose, return content, and usage order. Minor gap: does not specify if dashboardId is a UUID or other format.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, and the description mentions 'by ID' but does not explain the format or source of the dashboardId. It adds minimal value beyond the parameter name.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states it retrieves the full dashboard definition by ID, specifying it returns widgets, queries, and layout. This distinguishes it from sibling tool 'get-dashboards' which lists dashboards.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Explicitly instructs to use after 'get-dashboards' to explore a specific dashboard's contents, providing clear context for when this tool is appropriate.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-dashboardsA
List all Datadog dashboards. Use to answer 'what dashboards exist', 'find dashboard for API metrics', or to get dashboard IDs for get-dashboard. Returns dashboard names, IDs, and URLs.
| Name | Required | Description | Default |
|---|---|---|---|
| limit | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries full burden. It states the tool returns dashboard names, IDs, and URLs, which is transparent. However, it does not disclose any additional behavioral traits like rate limits or permissions, but for a simple list operation, this is adequate.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise with three sentences that each add value: stating the action, listing use cases, and describing the return data. No filler or redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The tool is simple (one optional parameter, no output schema), and the description covers its purpose, typical queries, and return fields. It could mention pagination or behavior when limit is exceeded, but the default and description of 'all dashboards' make it adequate.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
There is one parameter (limit) with 0% schema description coverage. The description does not mention the limit parameter or its default value, leaving the agent to infer its purpose from the schema alone. This is a gap in adding value beyond the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool lists all Datadog dashboards and provides example use cases. It differentiates from get-dashboard by mentioning it returns IDs, indicating how to get a specific dashboard.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives explicit contexts for use (e.g., 'what dashboards exist', 'find dashboard for API metrics') and mentions using it to get IDs for get-dashboard, but does not explicitly state when not to use it or mention alternatives among siblings.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_dbm_query_metricsC
Get Database Monitoring query metrics. Filter by database type, host, query text, and time range.
| Name | Required | Description | Default |
|---|---|---|---|
| filter_db_type | No | ||
| filter_host | No | ||
| filter_query | No | ||
| filter_from | No | ||
| filter_to | No | ||
| page_limit | No | ||
| page_cursor | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description must disclose behavioral traits, but it only states the action and filter options. It does not indicate whether the operation is read-only, any side effects, pagination behavior, rate limits, or data retention. This lack of transparency could lead to misuse.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is very concise at two sentences, front-loading the purpose. While it is efficient, the brevity sacrifices necessary detail for a tool with 7 parameters and no annotations. It balances well but could be slightly expanded without becoming verbose.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description lacks crucial context such as output format, pagination, required permissions, and time range formatting. Without annotations or output schema, the agent is left with insufficient information to invoke the tool correctly, especially given the complexity of 7 parameters.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The description mentions four filter parameters (database type, host, query text, time range) which map to filter_db_type, filter_host, filter_query, filter_from, and filter_to in the schema. However, it omits pagination parameters (page_limit, page_cursor) and does not specify expected formats (e.g., date-time for time range). Given the 0% schema description coverage, it adds some value but is incomplete.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool retrieves 'Database Monitoring query metrics' with filtering by specific attributes. This effectively identifies the resource and action. However, it does not differentiate from sibling tools like 'get-dbm-samples' which also deal with DBM data, so it loses some clarity in distinguishing itself.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives, such as other metrics tools or aggregate functions. It fails to mention prerequisites, context, or exclusions, leaving the agent without decision support for tool selection.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-dbm-samplesA
Get Database Monitoring query samples. Use for 'slow database queries', 'what queries are running on postgres', 'DB performance issues'. Returns query samples with execution time, affected rows, and database context.
| Name | Required | Description | Default |
|---|---|---|---|
| start | No | Start timestamp (Unix seconds) | |
| end | No | End timestamp (Unix seconds) | |
| source | No | Database type (e.g., 'postgresql', 'mysql') | |
| dbHost | No | Database hostname filter | |
| dbName | No | Database name filter | |
| limit | No | Max results to return |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must disclose behavior. It states it returns query samples with execution time, affected rows, and database context, implying a read-only operation. However, it omits details like authentication requirements, rate limits, or potential side effects.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise with two sentences. The first sentence states the action and resource, and the second provides use cases and return types. No extraneous information.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description covers the tool's purpose and return fields but lacks details on default behavior when optional parameters are omitted, pagination, result ordering, or limits on time range. With no output schema, more context on return structure would be beneficial.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema already describes all six parameters, so the baseline is 3. The description adds no additional parameter-specific meaning; it only mentions return fields (execution time, rows, context), which are not in the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool retrieves Database Monitoring query samples, with specific verb 'Get' and resource. It also provides concrete use cases like 'slow database queries' and 'DB performance issues', making the purpose unambiguous.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives clear example scenarios for when to use this tool, such as investigating slow queries or monitoring current query activity. However, it does not explicitly mention when not to use it or differentiate from sibling tools like 'get_dbm_query_metrics'.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-downtimesA
List scheduled maintenance downtimes in Datadog. Use for 'are there any active downtimes', 'what's scheduled for maintenance', 'why is this monitor muted'. Shows scope, schedule, and duration. Critical for on-call to understand muted monitors.
| Name | Required | Description | Default |
|---|---|---|---|
| currentOnly | No | Return only currently active downtimes | |
| include | No | Comma-separated list to include (e.g., 'created_by,monitor') | |
| pageOffset | No | Pagination offset | |
| pageLimit | No | Number of downtimes to return |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must disclose behavior. It indicates a read operation and mentions output scope/schedule/duration. However, it omits details on auth, rate limits, or pagination behavior beyond parameter hints.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is three sentences, front-loaded with the main action, and each sentence adds value. It is concise and well-structured without unnecessary words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's simplicity (list downtimes, 4 optional parameters, no output schema), the description covers purpose, usage, and output contents. It is nearly complete, though pagination behavior and output format are not described.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
All four parameters have descriptions in the input schema (100% coverage). The tool description adds no additional parameter meaning beyond what the schema already provides, meeting the baseline of 3.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states it lists scheduled maintenance downtimes and provides specific use cases. It distinguishes from many siblings but does not explicitly differentiate from the similar 'list_downtime_schedules' tool.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explicitly gives usage scenarios (e.g., 'are there any active downtimes') and notes it's critical for on-call. It does not provide exclusions or alternatives, but the guidance is clear and context-rich.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_error_tracking_issueA
Get details of a Datadog error tracking issue (user-facing error/exception) by ID
| Name | Required | Description | Default |
|---|---|---|---|
| issue_id | Yes | Error tracking issue ID |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries full burden. It indicates a read operation and that details are returned, but does not disclose authentication needs, rate limits, or potential side effects.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence with no unnecessary words, front-loading the key information efficiently.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no output schema, the vague 'details' leaves incomplete context about what is returned. However, the tool is simple with one parameter, so it is adequate but not thorough.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100% for the single parameter 'issue_id'. The description adds 'by ID' but does not provide additional semantic information beyond what the schema already states.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb ('get details'), resource ('Datadog error tracking issue'), and method ('by ID'). It distinguishes from sibling 'search_error_tracking_issues' which is for searching.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies usage when you have a specific issue_id, but does not explicitly state when not to use or mention alternatives like search. No guidance on prerequisites.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_estimated_costC
Get estimated cost data for your Datadog usage. Filter by date range and view type (sub_org, summary). Useful for cost monitoring and budget planning.
| Name | Required | Description | Default |
|---|---|---|---|
| view | No | ||
| start_month | No | ||
| end_month | No | ||
| start_date | No | ||
| end_date | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must convey behavioral traits. It indicates a read-like operation for cost data, but does not disclose idempotency, rate limits, or what happens on invalid input (e.g., malformed dates). The description is vague on side effects and safety.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise with two sentences. The first sentence states the primary purpose, and the second adds context about use case. It is front-loaded and wastes no words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool has 5 parameters, no output schema, and no annotations, the description is too brief. It does not explain the difference between start_month/end_month and start_date/end_date, how the view parameter values differ, or the structure of the returned cost data. The description leaves significant gaps for an agent to use the tool correctly.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, meaning the description adds no parameter-specific details. While it mentions 'date range and view type (sub_org, summary)', it does not map these to the five parameters (view, start_month, end_month, start_date, end_date) or explain their relationships. This is insufficient for a tool with multiple optional parameters.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool retrieves estimated cost data for Datadog usage, with filtering by date range and view type. It specifies the resource (cost data) and actions (get, filter), but does not explicitly differentiate from related siblings like get_hourly_usage or get-usage.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description mentions the tool is useful for cost monitoring and budget planning, providing some context. However, it does not specify when to use this tool over alternatives like get_hourly_usage or get-usage, nor does it provide any exclusions or prerequisites.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-eventsB
Query Datadog events within a time range. Events include deployments, alerts, configuration changes, and comments. Use for 'what happened yesterday', 'show deployment events', or correlating incidents with changes. Requires start/end as Unix timestamps.
| Name | Required | Description | Default |
|---|---|---|---|
| start | Yes | ||
| end | Yes | ||
| priority | No | ||
| sources | No | ||
| tags | No | ||
| unaggregated | No | ||
| excludeAggregation | No | ||
| limit | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations exist; description carries full burden. It states 'Requires start/end as Unix timestamps' which is useful. However, it does not disclose side effects (though query suggests read-only), rate limits, pagination behavior, or what the response contains. The description is adequate but not thorough.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise with two sentences. It covers purpose, examples, and key requirement. However, it could be more structured (e.g., bullet points) for better scanning. No unnecessary words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given 8 parameters (2 required) and no output schema, the description is incomplete. It only addresses start/end, ignoring other params and return format. An agent would lack information about filtering and response structure.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 0%, so description must explain parameters. Only start and end are mentioned as 'Unix timestamps'. The other six parameters (priority, sources, tags, unaggregated, excludeAggregation, limit) have zero explanation. This severely limits an agent's ability to correctly use them.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states 'Query Datadog events within a time range' and provides examples like 'deployments, alerts, configuration changes, and comments'. It suggests use cases such as 'what happened yesterday'. While it doesn't explicitly differentiate from sibling tools like get-audit-events, the focus on general events is implied. The verb and resource are specific.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides concrete use cases: 'what happened yesterday', 'show deployment events', correlating incidents with changes'. This gives agents good context for when to invoke. However, it does not include when not to use or mention alternative tools for specific event types.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-hostsA
List infrastructure hosts reporting to Datadog. Use for 'show production hosts', 'which hosts are muted', 'hosts running agent version X'. Returns host names, IPs, apps, agent info, and mute status. Essential for infrastructure visibility during incidents.
| Name | Required | Description | Default |
|---|---|---|---|
| filter | No | Filter hosts by name substring | |
| sortField | No | Field to sort by (e.g., 'name', 'apps', 'cpu') | |
| sortDir | No | Sort direction ('asc' or 'desc') | |
| start | No | Starting offset for pagination | |
| count | No | Number of hosts to return (max 1000) | |
| from | No | Unix timestamp to filter hosts seen after | |
| includeMutedHostsData | No | Include mute status and expiry | |
| includeHostsMetadata | No | Include host metadata (agent version, platform) |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full burden. It lists the returned fields (host names, IPs, apps, agent info, mute status) and implies a read-only operation. However, it fails to disclose pagination behavior, default sort, or any rate limits, which are important for a list operation.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise: three short sentences with no filler. The most critical information (purpose, use cases, output) is front-loaded and easy to parse.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a list tool with no output schema but well-documented parameters, the description covers the essential purpose and output fields. It lacks details on pagination and defaults, but these are partially covered by schema descriptions. Overall, it provides sufficient context for basic usage.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
All 8 parameters have descriptions in the input schema (100% coverage), so the baseline is 3. The description adds no parameter-specific guidance beyond the schema's descriptions.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states it lists infrastructure hosts from Datadog, with specific example queries that illustrate its scope. It effectively differentiates from siblings like get-active-hosts-count or list-fleet-agents by focusing on host details and mute status.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides concrete usage examples (e.g., 'show production hosts', 'which hosts are muted') that guide an agent on when to invoke this tool. However, it does not mention when not to use it or explicitly name alternative tools.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-host-tagsA
Get all tags associated with hosts. Use for 'what tags are on my hosts', 'which hosts have team:platform tag', or to understand host groupings. Returns a map of tag names to host lists.
| Name | Required | Description | Default |
|---|---|---|---|
| host_name | Yes | Host name to get tags for | |
| source | No | Tag source filter (e.g., 'datadog-agent', 'users', 'chef') |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided. Description discloses return format ('map of tag names to host lists') but lacks details on read-only nature, permissions, or rate limits. Adequate for a simple read tool.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two sentences with example queries, no filler. Front-loaded with main purpose. Every sentence adds value.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
No output schema but description explains return format. Parameter coverage complete. Usage examples provide context. Sufficient for a straightforward tag-listing tool.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema covers 100% of parameters. Description adds no additional parameter details beyond schema; example queries hint at usage but don't expand on format or constraints.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states 'Get all tags associated with hosts' with specific example queries. Distinguishes from sibling tools like list-hosts by focusing on tags.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Provides explicit use cases like 'what tags are on my hosts' and 'which hosts have team:platform tag'. Does not explicitly state when not to use, but examples cover typical scenarios.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_hourly_usageB
Get Datadog hourly usage by product family for cost analysis
| Name | Required | Description | Default |
|---|---|---|---|
| filter_timestamp_start | Yes | Start time (ISO 8601, required) | |
| filter_timestamp_end | No | End time (ISO 8601) | |
| filter_product_families | Yes | Comma-separated product families (e.g. infra_hosts,logs) | |
| page_limit | No | Max results per page | |
| page_next_record_id | No | Pagination record ID |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must carry the full behavioral burden. It only states the purpose but does not disclose side effects, authentication requirements, rate limits, or data scope. The read-only nature is implied but not explicit.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
A single concise sentence that is front-loaded with the tool's purpose. No unnecessary words, making it efficient for an agent to parse.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
With 5 parameters, no output schema, and no annotations, the description lacks details on return format, pagination behavior, or filtering semantics. It feels incomplete for a data retrieval tool.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the input schema already explains each parameter. The description adds no further meaning beyond what the schema provides, meeting the baseline but not exceeding it.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool retrieves Datadog hourly usage by product family for cost analysis, with a specific verb and resource. It distinguishes from siblings like get_usage or get_estimated_cost by focusing on hourly granularity and product family breakdown.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives like get_usage or get_estimated_cost. The description does not mention preferred scenarios or exclusions, leaving the agent without decision support.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-incidentsB
List Datadog incidents for incident management. Use for 'show active incidents', 'what incidents happened this week', or 'find incidents related to payments'. Includes severity, status, commander, and timeline.
| Name | Required | Description | Default |
|---|---|---|---|
| pageSize | No | ||
| pageOffset | No | ||
| query | No | ||
| limit | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided, so description bears full burden. It only states 'List' (read operation) and mentions included fields, but omits pagination, rate limits, authentication requirements, or any limitations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Three sentences, front-loaded with purpose, no redundant information. Efficient and structured for quick comprehension.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Despite moderate complexity (4 params, no annotations, no output schema), description lacks detail on return format, pagination behavior, filtering semantics, and sibling tool distinctions. Incomplete for an agent to use correctly without external knowledge.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%. Description does not explain parameters like pageSize, pageOffset, or limit. Example usage for query is implicit but not explained. Provides minimal added meaning beyond schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Clear verb+resource: 'List Datadog incidents for incident management.' Provides specific example use cases that distinguish it from other incident-related tools like get_incident_services or get_incident_timeline.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Gives example phrases like 'show active incidents', but does not contrast with sibling tools such as search_incidents or other listing tools. Usage guidance is implied but not explicit about when to choose this over alternatives.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_incident_servicesA
List incident services used for categorizing and routing incidents. Filter by name and paginate results.
| Name | Required | Description | Default |
|---|---|---|---|
| page_size | No | ||
| page_offset | No | ||
| filter | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations exist, so the description must convey behavior. It states the operation (list) but omits details like permissions, rate limits, data freshness, or side effects. It is not contradictory but minimally informative.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two sentences: first defines purpose, second specifies parameters. No redundant or unnecessary words. It is well-structured and front-loaded.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple list tool with pagination and filter, the description covers the essential functionality. However, it lacks details on output format and default pagination values, leaving minor gaps.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%. The description clarifies only the 'filter' parameter ('Filter by name'), providing no context for page_size or page_offset, such as defaults or boundaries.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states 'List incident services used for categorizing and routing incidents', specifying the verb 'List', resource 'incident services', and their purpose. It distinguishes from siblings like get-incidents and search_incidents.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The tool's purpose is clear and appropriate for listing incident services; no explicit when-not-to-use or alternatives are mentioned, but the context of sorting through siblings implies it is the only tool for this resource.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_incident_timelineC
Get timeline events for a Datadog incident. Shows status changes, messages, tasks, notifications.
| Name | Required | Description | Default |
|---|---|---|---|
| incident_id | Yes | ||
| page_size | No | ||
| page_offset | No | ||
| filter_type | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden of behavioral disclosure. It notes the types of events shown, but does not mention pagination behavior, rate limits, ordering, or whether the operation is read-only. The listing of event types adds only partial transparency.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise with one brief sentence and a list of event types. It front-loads the purpose, but could be better structured to include parameter usage or example values. Overall, it is fairly efficient but could improve readability.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool retrieves a timeline with four parameters and no output schema, the description is too sparse. It lacks details on response structure, pagination, parameter roles, and how to filter events. The agent cannot confidently use the tool correctly based solely on this description.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0% and the description does not explain any of the four parameters (incident_id, page_size, page_offset, filter_type). No meaning is added beyond the schema field names, leaving the agent without guidance on parameter values or usage.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool gets timeline events for a Datadog incident, with specific examples like status changes, messages, tasks, and notifications. It uses a specific verb and resource, distinguishing it from siblings such as get-incidents and get_incident_todos.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description does not provide any guidance on when to use this tool versus alternatives, no prerequisites or exclusions. It only states what it shows, leaving the agent to infer usage context without explicit direction.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_incident_todosA
Get action items/todos for a specific Datadog incident
| Name | Required | Description | Default |
|---|---|---|---|
| incident_id | Yes | Incident ID |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must disclose behavioral traits. It only states the action (get) without clarifying whether it is read-only, destructive, or requires special permissions. This is minimal disclosure for a retrieval tool.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence of 8 words, with no wasted text. It is front-loaded with the action and resource, achieving maximum conciseness.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple tool with one parameter and no output schema, the description is adequate. It explains the tool's purpose and input. However, it omits details about return format or pagination, but these are not critical given the tool's simplicity.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema provides a description for the single parameter (incident_id: 'Incident ID'), covering 100% of parameters. The description adds no additional meaning beyond what the schema already states, so a baseline score of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool retrieves action items/todos for a specific Datadog incident, with a specific verb and resource. It distinguishes from sibling tools like get_incidents (which retrieves incidents) and get_incident_timeline.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description does not provide explicit guidance on when or when not to use this tool. It implies usage for retrieving incident todos but lacks exclusions or alternatives, leaving the agent to infer context from the tool name.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_ip_rangesA
Get Datadog IP ranges used by agents, APIs, APM, logs, process collection, synthetics, and webhooks. Useful for firewall/allowlist configuration.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description must fully disclose behavior. It states the tool 'gets' IP ranges, implying a read operation, but offers no details on side effects, permissions, or rate limits. Basic transparency is present but lacks depth.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description consists of two concise sentences. The first sentence delivers the core purpose, and the second adds a common use case. No extraneous words, efficiently front-loaded.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool has no parameters, no output schema, and no annotations, the description covers the essential purpose and a typical use case. However, it could be more complete by hinting at the response format (e.g., CIDR blocks) to aid post-invocation handling.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has zero parameters, so schema description coverage is 100%. The description does not need to add parameter meaning; the baseline score of 4 applies. No additional value is required.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly specifies the action ('Get'), the resource ('Datadog IP ranges'), and the scope (agents, APIs, APM, logs, etc.). It distinguishes this tool from siblings by focusing on IP range retrieval, a unique functionality among listed tools.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides a practical use case ('firewall/allowlist configuration') but does not explicitly state when to use this tool versus alternatives, nor does it mention when not to use it. The context is implied but not fully directive.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-log-indexesA
List all log indexes and their configuration. Use for 'where are logs being stored', 'what retention is configured', 'which logs are being excluded'. Returns index names, filters, retention days, daily limits, and exclusion filters.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided; description lists return fields but does not disclose side effects, rate limits, or authentication needs. As a simple read operation, it is adequate but not exhaustive.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two sentences front-load the action and usage context, followed by return fields. No unnecessary words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Despite no output schema or annotations, the description provides action, usage guidance, and return fields, making it self-contained for a simple list tool.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
There are no parameters; schema coverage is 100%. The description adds no parameter info but meets the baseline for a zero-parameter tool.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states it lists all log indexes and their configuration, and provides example queries and return fields, distinguishing it from siblings like search-logs and get-logs-archives.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
It gives explicit use cases (e.g., 'where are logs being stored', 'what retention is configured') but does not state when not to use or mention alternatives, though the context is clear.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-log-pipelinesA
List all log processing pipelines. Use for 'how are logs being processed', 'which pipelines are active', 'what parsing rules exist'. Returns pipeline names, filters, processors, and enabled status. Essential for understanding log processing configuration.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries full burden. It states the tool lists all pipelines and returns specific fields (names, filters, processors, enabled status). It does not mention side effects or authorization, but for a read-only list tool, this is sufficient.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description consists of four sentences, each adding value. It is front-loaded with the core action. Slightly redundant in the last sentence ('Essential for understanding...'), but overall concise.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description is complete for a zero-parameter list tool. It covers the return value ('pipeline names, filters, processors, and enabled status') and provides context for when it's essential. No output schema exists, but the description fills the gap.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
There are zero parameters, so schema coverage is 100%. The description adds no parameter details, but none are needed. Baseline for zero parameters is 4, and the description meets that.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states 'List all log processing pipelines' with a specific verb and resource. It distinguishes from sibling tools by focusing on pipelines, not indexes or metrics, and provides example queries like 'how are logs being processed'.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explicitly lists use cases: 'Use for ...' which gives clear context. However, it does not mention when not to use this tool or name alternatives among siblings like get-log-indexes.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_logs_archive_orderA
Get the ordered list of log archive IDs, showing the priority order for log archiving.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries full burden. It states 'Get' implies a read operation, but does not disclose side effects, authentication needs, rate limits, or what 'priority order' means. The behavioral transparency is minimal.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence that efficiently conveys the purpose and result. It is front-loaded and contains no unnecessary words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's simplicity (zero parameters, no output schema, no annotations), the description is adequate. It explains what is returned and why. However, it could mention that this is a configuration read or that the order reflects processing priority.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has zero parameters, and schema coverage is 100% (trivially). Per guidelines, baseline is 4. The description adds no parameter information, but none is needed. It does not clarify that no input is required, but this is implied by the empty schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool retrieves an ordered list of log archive IDs and explains it shows priority order. The verb 'Get' and resource 'ordered list of log archive IDs' are specific and distinct from siblings like 'get-logs-archives' which likely returns a list of archives, not an order.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives (e.g., 'get-logs-archives'). The description does not provide context for selection or exclusions, leaving the agent to infer usage from the name alone.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-logs-archivesB
Get log archive configurations showing where logs are stored
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided, so description must fully disclose behavior. Only states it is a get (read) operation, but gives no details on response structure, authentication, or whether any side effects exist.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence, no wasted words, directly communicates purpose. Front-loaded and efficient.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Describes core function but lacks details on output format, pagination, or exceptions. Given no output schema, more context would be beneficial, but for a simple list operation it is minimally adequate.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema has 0 parameters with 100% coverage. Description adds no parameter info, but baseline is 3 per rules since schema is sufficient.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states verb 'Get', resource 'log archive configurations', and purpose 'showing where logs are stored'. Distinguishes from siblings like get-log-indexes or get-logs-pipelines.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives. Does not mention that it retrieves configurations only, not logs themselves, or that it returns all archives without filtering.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-logs-indexesB
Get log index configurations including retention and exclusion filters
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The description only states 'Get', implying a read-only operation, but with no annotations, it fails to disclose any behavioral details such as data freshness, permission requirements, or rate limits. The description does not add value beyond the verb.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence that is concise and front-loaded with the key purpose. Every word contributes meaning without redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given zero parameters and no output schema, the description is adequate for a simple retrieval tool. However, it does not mention pagination, sorting, or any constraints, leaving room for improvement in completeness for an agent unfamiliar with the API.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
There are no parameters, so the schema coverage is 100% vacuously. The description adds meaning by specifying that the tool returns configurations including retention and exclusion filters, helping the agent understand the content of the response. This meets the baseline for zero-parameter tools.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states 'Get log index configurations including retention and exclusion filters', specifying the verb, resource, and what the configurations include. It distinguishes from similar sibling tools like 'get-log-indexes' by adding detail about retention and exclusion filters, but does not explicitly differentiate them.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives like 'get-log-indexes' or other log-related tools. The agent has no context for selection.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-logs-metricsA
Get all log-based metric configurations
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description should disclose behavioral traits. It states 'Get all', but omits whether results are paginated, require authentication, or what happens if no configurations exist. Acceptable for a simple retrieval.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Minimal one-sentence description that conveys purpose without wasted words. Could be slightly expanded to add value, but remains concise.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the absence of parameters and output schema, the description is moderately complete. However, it lacks context on what log-based metric configurations are or how this tool differs from similar siblings like 'list_logs_metrics'.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
No parameters exist in the schema; baseline for zero parameters is 4. The description adds no param information, which is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description uses a specific verb ('Get') and identifies the resource ('all log-based metric configurations'), clearly distinguishing it from sibling tools that retrieve metrics or other entities.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives like 'list_logs_metrics' or 'get-metrics'. The description provides no exclusions or context for appropriate use.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_logs_pipeline_orderA
Get the ordered list of log pipeline IDs, showing the processing order for log pipelines.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description is the sole source. It describes the output (ordered IDs, processing order) but does not disclose potential side effects, permissions needed, or data limitations. For a simple read-only tool with no parameters, this is adequate but not comprehensive.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence with no unnecessary words. It front-loads the core action and result. Every word adds value, making it concise and well-structured.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the low complexity (no parameters, no output schema, no annotations), the description is fairly complete. It specifies what is returned and the key property (order). Minor gaps exist (e.g., no mention of data freshness or sorting direction), but these are not critical for a simple list tool.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has no parameters, and schema coverage is 100%. The description does not need to add parameter details. According to guidelines, baseline is 4 for zero parameters, and the description adds no extra parameter semantics beyond the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states it retrieves the ordered list of log pipeline IDs, showing processing order. It is specific about the resource ('log pipeline IDs') and the verb ('Get'), and it distinguishes from similar list tools (e.g., 'get-log-pipelines') by emphasizing order.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives. While it implies use when ordering matters, it does not explicitly tell the agent when not to use it or mention sibling tools like 'get-log-pipelines' for unordered lists.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-logs-pipelinesC
Get log processing pipeline configurations
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries full burden but only states 'Get', implying a read operation. It fails to disclose whether all pipelines are returned, if pagination exists, or authentication requirements.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence with no waste, but it is too minimal—essentially just repeating the tool name. It could be more informative without adding length.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no output schema and no parameters, the description is adequate at a basic level but does not specify the return format or scope. It leaves gaps for an agent needing to understand the output.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
No parameters exist, and schema coverage is 100% (trivially). Description adds no parameter info, but baseline is 3 per guidelines when schema coverage is high.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states it retrieves 'log processing pipeline configurations' with a specific verb and resource. However, it does not distinguish itself from similar sibling tools like get-log-pipelines or get-log-indexes, lacking differentiation.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No usage guidance is provided. There is no indication of when to use this tool over alternatives, nor any exclusions or prerequisites. The context is purely implied.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-metric-metadataA
Get metadata for a specific metric name. Returns type (gauge/count/rate), unit, description, and integration. Use when you need to understand what a metric measures, e.g., 'what does system.cpu.user mean'.
| Name | Required | Description | Default |
|---|---|---|---|
| metricName | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries full burden. It states the return fields but does not explicitly disclose that the operation is read-only or safe, nor does it mention authentication, rate limits, or side effects. While the example implies a lookup, the description lacks explicit behavioral guarantees.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two sentences: first states purpose and return fields, second gives usage guidance with an example. Every sentence adds value, no wasted words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's simplicity (one required parameter, no output schema), the description covers the primary use case, return fields, and provides an example. It is sufficient for an agent to understand and invoke the tool correctly.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The schema has 0% description coverage for the single parameter 'metricName'. The description provides an example usage ('what does system.cpu.user mean') which hints at the expected value format, but does not specify syntax, case sensitivity, or constraints beyond the required flag. This adds value but falls short of fully compensating for the lack of schema descriptions.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states 'Get metadata for a specific metric name' and lists the returned fields (type, unit, description, integration). It also provides a concrete example, 'what does system.cpu.user mean', which distinguishes it from sibling tools like 'get-metrics' or 'query-metrics'.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description says 'Use when you need to understand what a metric measures' with a usage example, but does not explicitly mention when not to use it or how it differs from siblings like 'get-metrics' (which lists metrics) or 'query-metrics' (which retrieves data). Usage guidance is implied rather than explicit.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-metricsB
Search for available Datadog metrics by name pattern. Use to discover metrics like 'what CPU metrics exist' or 'find metrics for service X'. Parameter q searches metric names (e.g., q='aws.ec2' finds all EC2 metrics).
| Name | Required | Description | Default |
|---|---|---|---|
| q | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden. It mentions the tool searches by name pattern but does not disclose behavioral traits such as whether it is read-only, authentication requirements, rate limits, or pagination behavior. The description lacks sufficient transparency for a tool without annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise, containing two sentences and a parenthetical example. It is front-loaded with the primary purpose and quickly provides usage context. No extraneous information.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple tool with one parameter and no output schema, the description covers the main purpose and parameter usage. However, it lacks details on return format, possible empty results, or performance considerations. It is adequate but not comprehensive.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The schema has 0% description coverage for the single parameter 'q'. The description compensates by explaining that 'q searches metric names' and provides an example. While it adds meaning beyond the schema, it could be more precise about pattern matching (e.g., wildcard support).
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool searches for available Datadog metrics by name pattern, using the verb 'search' and specifying the resource. It provides examples that help distinguish from possible data querying tools like 'query-metrics', though not explicitly differentiating.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description indicates when to use the tool ('to discover metrics') but does not explicitly state when not to use it or mention alternative tools like 'query-metrics' for fetching metric values. The usage context is implied rather than explicit.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_metric_tag_configA
Get tag configuration for a specific metric. Shows which tags are indexed and queryable.
| Name | Required | Description | Default |
|---|---|---|---|
| metric_name | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The description discloses that the tool shows indexed and queryable tags, which is helpful for understanding the output. It is a read operation, but no annotations exist; the description is adequate for this simple get tool.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two sentences, front-loaded with purpose, no superfluous words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple 1-parameter tool without output schema, the description covers the purpose and result nature. Missing an example or note on metric_name format, but generally complete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
With 0% schema description coverage, the description does not elaborate on the metric_name parameter beyond its name, lacking details on expected format or constraints.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states it retrieves tag configuration for a specific metric, distinguishing it from sibling tools like list_metric_tag_configs which list all configurations.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies usage for a specific metric but does not explicitly contrast with alternatives like list_metric_tag_configs or provide when-to-use/not-to-use guidance.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-monitorA
Get full details for a specific monitor by ID. Use after get-monitors to dive deeper into a specific monitor's configuration, thresholds, query, and current state. Returns complete monitor definition.
| Name | Required | Description | Default |
|---|---|---|---|
| monitorId | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided, so description carries full burden. It states returns 'complete monitor definition' implying read-only, but does not explicitly confirm no side effects. Minimum viable for a simple get operation, but could be more explicit about no mutation.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two sentences, front-loaded with action and resource, followed by usage context. Every word earns its place. No wasted text.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple tool with one parameter and no output schema, the description is complete: it explains purpose, usage sequence, and return content. No additional information needed.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 0% and description only says 'by ID' which adds little beyond schema. The parameter monitorId is a number with no format or source hints. Description could have explained how to obtain the ID from get-monitors, but does not. Minimal semantic help.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'Get', the resource 'full details for a specific monitor by ID', and differentiates from sibling 'get-monitors' by specifying it is a follow-up drill-down. It also mentions return content: configuration, thresholds, query, current state.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Provides explicit usage context: 'Use after get-monitors to dive deeper into a specific monitor's configuration...' This clearly indicates it is intended as a follow-up step after listing monitors. While no explicit when-not-to-use or alternatives are given, the context is sufficient for an AI agent.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_monitor_config_policiesA
Get monitor configuration policies that enforce tag and setting requirements on monitors across your organization.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, and the description does not disclose behavioral traits such as read-only nature, authentication requirements, or side effects. For a tool with no annotations, the description should compensate but only states basic functionality.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence that conveys the purpose efficiently without extra words. Every part is meaningful for understanding the tool's function.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the simplicity (no parameters, no output schema), the description adequately explains what the tool retrieves. Lacks details on output structure or scope, but sufficient for basic understanding.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has zero parameters with 100% schema coverage. Since there are no parameters to document, the description naturally adds no parameter information. Baseline for no parameters is 4.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states verb 'Get' and specific resource 'monitor configuration policies' with explanation of their purpose (enforce tag and setting requirements). Distinct from sibling tools like get-monitor, which retrieves individual monitors rather than policies.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No explicit when-to-use or alternatives are provided. Usage is implied by the tool's purpose, but there is no guidance on when not to use this tool or how it relates to similar tools like get-monitor or get-downtimes.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-monitorsA
List Datadog monitors with filtering. Use for questions like 'show alerting monitors', 'what monitors are in warning state', or 'monitors tagged with team:platform'. Filter by groupStates: 'alert', 'warn', 'no data', 'ok'. Use get-monitor for a single monitor's full details.
| Name | Required | Description | Default |
|---|---|---|---|
| groupStates | No | ||
| tags | No | ||
| monitorTags | No | ||
| limit | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries full burden. It mentions filtering but does not disclose behavioral traits such as authentication needs, rate limits, pagination behavior, or whether the operation is read-only. For a list operation, this is adequate but not comprehensive.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is very concise with three sentences. It front-loads the main action, provides examples, and directs to the sibling tool. No extraneous information.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the lack of annotations and output schema, the description covers core purpose and usage but omits details on return format, pagination, and behavior of all parameters. It is functional but not fully complete for a listing tool with 4 parameters.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, so the description must compensate. It adds meaning for groupStates by listing possible values, but tags, monitorTags, and limit are not described beyond the schema examples. The limit parameter's default is not mentioned. This is insufficient for a 4-parameter tool with no schema descriptions.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states 'List Datadog monitors with filtering' and distinguishes from sibling 'get-monitor' by noting it is for a single monitor's full details. The verb 'list' and resource 'monitors' are specific, and the differentiation from the alternative tool is explicit.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides explicit usage examples like 'show alerting monitors' and 'monitors tagged with team:platform', and advises to use 'get-monitor' for single monitor details. This offers clear when-to-use and when-not-to-use guidance.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_notebookA
Get a specific Datadog notebook by ID with all cells and content
| Name | Required | Description | Default |
|---|---|---|---|
| notebook_id | Yes | Notebook ID |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden of behavioral disclosure. It adds the detail that the tool returns 'all cells and content', which is useful. However, it does not mention any side effects, authentication needs, or limitations. For a read operation, this is adequate but minimal.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, front-loaded sentence that efficiently conveys the tool's purpose. No extraneous words or unnecessary details. Ideal for quick parsing by an AI agent.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the simple tool (one required parameter, no output schema), the description is fairly complete. It specifies what the tool does and what it returns. It could mention output format or error handling but is sufficient for an agent to understand the basic function.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% for the single parameter 'notebook_id', with a description 'Notebook ID'. The description adds no additional meaning beyond what the schema provides. Baseline score of 3 is appropriate as the schema already documents the parameter sufficiently.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action ('Get'), the resource ('a specific Datadog notebook'), and the scope ('by ID with all cells and content'). It distinguishes from sibling tools like 'get-notebooks' which likely list notebooks. The specificity of 'by ID' and 'all cells and content' provides high clarity.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies usage context: use when you have a specific notebook ID and need full content. However, it lacks explicit guidance on when to use this tool vs. alternatives like 'get-notebooks' or 'list_notebooks'. The sibling list includes many similar tools but no exclusions are mentioned.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-notebooksB
List Datadog notebooks. Use for 'show investigation notebooks', 'find notebooks by team', or 'recent notebooks about outage'. Notebooks are collaborative documents used during incidents and investigations.
| Name | Required | Description | Default |
|---|---|---|---|
| authorHandle | No | Filter by author's email handle | |
| excludeAuthorHandle | No | Exclude specific author | |
| count | No | Number of notebooks to return | |
| start | No | Pagination offset | |
| sortField | No | Sort field ('modified' or 'name') | |
| sortDir | No | Sort direction ('asc' or 'desc') | |
| query | No | Search notebooks by text | |
| includeCells | No | Include notebook cell content | |
| isTemplate | No | Filter by template status | |
| type | No | Filter by notebook type |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must fully disclose behavior. It only states 'List...' and defines notebooks as collaborative documents. It fails to mention pagination (start, count), sorting effects, rate limits, or authentication requirements. The agent gets minimal behavioral context.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two sentences with zero waste. The first sentence immediately states the primary action. The second sentence provides context. Every word earns its place.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
With 10 parameters, no output schema, and no annotations, the description is too brief. It does not explain pagination, sorting, filtering, or the structure of the response. A more detailed description is warranted given the tool's complexity.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
All 10 parameters have descriptions in the input schema, providing full coverage. The description does not add any additional meaning beyond what the schema already offers. Baseline score of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states 'List Datadog notebooks' and provides example use cases like 'show investigation notebooks'. It is specific and actionable, but does not differentiate from the sibling tool 'list_notebooks' which would perform a similar function.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description includes example queries when to use ('show investigation notebooks', 'find notebooks by team', 'recent notebooks about outage'), but does not explicitly contrast with the sibling 'list_notebooks' or other listing tools. Guidance is present but lacks exclusionary information.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_organizationA
Get your Datadog organization info including name, plan, public ID, and settings. Essential for understanding account configuration.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries full burden. It only states that it retrieves info, but does not mention behavioral traits like read-only nature, idempotency, authentication requirements, or rate limits.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two sentences with no wasted words. It front-loads the action and resource, making it easy to scan.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool has no parameters and returns organization info, the description is fairly complete. It covers what is retrieved and its purpose. However, it could mention response format since there is no output schema.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
There are zero parameters, and the schema coverage is 100% (empty). The description adds value by listing the specific information returned (name, plan, public ID, settings), which goes beyond the empty schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action ('Get...org info') and specifies what is included (name, plan, public ID, settings). Among siblings, there is no other tool that retrieves organization information, so it is distinct.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description says it's 'essential for understanding account configuration' but does not explicitly state when to use this tool versus alternatives or when not to use it. No mention of exclusions or alternatives.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-powerpacksC
Get reusable dashboard widget templates (Powerpacks)
| Name | Required | Description | Default |
|---|---|---|---|
| page_limit | No | Maximum number of results | |
| page_offset | No | Page offset |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided, so description must disclose behavior. It only says 'Get', implying a read operation, but does not confirm read-only behavior, pagination details, permissions needed, or the form of the result. Minimal transparency.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence, front-loaded with verb and resource. No fluff, but could provide slightly more detail without losing conciseness. Efficient.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Tool is simple with 2 params and no output schema. Description explains what it fetches but not the return format (list of objects?), pagination behavior, or how results are ordered. Leaves questions for the agent.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, with both page_limit and page_offset described. The description adds no extra meaning beyond the schema. Baseline 3 is appropriate since schema fully documents parameters.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states verb 'Get' and resource 'reusable dashboard widget templates (Powerpacks)'. It distinguishes from sibling tools as no other powerpack-related tool exists. However, it could elaborate on what a Powerpack is (e.g., a dashboard template).
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool vs alternatives. No mention of prerequisites, filtering, or context where this might be preferred over other get/list tools. The description solely explains what it does without usage context.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-security-findingA
Get a legacy CSPM/CIEM finding by ID (posture_management). Note: this endpoint uses the legacy data model. Requires the security_monitoring_findings_read scope.
| Name | Required | Description | Default |
|---|---|---|---|
| findingId | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description partially covers behavior by mentioning the legacy data model and required scope ('security_monitoring_findings_read'). However, it lacks details on potential errors, idempotency, or response structure, leaving gaps in transparency.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise with two sentences, front-loading the core action and resource. Every word adds value, making it efficient and easy to parse.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple get-by-ID tool with one parameter and no output schema, the description covers the key aspects: purpose, legacy model, and required scope. It does not explicitly state the return format, but this is implied. Adequate for the complexity.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 0%, but the description adds meaning by clarifying that 'findingId' is the ID of a legacy CSPM/CIEM finding. This gives context beyond the bare parameter name in the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action ('Get'), the resource ('legacy CSPM/CIEM finding'), and the method ('by ID'). It distinguishes from sibling tools like 'list-posture-findings' and 'search-security-findings' by specifying retrieval of a single finding by identifier.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies usage for fetching a specific finding by ID and notes the legacy data model, but does not explicitly state when to use alternatives or provide exclusion criteria. Siblings like 'search-security-findings' are not mentioned.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_sensitive_data_scanner_configA
Get Sensitive Data Scanner configuration including scanning groups and rules for PII/sensitive data detection.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must carry the full burden. It only states the tool retrieves configuration, with no mention of read-only behavior, authentication needs, rate limits, or side effects.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, informative sentence that is front-loaded and contains no redundant or extraneous words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
With no parameters and no output schema, the description adequately covers the tool's purpose and scope. It could mention that the return value includes scanning groups and rules, which it does.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has no parameters (100% coverage), so the description does not need to add parameter details. The baseline is 4, and the description does not detract.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'Get', the resource 'Sensitive Data Scanner configuration', and specifies what it includes ('scanning groups and rules for PII/sensitive data detection'). It is distinct from sibling get tools as it targets a specific configuration.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool vs alternatives, no exclusions, and no context about prerequisites or typical use cases.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-service-definitionA
Get a single service definition by name from the Service Catalog. Use for 'show service X details', 'what team owns service Y', 'service definition for Z'.
| Name | Required | Description | Default |
|---|---|---|---|
| serviceName | Yes | The service name to look up | |
| schemaVersion | No | Schema version: v1, v2, v2.1, or v2.2 |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries full burden. It correctly indicates a read operation (getting a definition) but lacks details on side effects, permissions, or rate limits. It is minimally adequate.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise: one sentence plus example phrases. Every part is useful, no wasted words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
No output schema is provided, and the description does not describe the return value structure. While the tool is simple, a mention of the response format would improve completeness.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so baseline is 3. The description and schema both describe 'serviceName' and 'schemaVersion' clearly, but the description adds no extra meaning or context beyond what the schema already provides.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states it gets a single service definition by name, with example queries like 'show service X details' and 'what team owns service Y'. This distinguishes it from sibling tools such as 'list-service-definitions' which would list all.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides explicit use cases ('Use for...'), giving clear context. It does not explicitly state when not to use or alternatives, but the examples imply appropriate scenarios.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-service-dependenciesA
Get service dependency graph for APM services in a given environment
| Name | Required | Description | Default |
|---|---|---|---|
| env | Yes | Environment name (e.g. production, staging) |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, and the description does not disclose behavioral traits such as read-only nature, permissions required, rate limits, or return value characteristics. The name suggests a read operation but lacks explicit disclosure.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence of 12 words, efficiently conveying the purpose without unnecessary detail. It is appropriately front-loaded.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's low complexity, the description is adequate but does not mention the return format or output structure. It tells what the tool does but not what the response will contain, leaving some gaps.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema covers the single parameter 'env' with a clear description. The tool description does not add additional meaning beyond what the schema already provides, so baseline score of 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'Get', the resource 'service dependency graph', and the scope 'for APM services in a given environment'. It distinguishes from sibling tools like 'get-services' and 'get-service-definition'.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies usage for retrieving dependency graphs but provides no explicit guidance on when to use this tool versus alternatives, nor any exclusions or prerequisites.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-servicesA
List all APM-instrumented services. Use to discover traced services, find service names for span queries, or get an overview of your distributed system. Returns service names and their environments.
| Name | Required | Description | Default |
|---|---|---|---|
| env | No | Filter services by environment |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations exist. The description discloses read-only trait (lists services) and return values (names and environments). It does not mention pagination, rate limits, or authentication needs, but for a simple list tool, this is adequate.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is three concise sentences: what it does, when to use it, what it returns. No extraneous content.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
No output schema exists, but the description mentions return values (service names and environments). It lacks mention of pagination or limits, and does not guide users to related tools like get-service-definition for detailed info. Still, it covers the essential context for a simple list operation.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema has one optional parameter 'env' with description. The description adds no additional semantics beyond what the schema provides. With 100% schema coverage, baseline 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states it lists all APM-instrumented services and mentions use cases like discovering traced services and getting an overview. It distinguishes from siblings like get-service-definitions, which return detailed metadata, but does not explicitly contrast with list-service-definitions.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides usage context (discover services, find names for span queries), but does not specify when to avoid this tool or mention alternatives. Implicit guidance is present but lacking explicit exclusion criteria.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-sloA
Get detailed SLO information by ID. Returns error budget remaining, burn rate, target vs actual, thresholds, and configured alerts. Use after get-slos to understand a specific SLO's health and history.
| Name | Required | Description | Default |
|---|---|---|---|
| sloId | Yes | The ID of the SLO to retrieve | |
| withConfiguredAlertIds | No | Include IDs of monitors configured as SLO alerts |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided, so description carries full burden. Lists returned fields but does not disclose read-only behavior, idempotency, or error conditions. Adequate but could be more transparent.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Extremely concise: two sentences, front-loaded with purpose. Every word adds value, no redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no output schema, description enumerates key return fields. Includes usage context. Lacks error handling details, but sufficient for typical use.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% with descriptions for both parameters. The description adds no additional parameter semantics beyond the schema, so baseline score is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Clearly states it retrieves detailed SLO information by ID, listing specific fields like error budget remaining and burn rate. Distinguishes from sibling 'get-slos' by advising use after that tool.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Provides clear sequential usage guidance ('Use after get-slos'). However, does not explicitly mention when not to use or compare with alternatives like get-slo-history or search_slos.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_slo_correctionsC
List all SLO corrections (status adjustments) across your organization. Shows maintenance windows and planned downtime exclusions that affect SLO calculations.
| Name | Required | Description | Default |
|---|---|---|---|
| offset | No | ||
| limit | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must convey behavioral traits. It describes the tool as listing corrections affecting SLO calculations, but does not disclose response format, pagination behavior, permission requirements, or whether it is read-only. This is minimal disclosure.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two sentences, front-loaded with the main action. It is concise and directly states the tool's purpose. No unnecessary words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool has 2 parameters with no descriptions, no output schema, and no annotations, the description covers the basic purpose but lacks detail on response shape, pagination, and parameter usage. It is adequate but incomplete for optimal agent usage.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 0% and the description does not mention the parameters offset and limit. The schema provides no descriptions, so the agent relies entirely on inference. The description adds no semantic value for parameters.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool lists all SLO corrections (status adjustments) across the organization, specifying it includes maintenance windows and planned downtime exclusions. It distinguishes itself from sibling tools like get-slo and get-slo-history by focusing specifically on corrections.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No explicit guidance on when to use this tool versus alternatives. The description does not mention prerequisites, limitations, or when not to use it. Sibling tools exist (e.g., search_slos) but no comparison is provided.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-slo-historyA
Get historical SLO data over a time range. Use after get-slo to see 'SLO performance last 30 days', 'error budget consumption over time', or 'SLI trend for checkout service'. Returns SLI values, thresholds, and time range data.
| Name | Required | Description | Default |
|---|---|---|---|
| sloId | Yes | The SLO ID | |
| fromTs | Yes | Start time as Unix epoch seconds | |
| toTs | Yes | End time as Unix epoch seconds | |
| target | No | SLO target percentage for calculations |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided, so description must disclose behavior. It mentions return data (SLI values, thresholds, time range) but does not cover side effects (none expected, as read-only), rate limits, or detailed behavior like whether it aggregates data. Adequate but minimal.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two sentences: first states the core function, second adds usage examples and output summary. No unnecessary words, front-loaded, efficient.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Lacks output schema, so description should clarify return format. Mentions SLI values, thresholds, and time range, which covers key elements. For a simple historical query, this is reasonably complete, though details on data points or aggregation could improve completeness.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Input schema already describes all 4 parameters with 100% coverage (e.g., 'Start time as Unix epoch seconds'). Description adds contextual usage ('Use after get-slo') but no additional parameter meaning beyond schema. Baseline 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Clearly states it retrieves historical SLO data over a time range, with specific example queries (e.g., 'SLO performance last 30 days'). Distinguishes from sibling 'get-slo' which gets a single SLO's details and 'get-slos' which lists SLOs.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Suggests using it after get-slo, providing context for typical use cases. However, lacks explicit when-not-to-use or alternative tools (e.g., when to use search_slos instead). The guidance is helpful but not exhaustive.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-slosA
List Service Level Objectives (SLOs). Use for 'show all SLOs', 'SLOs for team platform', 'which SLOs are at risk'. Returns SLO names, targets, and current status. Use get-slo for detailed error budget and history of a specific SLO.
| Name | Required | Description | Default |
|---|---|---|---|
| ids | No | Comma-separated list of SLO IDs to fetch | |
| query | No | Search SLOs by name | |
| tagsQuery | No | Filter by tags (e.g., 'team:platform,env:prod') | |
| metricsQuery | No | Filter by metrics used in SLO | |
| limit | No | Number of SLOs to return | |
| offset | No | Pagination offset |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description bears full responsibility. It implies a read-only list operation but does not disclose pagination behavior, rate limits, or any other constraints. The mention of returned fields (names, targets, status) adds some transparency but leaves gaps.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two sentences totaling about 30 words, front-loading the purpose and then providing behavioral cues and sibling reference. Every sentence adds value, and there is no superfluous content.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the 6 parameters and no output schema, the description provides a reasonable overview of functionality and return content. It mentions query examples and a sibling for detail, but lacks details on pagination (limit/offset) and response format, leaving minor gaps.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% as all parameters have descriptions. The tool description does not add significant meaning beyond the schema, such as default values or formatting details. Baseline of 3 is appropriate given the schema already covers parameter semantics.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states it lists SLOs with specific examples of queries ('show all SLOs', 'SLOs for team platform', 'which SLOs are at risk'). It also mentions what information is returned (names, targets, current status) and distinguishes from sibling 'get-slo' for detailed info.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides example use cases and explicitly references an alternative tool ('get-slo') for detailed error budget and history. However, it does not mention other sibling tools like 'search_slos' or provide explicit when-not-to-use guidance.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-spans-metricsA
Get all span-based metric configurations from APM
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are present, and the description fails to disclose any behavioral traits such as read-only nature, side effects, or permissions. The verb 'Get' implies reading, but explicit confirmation is missing.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise with a single, front-loaded sentence. Every word serves the purpose, with no extraneous information.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the absence of parameters and output schema, the description adequately conveys the tool's function. However, it could mention the expected return format or that it returns a list.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
There are no parameters, and schema coverage is 100%. The description implicitly conveys that no input is required, which aligns with the baseline for zero-parameter tools.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the specific verb 'Get', the resource 'span-based metric configurations', and the source 'from APM'. It distinguishes from siblings like 'get-logs-metrics' and 'list_spans_metrics' by focusing on span-based metrics.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives. There is no mention of prerequisites, context, or exclusions, leaving the agent without decision-making support.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-synthetic-resultsA
Get execution results for a specific Synthetic test. Use after get-synthetic-tests to see pass/fail history, response times, and probe locations. Returns individual check results with timing data.
| Name | Required | Description | Default |
|---|---|---|---|
| publicId | Yes | The synthetic test's public ID | |
| fromTs | No | Start timestamp (Unix epoch milliseconds) | |
| toTs | No | End timestamp (Unix epoch milliseconds) | |
| probeDc | No | Filter by probe datacenter locations |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are present, so the description must carry the behavioral information. It mentions returning 'individual check results with timing data' and 'pass/fail history' but does not disclose authentication needs, rate limits, or whether it is read-only. This is adequate but not thorough.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is three sentences, each adding distinct value: stating purpose, usage context, and return contents. No redundancy; perfectly front-loaded.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no output schema, the description adequately explains what is returned (pass/fail, response times, probe locations). It also provides usage context. Minor gaps like pagination or limits prevent a perfect score.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
All 4 parameters have descriptions in the input schema (100% coverage). The description adds no additional parameter meaning beyond the schema, so it meets the baseline of 3.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action (Get), the resource (execution results for a specific Synthetic test), and differentiates from siblings like get-synthetic-tests by specifying it returns results for one test.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explicitly says 'Use after get-synthetic-tests to see pass/fail history...', providing clear usage context and ordering. It does not list alternatives or when not to use, but the guidance is helpful.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-synthetic-testsA
List Datadog Synthetic tests (API and browser). Use for 'show all synthetic tests', 'what API tests exist', or 'which tests are failing'. Returns test names, types, status, locations, and tags.
| Name | Required | Description | Default |
|---|---|---|---|
| pageSize | No | Number of tests per page | |
| pageNumber | No | Page number for pagination | |
| type | No | Filter by test type ('api' or 'browser') | |
| locations | No | Comma-separated location filter |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description partially covers behavior by listing returned fields (names, types, status, locations, tags), but lacks detail on pagination, ordering, or read-only nature. It neither contradicts nor fully discloses behavioral traits.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two sentences long, front-loads the core purpose, and includes example queries without unnecessary words, making it highly concise and structured.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no output schema, the description explains returned fields (names, types, status, locations, tags). It implicitly covers filtering by type and locations but omits pagination behavior and error cases, which are minor gaps for a listing tool.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% with descriptions for all 4 parameters. The description adds no new parameter-level semantics beyond what the schema provides, so baseline 3 is appropriate; the mention of returned fields improves overall understanding but does not directly enhance parameter semantics.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states 'List Datadog Synthetic tests' with specific verb and resource, and includes examples like 'show all synthetic tests' and 'which tests are failing', distinguishing it from sibling tools that focus on different resources.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides explicit usage examples ('show all synthetic tests', 'what API tests exist', 'which tests are failing') but does not mention when to avoid using this tool or suggest alternatives, which is acceptable given its distinct purpose.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_top_avg_metricsC
Get top custom metrics by average hourly count for cost and cardinality analysis
| Name | Required | Description | Default |
|---|---|---|---|
| month | No | ||
| day | No | ||
| names | No | ||
| limit | No | ||
| next_record_id | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided; description only states purpose without detailing behavioral traits such as pagination (next_record_id), read-only nature, or rate limits. Agent cannot infer important behavior.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence, no unnecessary words; adequate conciseness but could benefit from structured clarity given parameter complexity.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given complexity of 5 undocumented parameters and no output schema, the description is insufficient for agent to use correctly. Missing parameter semantics and output details.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Input schema has 5 parameters with 0% schema description coverage, and description adds no parameter explanations. Agent lacks guidance on how to use month, day, names, limit, next_record_id.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states the tool retrieves top custom metrics by average hourly count for cost and cardinality analysis, but does not differentiate from sibling tools like get-metrics, query-metrics, etc.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No explicit guidance on when to use this tool versus alternatives; lacks context on appropriate scenarios or prerequisites.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-traceA
Get all spans for a specific trace ID. Use after search-spans to see the full request flow across services. Returns all spans in the trace with timing, service, resource, and error information.
| Name | Required | Description | Default |
|---|---|---|---|
| traceId | Yes | The trace ID to retrieve (hexadecimal string) | |
| from | No | Start time (defaults to 'now-1h') | |
| to | No | End time (defaults to 'now') |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Describes return content ('timing, service, resource, and error information') but does not disclose potential behavioral traits like pagination, limits, or side effects. With no annotations, the description provides adequate but not comprehensive transparency.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two concise sentences: first states purpose, second provides usage context and return information. No redundant or unnecessary text.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given 3 parameters and no output schema, the description explains what is returned and when to use. It leverages schema descriptions for parameters. Could mention ordering or limits, but overall complete for typical use.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% and each parameter has a description in the schema. The description does not add further meaning to the parameters (e.g., explains traceId is required, from/to are optional with defaults). Baseline 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Clearly states 'Get all spans for a specific trace ID.' and distinguishes from sibling search-spans by explaining it is used after search-spans to see the full request flow. Defines specific verb and resource.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Explicitly tells when to use: 'Use after search-spans to see the full request flow across services.' Provides clear context, though it does not explicitly mention when not to use or list alternatives beyond search-spans.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get-usageA
Get hourly usage data by product family. Use for 'how many infra hosts this month', 'log ingestion volume', 'APM usage trends'. Returns usage records with timestamps for billing and capacity planning.
| Name | Required | Description | Default |
|---|---|---|---|
| startHr | Yes | Start time ISO8601 (e.g., '2024-01-01T00:00:00+00:00') | |
| endHr | No | End time ISO8601 | |
| productFamilies | No | Comma-separated families (e.g., 'infra_hosts,logs,apm') | |
| pageLimit | No | Max records to return | |
| pageNextRecordId | No | Pagination cursor |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, yet the description does not disclose behavioral traits such as read-only nature, pagination behavior, rate limits, or authentication requirements. It only mentions return of timestamps for billing.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two concise sentences: the first states the core action, the second provides examples and return context. No extraneous information.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description hints at return values (timestamps for billing) but does not explain pagination parameters or response structure. Given 5 parameters and no output schema, more detail would be beneficial.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the description adds minimal value beyond the schema. It mentions 'by product family' but that is already covered by the 'productFamilies' parameter.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool retrieves hourly usage data by product family, with concrete examples like 'how many infra hosts this month' and 'APM usage trends'. It effectively distinguishes from siblings by specifying the scope and return value.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides explicit use cases but does not differentiate from the similar sibling 'get_hourly_usage'. No when-not-to-use guidance is given, which may cause confusion among similar tools.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_api_keysC
List Datadog API keys for key management and security audit
| Name | Required | Description | Default |
|---|---|---|---|
| page_size | No | Number of keys per page | |
| page_number | No | Page number | |
| filter | No | Filter by key name | |
| sort | No | Sort field |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description must convey behavioral traits. It only says 'List' and 'for key management and security audit', implying a read operation but omitting specifics such as authentication requirements, pagination behavior, or any potential side effects.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence, concise and front-loaded. While it could include more detail, it efficiently conveys the tool's purpose.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the absence of an output schema, the description should clarify what is returned. It does not mention the response format or that API keys are sensitive. Additionally, it fails to differentiate from many similar sibling list tools.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so baseline is 3. The description adds no additional meaning to the parameters (page_size, page_number, filter, sort) beyond what the schema already provides.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool lists Datadog API keys, with a specific purpose of key management and security audit. However, it does not differentiate from the sibling tool 'list_app_keys', which is similar but for application keys.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives like list_app_keys or other list tools. The description only states the purpose, leaving the agent to infer usage context.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_app_keysC
List application keys for the current user. Shows key names, scopes, and creation dates.
| Name | Required | Description | Default |
|---|---|---|---|
| page_size | No | ||
| page_number | No | ||
| sort | No | ||
| filter_name | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description must fully disclose behavioral traits. It states what is shown (key names, scopes, creation dates) but omits important details like whether it is read-only, pagination behavior, authentication requirements, or if it lists only active keys. The description is too sparse for a tool with no annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is very short (two sentences) and front-loads the purpose. However, it omits critical information, making it under-specified rather than efficiently concise. A bit more detail could be added without sacrificing conciseness.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool has 4 optional parameters and no output schema, the description should cover pagination, filtering, sorting, and return structure. It mentions the fields returned but misses pagination details and parameter usage. Incomplete for a list tool of moderate complexity.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 4 parameters (page_size, page_number, sort, filter_name) with 0% description coverage, and the description provides no guidance on their meaning or usage. The agent receives no help on how to correctly invoke the parameters.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool lists application keys for the current user, specifying the resource (application keys) and scope (current user). However, it does not explicitly differentiate from the sibling tool 'list_api_keys', which could cause confusion.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool vs alternatives, such as when to use list_app_keys over list_api_keys or search tools. There are no exclusions or best practices mentioned.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_authn_mappingsB
List authentication mappings (SAML/OIDC). Shows how identity provider attributes map to Datadog roles.
| Name | Required | Description | Default |
|---|---|---|---|
| page_size | No | ||
| page_number | No | ||
| sort | No | ||
| filter_query | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries full burden. It only states 'List' which implies read-only, but does not disclose pagination behavior, authentication requirements, rate limits, or any side effects. Additional behavioral context is needed.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is very concise with two short sentences, no unnecessary words. However, it sacrifices completeness for brevity, missing parameter and behavioral details.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no annotations, no output schema, and 0% schema parameter coverage, the description is insufficient. It does not explain return values, pagination, or parameter roles, making it incomplete for a tool with 4 parameters.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The schema has 4 parameters (page_size, page_number, sort, filter_query) with 0% description coverage. The tool description does not mention any parameters or explain their semantics, leaving the agent without guidance on how to use them.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'List' and the resource 'authentication mappings' with specific context (SAML/OIDC) and explains what they are (maps identity provider attributes to Datadog roles). It distinguishes from sibling list tools which cover different resources.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No explicit guidance on when to use this tool vs alternatives, nor any when-not-to-use advice. The purpose implies usage for viewing auth mappings, but lacks comparative context with other list tools.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_aws_accountsB
List AWS accounts integrated with Datadog
| Name | Required | Description | Default |
|---|---|---|---|
| aws_account_id | No | Filter by AWS account ID |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided, and the description lacks details such as authentication requirements, rate limits, or whether it returns all accounts or supports pagination.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single, clear sentence that is appropriately sized for a simple list tool; no wasted words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple list tool with one optional parameter and no output schema, the description lacks information on return format or pagination, but is minimally adequate.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description covers the parameter fully ('Filter by AWS account ID'), and the tool description adds no additional meaning; baseline score of 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states action (List) and resource (AWS accounts integrated with Datadog), distinguishing it from other list tools targeting different integrations.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No explicit guidance on when to use this tool vs. alternatives like list_azure_integration or list_gcp_integration; usage is implied by the name but not stated.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_azure_integrationA
List Azure integration accounts connected to Datadog.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must disclose behavior. It implies a read-only list operation but doesn't explicitly state side effects, authentication needs, or outcome details. Adequate for a simple list with no parameters.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence that directly conveys the purpose without any redundant words. It is front-loaded and efficient.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a tool with no parameters and no output schema, the description is complete. It clearly identifies the resource type and action, and the sibling list tools provide context for differentiation.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has zero parameters, and the input schema is fully covered (100%). The description adds no parameter information, which is acceptable since there are none. Baseline 4 applies for zero-parameter tools.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action 'List' and the specific resource 'Azure integration accounts connected to Datadog', distinguishing it from siblings like list_aws_accounts or list_gcp_integration.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus similar list tools. The description doesn't mention when-not or prerequisites, leaving the agent to infer from the name alone.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list-ci-pipelinesB
List CI pipeline events (pipeline runs/executions). Use for 'recent CI builds', 'failed pipelines', 'CI pipeline status', 'deployment history'.
| Name | Required | Description | Default |
|---|---|---|---|
| filterQuery | No | Query to filter pipeline events | |
| filterFrom | No | Start time (ISO 8601) | |
| filterTo | No | End time (ISO 8601) | |
| pageLimit | No | Max results per page | |
| pageCursor | No | Pagination cursor | |
| sort | No | Sort field |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided. The description does not disclose behavioral traits such as whether the operation is read-only, pagination behavior, rate limits, or side effects. Only a list of example queries is given.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise: one sentence defining the tool plus a list of example use cases. No redundant information, though the use cases could be integrated into a single sentence for tighter structure.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Covers the core purpose and example queries but lacks details on behavior such as pagination (despite pageLimit and pageCursor), sorting, or the difference from similar tools. Missing output schema and annotations leave gaps.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% with all six parameters described in the input schema. The description does not add any extra meaning or context beyond what the schema already provides (e.g., filterQuery, filterFrom, filterTo, pageLimit, pageCursor, sort).
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Clearly states the verb 'List' and resource 'CI pipeline events' (pipeline runs/executions). Provides specific use cases like 'recent CI builds' and 'failed pipelines', distinguishing it from sibling tools such as 'get-ci-pipeline-events' (likely single event) and 'list_ci_tests'.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Lists example use cases (e.g., 'recent CI builds', 'failed pipelines') indicating when to use. However, it does not provide when-not-to-use guidance or mention alternative tools like 'get-ci-pipeline-events' for single-pipeline queries or 'search_ci_test_events' for test-specific filtering.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_ci_testsA
List CI test events from Datadog CI Visibility. Filter by query, time range. Use for 'show failed tests', 'test results for service X'.
| Name | Required | Description | Default |
|---|---|---|---|
| filter_query | No | ||
| filter_from | No | ||
| filter_to | No | ||
| page_limit | No | ||
| page_cursor | No | ||
| sort | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided, so the description must carry the full burden. It mentions listing and filtering but omits behavioral traits such as pagination, rate limits, or read-only nature. The description lacks depth on how the tool behaves.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two efficient sentences with front-loaded purpose. Every sentence adds value, no fluff.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Covers basic purpose and use cases, but with 6 parameters, no output schema, and no annotation support, it leaves gaps in pagination, sorting, and output details. Adequate for a simple list tool but not fully complete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%. The description adds meaning for 'filter_query', 'filter_from', and 'filter_to' by referencing 'query' and 'time range', but does not explain 'page_limit', 'page_cursor', or 'sort'. Given low coverage, more detail is needed.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Clearly states the action (List), resource (CI test events from Datadog CI Visibility), and filtering capabilities. The mention of use cases like 'show failed tests' differentiates from sibling tools.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Provides explicit use cases ('show failed tests', 'test results for service X'), giving clear context. However, it does not specify when to avoid this tool or mention alternatives like search_ci_test_events.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_cloudflare_accountsA
List Cloudflare accounts integrated with Datadog for monitoring CDN and edge performance.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must carry the full burden of behavioral disclosure. It only states the tool 'lists accounts', but does not mention return format, schema, pagination, rate limits, or whether the operation is read-only. Important behavioral details are omitted.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, grammatically complete sentence that immediately conveys the tool's purpose. It is front-loaded and contains no superfluous words, earning a high conciseness score.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a parameterless tool with no output schema, the description adequately explains what the tool does and the context (Cloudflare accounts integrated with Datadog, for CDN/edge monitoring). It could optionally mention that the output is likely a list of account IDs/names, but the current level is sufficient for a simple list operation.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
There are zero parameters, and schema coverage is 100% (trivially). Per guidelines, baseline is 4. The description adds value by specifying the integration context and monitoring purpose, which complements the empty schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly specifies the tool lists Cloudflare accounts integrated with Datadog for monitoring CDN and edge performance. It uses a specific verb ('list') and resource ('Cloudflare accounts'), and distinguishes from sibling tools like list_aws_accounts or list_azure_integration by naming the integration partner.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies usage for retrieving Cloudflare account listings, but does not provide explicit guidance on when to use this tool versus alternatives (e.g., list_aws_accounts) or specify prerequisites (e.g., Datadog-Cloudflare integration must be configured). No when-not-to-use or exclusion criteria are stated.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_confluent_accountsA
List Confluent Cloud accounts integrated with Datadog for monitoring Kafka clusters.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, and the description does not disclose any behavioral traits such as authentication needs, rate limits, or side effects. For a read operation, it adds minimal context beyond the obvious.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
One sentence, 13 words, front-loaded with verb and resource. No wasted words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple parameterless list tool, the description is sufficient to understand what is returned. Could mention prerequisites, but not strictly necessary.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
With zero parameters, the description implicitly states no filtering is needed. Baseline for 0 params is 4, and the description adds clarity by specifying 'integrated with Datadog'.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'list' and the resource 'Confluent Cloud accounts integrated with Datadog for monitoring Kafka clusters', making the tool's purpose specific and distinct from sibling tools like list_aws_accounts.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The context is clear: use to list Confluent Cloud accounts. However, no explicit guidance on when not to use or alternatives, though the tool's specificity implies its niche.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_containersC
List Datadog-monitored containers with their metadata and health status
| Name | Required | Description | Default |
|---|---|---|---|
| filter_tags | No | Filter by tags (e.g. env:prod) | |
| group_by | No | Group results by field | |
| sort | No | Sort field | |
| page_size | No | Page size | |
| page_cursor | No | Pagination cursor |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description must disclose behavioral traits, but it only states the action and output. It does not mention pagination, read-only nature, or any side effects.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence that conveys the core function without unnecessary words. It is appropriately concise.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool has 5 parameters and no output schema or annotations, the description is incomplete. It lacks details on filtering, pagination, typical use cases, and output format.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the schema provides sufficient parameter descriptions. The description adds no additional context beyond the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states it lists Datadog-monitored containers with metadata and health status. However, it does not differentiate from the sibling tool 'get-containers', leaving ambiguity about when to use which.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives like get-containers or other list tools. There is no mention of prerequisites or context.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_cost_budgetsC
List cloud cost management budgets for tracking team spending
| Name | Required | Description | Default |
|---|---|---|---|
| page_size | No | ||
| page_offset | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided, and description only states it 'lists' budgets. No disclosure of return format, pagination behavior, permissions needed, or whether it supports filtering. Minimal behavioral info.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence is concise and front-loaded with purpose. However, could be slightly expanded to include parameter hints without becoming verbose.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a list tool with two optional parameters and no output schema, description omits return type, pagination explanation, and prerequisites. Incomplete for an agent to use effectively without additional context.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, and description does not mention the two pagination parameters (page_size, page_offset). The agent gets no parameter guidance beyond the schema itself, which lacks descriptions.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states verb 'List' and specific resource 'cloud cost management budgets', distinguishing it from sibling tools like get_estimated_cost which deals with cost estimation, not budgets.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives, such as when to list budgets vs. get estimated costs. Context of use is implied but not explicit.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_csm_threats_agent_rulesC
List CSM Threats agent rules for workload security monitoring
| Name | Required | Description | Default |
|---|---|---|---|
| page_size | No | ||
| page_number | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided. The description does not disclose whether the operation is read-only, safe, or what the return format is. No mention of rate limits, ordering, or default values for parameters.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence and front-loaded. It is concise but lacks explanatory depth. There is no waste, but it fails to provide sufficient detail for effective tool use.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no output schema and minimal parameter info, the description is incomplete. It does not explain what the output contains, how pagination works, or any specifics about the agent rules. For a simple list tool, more detail is needed.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0% with two parameters (page_size, page_number) lacking any description. The tool description adds no explanation of these parameters, their valid ranges, or defaults.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action 'List' and the resource 'CSM Threats agent rules' with context 'for workload security monitoring'. It distinguishes from other list tools by specifying a unique resource type, which is not repeated among siblings.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives. No mention of prerequisites, default behavior, or pagination limits. The description lacks context for when to choose this over other list tools.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list-dashboard-listsA
List all custom dashboard lists. Use for 'what dashboard lists exist', 'organized dashboards', 'dashboard collections'.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, and the description lacks any behavioral details such as read-only nature, performance characteristics, or permissions required.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two concise sentences with no redundant information, front-loading the core purpose.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's simplicity (no parameters, no output schema), the description covers the essential information adequately.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has no properties, so the description adds context that the tool lists custom dashboard lists, which is helpful beyond the empty schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description states the tool lists all custom dashboard lists, with specific example queries. It clearly identifies the resource and action.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides example use cases, helping the agent know when to invoke. However, it does not differentiate from other list-* siblings explicitly.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_dora_deploymentsB
List DORA metric deployments for tracking deployment frequency and lead time
| Name | Required | Description | Default |
|---|---|---|---|
| filter_from | No | ||
| filter_to | No | ||
| filter_service | No | ||
| filter_env | No | ||
| page_size | No | ||
| page_cursor | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must disclose behavioral traits. It only states the tool lists deployments, without mentioning read-only nature, authentication requirements, rate limits, or any side effects. This leaves the agent uninformed about safe usage.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence of 10 words, efficiently conveying the purpose. No fluff or redundancy exists; every word adds value.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool has 6 parameters, no output schema, and no annotations, the description is too sparse. It does not explain pagination, filtering, or what the return data looks like. More context is needed for an agent to use it effectively.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 6 parameters with 0% schema description coverage. The description adds no information about parameters, such as expected formats, valid values, or purposes. The parameter names (e.g., filter_from, page_cursor) are suggestive but insufficient for correct invocation.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states the tool lists DORA metric deployments for tracking deployment frequency and lead time. It specifies both the action (list) and the resource (DORA deployments), distinguishing it from other list tools in the sibling set.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No explicit when-to-use or when-not-to-use guidance is given. The description implies usage for DORA metric tracking, but lacks exclusions or alternatives. Since no sibling tool covers DORA deployments, the context is understood but not stated.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_downtime_schedulesC
List scheduled downtimes (v2 API). Filter by current/upcoming schedules. Shows muted monitors, scopes, and schedule details.
| Name | Required | Description | Default |
|---|---|---|---|
| page_limit | No | ||
| page_offset | No | ||
| current_only | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must convey behavioral traits. It mentions the API version and filtering, but does not disclose side effects, authentication requirements, rate limits, or pagination behavior. The read-only nature is implied but not explicit.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise with two sentences: the first states the primary function, the second adds key features. No unnecessary words or fluff.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
With no output schema, no annotations, and three parameters, the description is incomplete. It lacks parameter documentation, return format details, and differentiation from similar tools like get-downtimes. The context of pagination is hinted but not explained.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 0% and the description does not explain any of the three parameters (page_limit, page_offset, current_only). The mention of 'filter by current/upcoming schedules' loosely maps to current_only but lacks detail. The description adds no value for parameter understanding.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'List' and resource 'scheduled downtimes' (v2 API), and indicates what information is provided (muted monitors, scopes, schedule details). However, it does not explicitly differentiate from the sibling tool 'get-downtimes', which may cause confusion.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description mentions filtering by 'current/upcoming schedules' but provides no guidance on when to use this tool versus alternatives like 'get-downtimes'. No explicit when-to-use or when-not-to-use context is given.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_fleet_agentsC
List Datadog fleet agents with version, OS, and status information
| Name | Required | Description | Default |
|---|---|---|---|
| page_size | No | ||
| page_cursor | No | ||
| filter_query | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, and the description does not disclose behavioral traits such as read-only nature, rate limits, or data scoping. The agent cannot infer safety or side effects.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence and not verbose, but it lacks necessary details. It is concise but at the expense of completeness.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
With 3 optional parameters and no output schema, the description is too brief. It does not explain pagination, structure of results, or edge cases, leaving the agent underinformed.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, yet the description adds no explanation for the three parameters (page_size, page_cursor, filter_query). The agent must guess their semantics, which is insufficient.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states 'List Datadog fleet agents with version, OS, and status information', specifying both the action (list) and the resource (fleet agents) along with returned fields. It differentiates from many sibling tools that target different resources, though it does not explicitly exclude similar list tools.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives, nor does it mention pagination, filtering, or any prerequisites. It simply states the function without usage context.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_gcp_integrationA
List Google Cloud Platform integration accounts connected to Datadog.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden. It only states the tool lists accounts, but does not disclose behavior like pagination, ordering, result format, or whether the list is complete. This is insufficient for an agent to fully understand the tool's behavior.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence with no wasted words. It is front-loaded and efficiently communicates the tool's purpose.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description is brief but covers the core purpose. However, given no output schema and many similar list tools, it lacks details on what fields are returned or any limitations (e.g., only active accounts). Still, for a simple list operation, it is minimally adequate.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
There are zero parameters, and schema description coverage is 100% (vacuous). The description adds no parameter info because none exist. Baseline for zero parameters is 4, and the description is adequate for a no-param tool.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'List' and the specific resource 'Google Cloud Platform integration accounts connected to Datadog'. It distinguishes from siblings like list_aws_accounts and list_azure_integration by explicitly naming GCP.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool vs alternatives. With many sibling list_* tools, the description does not provide context such as prerequisites, permissions, or scenarios where this tool is preferred.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_host_totalsA
Get the total number of active and up hosts in your Datadog account. Quick health check for infrastructure scale.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must carry the full burden. It mentions 'active and up hosts' but does not disclose read-only nature, data freshness, or performance characteristics. Minimal behavioral context.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two sentences, front-loaded with the main action. No redundant words. Efficient and clear.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Adequately describes purpose and scope but lacks details on output format (e.g., returns JSON with active and up counts). No disambiguation from sibling get-active-hosts-count. Could be more complete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Input schema has zero parameters with 100% coverage. Description adds value by clarifying that the counts are for 'active and up hosts', but no additional parameter explanation needed. Baseline 4.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states it gets the total number of active and up hosts, serving as a quick health check. It uses specific verb 'Get' and resource 'total hosts', differentiating from siblings like get-hosts which returns detailed host lists.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies use for quick health checks ('Quick health check for infrastructure scale') but does not explicitly contrast with alternatives like get-active-hosts-count. No guidance on when not to use.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_logs_metricsB
List all log-based metrics configured for generating custom metrics from log data.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
There are no annotations, and the description does not disclose any behavioral traits such as permissions, rate limits, or side effects. It only states the basic action.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence, which is concise and front-loaded. It could benefit from additional structure or bullet points, but it is efficient.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's simplicity (no parameters, no output schema), the description provides the essential purpose. However, it lacks any details about return format or potential limitations, which would be helpful.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has 0 parameters, so the description naturally cannot add parameter details. According to guidelines, the baseline is 4, which is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states it lists all log-based metrics with added context about generating custom metrics. However, it does not distinguish from the sibling tool 'get-logs-metrics' which likely retrieves a single metric.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives, especially the closely named 'get-logs-metrics'. No when-not or exclusions are mentioned.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_metric_tag_configsC
List metric tag configurations. Filter by configured status, tags, activity window.
| Name | Required | Description | Default |
|---|---|---|---|
| filter_configured | No | ||
| filter_tags_configured | No | ||
| filter_metric | No | ||
| filter_active_within | No | ||
| window_seconds | No | ||
| page_size | No | ||
| page_cursor | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are present. The description only mentions filtering, omitting details like pagination, idempotency, or response structure. Behavioral traits such as whether the list is paginated or ordered are left unspecified.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single concise sentence that efficiently states the core function. It is front-loaded with the verb 'List' and resource, but could benefit from a bit more structure (e.g., bullet points for filters).
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no output schema and no annotations, the description is incomplete. It overlooks pagination parameters, the filter_metric parameter, and does not indicate the output format or any constraints. For a 7-parameter tool, more context is needed.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
With 0% schema coverage, the description adds some meaning by mentioning 'configured status, tags, activity window', which loosely map to parameters like filter_configured, filter_tags_configured, and filter_active_within. However, it does not explain all 7 parameters (e.g., filter_metric, window_seconds, page_size, page_cursor) and lacks detail.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states 'List metric tag configurations' with filtering options, distinguishing it from sibling tools like 'get_metric_tag_config' (singular) which retrieves a single config. However, the exact nature of 'metric tag configurations' is not further explained.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives (e.g., get_metric_tag_config for a single config). The mention of filtering is implied but no explicit when-to-use or when-not-to-use advice.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_monitor_notification_rulesC
List monitor notification routing rules showing who gets alerted
| Name | Required | Description | Default |
|---|---|---|---|
| page_size | No | ||
| page_offset | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries full burden for behavioral traits but fails to mention pagination, ordering, rate limits, or authentication. The existence of pagination parameters in the schema is not acknowledged.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single concise sentence with no redundancy. However, it could be slightly expanded to include parameter context without sacrificing conciseness.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no output schema and a simple list operation, the description should at least mention that the tool returns a paginated list of rules. It lacks completeness for effective use.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0% and the description does not explain the parameters. Agents cannot infer the meaning of page_size and page_offset from the description alone.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action (List) and the resource (monitor notification routing rules) and specifies the outcome (showing who gets alerted). It distinguishes this tool from sibling tools like list_monitors or list_downtime_schedules.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives. Sibling tools include many list tools, but no comparisons or exclusions are mentioned.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_network_devicesB
List network devices monitored by Datadog NDM with filtering and pagination
| Name | Required | Description | Default |
|---|---|---|---|
| page_size | No | ||
| page_number | No | ||
| filter_tag | No | ||
| sort | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must disclose behavioral traits. It mentions filtering and pagination but does not elaborate on how they work, what happens with large result sets, rate limits, or that the operation is read-only (implicit but not stated). The description is too terse to provide adequate transparency.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence with no filler words. It is front-loaded with the verb and resource and efficiently conveys the core purpose and features. Every word earns its place.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
No output schema is provided, and the description does not mention return format, field details, or usage examples. For a list tool with four optional parameters and no required fields, the description lacks enough context to fully specify tool behavior. It leaves agents guessing about how to effectively use filtering and pagination.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, so the description must compensate. It connects 'filtering' to filter_tag and 'pagination' to page_size/page_number, and implies sort is used for sorting. This adds some meaning beyond bare names, but does not explain valid values, format, or default behavior. A score of 3 reflects marginal added value.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'List', the specific resource 'network devices monitored by Datadog NDM', and mentions key features 'filtering and pagination'. It effectively distinguishes from the many sibling list tools that target different resources (e.g., list_containers, list_workflows).
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No explicit guidance on when to use this tool versus alternatives. While the resource name implies its domain, there is no mention of prerequisites, when not to use it, or comparison with other list tools. The description is purely declarative.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_notebooksC
List Datadog notebooks (investigation documents, runbooks, postmortems)
| Name | Required | Description | Default |
|---|---|---|---|
| query | No | Search query for notebook name | |
| count | No | Number of notebooks to return | |
| start | No | Offset for pagination | |
| sort_field | No | Field to sort by (e.g. modified) | |
| sort_dir | No | Sort direction (asc or desc) | |
| author_handle | No | Filter by author handle |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description must cover behavior. It only says 'List', without disclosing pagination, filtering behavior, or any side effects. The agent is left to infer from the schema.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence with no wasted words, including helpful parenthetical context. It is front-loaded and efficient, though very brief.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
With 6 parameters, no output schema, and no annotations, the description is incomplete. It fails to explain return values, pagination behavior, or how parameters interact, leaving significant gaps for the agent.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the schema already describes all parameters. The description adds no additional meaning beyond the schema. Baseline 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool lists Datadog notebooks and defines what notebooks are (investigation documents, runbooks, postmortems). However, it does not differentiate from the sibling tool 'get-notebooks', which may perform a similar function.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives like 'get-notebooks' or other listing tools. There is no mention of prerequisites, use cases, or exclusions.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list-permissionsB
List all available permissions in Datadog
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description should disclose behavioral traits such as read-only status, authentication requirements, or rate limits. It states only 'List all available permissions', which implies a read operation but lacks explicit confirmation or any behavioral caveats.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise with a single sentence and four words. It is front-loaded with the action and resource, but could benefit from slightly more context without sacrificing brevity.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple list tool with no parameters and no annotations, the description provides the minimum viable information. It does not describe output format or any side effects, but given the simplicity, it is adequate yet leaves room for improvement.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has no parameters (100% coverage), so the description does not need to add parameter details. The baseline for zero parameters is 4, and the description meets that expectation.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'List' and the resource 'all available permissions', distinguishing it from sibling list tools for other resources like users or roles. However, it does not explicitly differentiate its scope from similar permissions-related tools.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when or why to use this tool over alternatives. The description only states the function, leaving it to the agent to infer usage context.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list-posture-findingsC
List legacy CSPM/CIEM posture management findings (misconfigurations and identity risks). Useful for compliance use-cases. Requires the security_monitoring_findings_read scope.
| Name | Required | Description | Default |
|---|---|---|---|
| filter | No | ||
| page | No | ||
| snapshotTimestamp | No | ||
| detailedFindings | No | ||
| limit | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided, so description must fully disclose behavior. It only mentions the required scope and that findings are 'legacy'. Does not mention pagination, rate limits, idempotency, or error scenarios, leaving significant gaps for an agent.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Three sentences, each serving a distinct purpose: what it does, when to use it, and a requirement. No fluff, front-loaded with the core action.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the complexity (5 parameters, nested filter object, no output schema, no annotations), the description is too sparse. It lacks details on filtering options, pagination, output format, and behavioral implications, making it incomplete for an agent to use effectively.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0% and the description does not explain any of the 5 parameters (filter, page, snapshotTimestamp, detailedFindings, limit). The description adds no meaning beyond the schema structure.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Clearly states it lists legacy CSPM/CIEM findings (misconfigurations and identity risks) and mentions compliance use-cases. Differentiates from siblings like 'search-security-findings' by implying this is a list operation, but does not explicitly contrast.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Only provides vague usage advice ('useful for compliance use-cases') and a scope requirement. No explicit guidance on when to use this vs alternatives (e.g., 'search-security-findings'), no when-not-to-use, and no prerequisites beyond the scope.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list-processesA
List running processes with optional filtering by search term or tags. Use for 'what processes are running', 'find java processes', 'process list for host'.
| Name | Required | Description | Default |
|---|---|---|---|
| search | No | Search term to filter processes | |
| tags | No | Comma-separated tags to filter | |
| from | No | Start timestamp (Unix seconds) | |
| to | No | End timestamp (Unix seconds) | |
| pageLimit | No | Max results per page | |
| pageCursor | No | Pagination cursor |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The description states 'List running processes', indicating a read operation. No annotations are provided, so the description carries the full burden. It does not mention auth requirements, side effects, or the scope of processes (e.g., all hosts vs current host). The example 'process list for host' implies host filtering, but no host parameter exists, which could be misleading.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single concise sentence followed by a list of three concrete example use cases. Every part is informative without redundancy, and the examples are front-loaded for quick understanding. No wasted words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description explains the core function and provides examples, but given the tool has 6 optional parameters, no output schema, and no annotations, more detail is needed. It omits what is returned, the default scope (e.g., all processes on the current host?), and how pagination works. The sibling list includes many similar list tools, so differentiation could be stronger.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The schema covers all 6 parameters with descriptions (100% coverage), so the schema already details each parameter. The description adds value by highlighting the primary filter capabilities ('search term or tags'), but does not explain time range or pagination parameters. This provides marginal additional context beyond schema, resulting in a baseline score of 3.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb ('List'), resource ('running processes'), and scope ('with optional filtering by search term or tags'). Examples like 'what processes are running' and 'find java processes' further clarify the function, distinguishing it from sibling list tools like list-containers or list-hosts.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description includes practical example queries ('what processes are running', 'find java processes', 'process list for host'), which implicitly guide when to use the tool. However, it lacks explicit instructions on when not to use it or alternatives, such as using get-hosts for host-level information.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_restriction_policiesC
Get restriction policy for a specific resource. Shows access control bindings and principals.
| Name | Required | Description | Default |
|---|---|---|---|
| resource_id | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Without annotations, the description only implies a read operation. No disclosure of authentication needs, rate limits, or other behavioral traits beyond 'Get'.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two concise sentences that front-load the core purpose without any wasted words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple single-parameter tool, the description covers the basic functionality but omits details on output format, pagination, or necessary permissions, leaving some gaps.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
With 0% schema description coverage and a single string parameter, the description adds no meaning beyond the schema. It does not explain the format or expected values of 'resource_id'.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool retrieves a restriction policy for a specific resource and shows access control bindings and principals. It uses a specific verb and resource, but does not differentiate from sibling tools like 'get_monitor_config_policies'.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool over alternatives, no exclusions or context provided. The agent must infer usage from the name alone.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list-rolesB
List RBAC roles in your Datadog organization
| Name | Required | Description | Default |
|---|---|---|---|
| page_size | No | Number of roles per page | |
| page_number | No | Page number | |
| filter | No | Filter roles by name |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description fully bears the burden of behavioral disclosure. It fails to mention pagination (page_size/page_number), filtering behavior, or the return format, leaving critical details unspecified.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise and front-loaded, stating the purpose in one sentence. However, it could include more useful information (e.g., pagination hints) without becoming verbose.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple list tool without an output schema, the description should at least indicate that the result is a list or mention pagination behavior. It lacks sufficient context for an agent to fully understand the tool's output and usage.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the parameters are adequately documented in the schema. The description adds no extra meaning, but the baseline of 3 is appropriate given high coverage.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action (List) and the resource (RBAC roles) within the Datadog organization. It is specific and distinct from sibling list tools that target other entities like users or permissions.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus other list tools (e.g., list-users, list-permissions) or alternative methods for retrieving roles. The agent must infer usage without context.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list-rum-applicationsA
List all RUM applications configured in Datadog. Use to discover which frontend apps are monitored, get application IDs for RUM queries, or see who created them. Companion to search-rum-events.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided; description does not disclose pagination, rate limits, or whether listing is complete in one call. For a list tool with no annotations, this is a significant gap.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Three sentences with clear front-loading of purpose. No wasted words, but could include behavioral notes concisely.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Covers purpose and high-level output, but missing details on pagination, sorting, or any constraints. Adequate for simple list, but not fully comprehensive.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Input schema has zero parameters, so no param info needed. Description adds value by mentioning output fields (application IDs, creators), compensating for lack of output schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states it lists all RUM applications in Datadog and provides specific use cases (discover monitored apps, get application IDs, see creators). It distinguishes from sibling 'search-rum-events' by calling itself a companion.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Explicitly describes when to use (discovery, obtaining IDs) and implies alternative via 'companion to search-rum-events'. Lacks explicit 'when not to use' but covers main use cases.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list-scorecard-outcomesB
List scorecard rule evaluation outcomes for services
| Name | Required | Description | Default |
|---|---|---|---|
| page_size | No | Number of results per page | |
| page_offset | No | Page offset | |
| filter_rule_id | No | Filter by rule ID | |
| filter_service_name | No | Filter by service name |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description must disclose behavioral traits. It only states 'List' implying a read operation, but does not mention pagination, data freshness, permissions, or any side effects. This is insufficient for safe invocation.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, well-structured sentence that front-loads the verb and resource. Every word is necessary and there is no fluff.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's simplicity and complete schema, the description is adequate but lacks any explanation of what a 'scorecard rule evaluation outcome' is or the typical usage pattern. No output schema exists, so more context on return format would be helpful.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 100% description coverage, so the baseline is 3. The description adds no additional parameter semantics beyond what the schema provides; it does not elaborate on how the filters affect results or the meaning of page size/offset.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description states the verb 'List' and resource 'scorecard rule evaluation outcomes for services', clearly indicating what the tool does. It implicitly differentiates from sibling tool 'list-scorecard-rules' by specifying 'outcomes' rather than 'rules', but lacks explicit disambiguation.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool over alternatives, nor any context about prerequisites or typical use cases. The description is purely declarative without usage direction.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list-scorecard-rulesC
List service scorecard rules for evaluating service quality
| Name | Required | Description | Default |
|---|---|---|---|
| page_size | No | Number of results per page | |
| page_offset | No | Page offset | |
| filter_rule_id | No | Filter by rule ID | |
| filter_rule_name | No | Filter by rule name |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must carry the full burden of behavioral disclosure. It does not mention pagination behavior (though parameters hint at it), rate limits, ordering, or whether all rules are returned. The description is too brief.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, concise sentence that directly states the purpose. It is not verbose, but could benefit from more structure or additional information without sacrificing brevity.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no output schema and four parameters, the description is insufficient. It does not explain what is returned, how results are paginated, or any constraints. The sibling tool 'list-scorecard-outcomes' suggests a related resource but guidance is missing.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%; all four parameters have clear descriptions in the schema (page_size, page_offset, filter_rule_id, filter_rule_name). The tool description adds no additional meaning beyond these, so baseline 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states 'List service scorecard rules for evaluating service quality', specifying the verb (list) and resource (scorecard rules). It distinguishes from the sibling tool 'list-scorecard-outcomes' implicitly by focusing on rules, but does not explicitly differentiate from other list tools.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives like 'list-scorecard-outcomes' or other list tools. There is no mention of prerequisites, filters, or context for usage, leaving the agent with implied usage only.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_security_monitoring_rulesB
List security monitoring detection rules with pagination. Shows enabled/disabled rules, names, and types.
| Name | Required | Description | Default |
|---|---|---|---|
| page_size | No | ||
| page_number | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description adds some behavioral context by stating the output includes status and types, but it omits details about permissions, pagination defaults, or limits. Adequate but not comprehensive.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two concise sentences, front-loaded with key action and resource. No unnecessary words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple list tool with two parameters and no output schema, the description provides basic context but lacks details on filtering, sorting, or return format. Sufficient for simple use but not fully complete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, and the description only mentions pagination without explaining the specific parameters (page_size, page_number). The description fails to compensate for the missing parameter documentation.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool lists security monitoring detection rules with pagination, specifying what is shown (enabled/disabled, names, types). It differentiates from the sibling 'list_security_rules' which likely covers all security rules.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives like search-security-findings or search-security-signals. The description does not provide context for selection.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_security_rulesC
List Datadog security monitoring detection rules
| Name | Required | Description | Default |
|---|---|---|---|
| page_size | No | Number of rules per page | |
| page_number | No | Page number |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are present, and the description does not disclose key behavioral traits such as pagination behavior, rate limits, data freshness, or whether the list is ordered. The minimal description leaves the agent uninformed.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, concise sentence that front-loads the key action and resource. It is efficient with no unnecessary words, though slightly lacking in depth.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's simplicity (two optional params, no output schema), the description is incomplete. It does not cover pagination, return format, or how to handle large result sets, which are essential for effective use.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 100% description coverage for both parameters, so the schema already explains their meaning. The description adds no additional value beyond the schema, resulting in a baseline score of 3.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description specifies the verb 'List' and the resource 'Datadog security monitoring detection rules' clearly. However, it does not differentiate from the sibling tool 'list_security_monitoring_rules', which appears to be nearly identical.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives, nor any mention of pagination handling or best practices. The description offers no context for appropriate use.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list-service-definitionsB
List service definitions from the Datadog Service Catalog. Use for 'what services exist', 'service catalog', 'list all registered services'.
| Name | Required | Description | Default |
|---|---|---|---|
| pageSize | No | Number of results per page | |
| pageNumber | No | Page number | |
| schemaVersion | No | Schema version: v1, v2, v2.1, or v2.2 |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, and the description does not disclose behavioral traits such as pagination, rate limits, or that it is a read-only operation. The burden falls on the description, which only states the basic action.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Description is concise with a single sentence and example phrases. No unnecessary words, but could be slightly more structured.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
No output schema is provided, and the description does not explain what fields are returned (e.g., service names, metadata). It lacks context on filtering, sorting, or pagination behavior, making it incomplete for a listing tool.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the schema already documents parameters. The description adds no additional meaning about pageSize/pageNumber behavior or schemaVersion values.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states it lists service definitions from Datadog Service Catalog and provides example queries. However, it does not explicitly differentiate from sibling tools like 'get-service-definition', though the distinction is implicit.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Description provides example use cases ('what services exist', etc.) implying when to use, but no guidance on when not to use or alternatives among sibling tools.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_spans_metricsA
List all span-based metrics (APM custom metrics) configured for generating metrics from APM spans.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries full burden. It only states it lists metrics, but omits details like pagination, read-only nature, or permissions. Minimal transparency beyond the action.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence with no wasted words. Clearly communicates purpose and scope.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given zero parameters, no output schema, and no annotations, the description is minimal but adequate for a simple list operation. However, it lacks details about return format or potential filters, leaving some uncertainty for the agent.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
No parameters exist; schema coverage is 100%. The description adds no param-specific info but correctly indicates 'all' metrics, which is sufficient for a parameterless tool. Baseline score 4 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool lists 'span-based metrics (APM custom metrics) configured for generating metrics from APM spans.' The verb 'List' and resource are specific, and the phrase differentiates it from siblings like 'get-metrics' or 'list_logs_metrics'.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No explicit guidance on when to use this tool versus alternatives like 'get-spans-metrics' or 'list_logs_metrics'. Usage is implied (when needing all span-based metric configurations) but no exclusions or context provided.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_synthetics_global_variablesA
List all Synthetics global variables used across synthetic tests for shared configuration like URLs, credentials, and test data.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Description implies a read-only operation with no side effects, but lacks details on scope (e.g., whether it lists variables across all accounts) or return format. Without annotations, this is minimally adequate for a list tool.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single concise sentence that conveys purpose and examples without redundancy. No unnecessary words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a parameterless tool with no output schema, the description fully explains what the tool does and why it's useful. No gaps given the simplicity.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
No parameters exist; schema coverage is 100%. According to guidelines, baseline is 4 for zero parameters.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states the tool lists all Synthetics global variables and provides concrete examples (URLs, credentials, test data), distinguishing it from sibling list tools like list_synthetics_locations.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives or prerequisites. The description only states what it does without context about appropriate use cases.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_synthetics_locationsA
List available Synthetics testing locations (both managed by Datadog and private). Useful for configuring where synthetic tests run.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided. Description honestly presents a read-only list operation with no destructive actions. Lacks details on pagination or rate limits, but for a parameterless list, these are likely minimal.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two concise sentences stating purpose and usage context. No redundant information.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple parameterless list with no output schema, the description provides all necessary context: what it lists, types of locations, and when to use it.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
No parameters in the input schema. Description adds no parameter info, but baseline is 4 for zero-parameter tools as per guidelines.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states it lists Synthetics testing locations, both managed and private. Differentiates from sibling list_synthetics_private_locations by explicitly including both types.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
States 'Useful for configuring where synthetic tests run,' providing clear context for when to use. No explicit when-not-to-use, but the purpose is sufficiently clear for a straightforward list tool.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_synthetics_private_locationsA
List Synthetics private locations for internal testing. Shows private location IDs, names, and tags.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden. It states that the tool shows private location IDs, names, and tags, implying a read-only operation. However, it does not disclose any behavioral traits like auth requirements, rate limits, or whether it returns all locations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two short sentences, front-loaded with the core purpose. No extraneous words; every sentence adds value.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description covers the key outputs (IDs, names, tags) and purpose. Given no output schema and no parameters, it is mostly complete. Minor improvement could mention if results are paginated or if any filtering is available.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has no parameters, and schema coverage is 100%. According to the rubric, baseline is 4 for zero parameters. The description adds no parameter information, but it is not needed.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'List' and the resource 'Synthetics private locations', specifying that it shows IDs, names, and tags. This distinguishes it from sibling tools like list_synthetics_locations and list_synthetics_global_variables.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description mentions 'for internal testing', providing some context, but does not specify when to use this tool vs alternatives or any prerequisites. For a simple list tool with no parameters, this is adequate but lacking explicit guidance.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_team_membersC
List members of a Datadog team. Shows user roles and membership details.
| Name | Required | Description | Default |
|---|---|---|---|
| team_id | Yes | ||
| page_size | No | ||
| page_number | No | ||
| sort | No | ||
| filter_keyword | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description should disclose behavioral traits but only generically mentions 'shows user roles'. Does not address pagination, sorting, filtering, or error handling. Incomplete for an agent.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two sentences with no waste, front-loaded with the core purpose. Could be slightly more structured but acceptable.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given 5 parameters, no output schema, and no annotations, the description is too sparse. Does not cover pagination, sorting, filtering, or return format, leaving significant gaps for an agent.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 0%, and the description provides no explanation of parameters like page_size, page_number, sort, or filter_keyword. Fails to add meaning beyond parameter names.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool lists members of a Datadog team and shows roles and membership details, distinguishing it from sibling tools like list-teams which list teams themselves.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool vs alternatives (e.g., list-teams) or when not to use it. Missing context for prerequisites or edge cases.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list-teamsA
List teams in the Datadog organization. Use for 'what teams exist', 'team structure', 'find team by name'.
| Name | Required | Description | Default |
|---|---|---|---|
| pageNumber | No | Page number | |
| pageSize | No | Results per page | |
| sort | No | Sort field: name, -name, user_count, -user_count | |
| filterKeyword | No | Filter teams by keyword |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description bears full responsibility for behavioral disclosure. It only states 'List teams' with no mention of read-only nature, pagination, authentication requirements, rate limits, or performance implications. The description is insufficient to make behavioral traits transparent.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise: a single sentence with a short usage hint. No redundant information; every phrase adds value. It is front-loaded with the core purpose.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple list tool with 4 optional parameters and no output schema, the description provides the essential purpose. However, it lacks details about return values (e.g., what fields are returned) and pagination behavior. This is adequate but not comprehensive.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 100% description coverage, with each parameter (pageNumber, pageSize, sort, filterKeyword) having a clear description. The tool description does not add further meaning beyond the schema, but the schema itself is adequate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action ('List teams') and the specific resource ('in the Datadog organization'). It provides usage examples like 'what teams exist', 'team structure', 'find team by name', making it distinct from sibling list tools for other resources.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives concrete usage scenarios ('what teams exist', 'team structure', 'find team by name'), indicating when to use this tool. However, it does not explicitly state when not to use it or mention alternative tools (e.g., list_team_members), but the context of siblings makes the purpose clear.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list-usersA
List users in the Datadog organization. Use for 'who has access', 'list all users', 'find user by email'.
| Name | Required | Description | Default |
|---|---|---|---|
| pageSize | No | Results per page | |
| pageNumber | No | Page number | |
| sort | No | Sort field | |
| sortDir | No | Sort direction: asc or desc | |
| filter | No | Filter by name or email | |
| filterStatus | No | Filter by status: Active, Pending, Disabled |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, and the description does not disclose behavioral traits like pagination behavior, rate limits, authentication requirements, or implications of filters. The description is too minimal for a tool with no annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence with examples, no wasted words. Extremely concise.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
No output schema and 6 optional parameters with no description of pagination, sorting, or filtering behavior. The description is adequate but leaves gaps in understanding the tool's full behavior.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% with all parameters described. The description adds no additional meaning beyond the schema, so baseline score of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states 'List users in the Datadog organization' with specific examples ('who has access', 'list all users', 'find user by email'), making the purpose unambiguous and distinguishing it from sibling list tools.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Provides explicit use cases ('who has access', 'list all users', 'find user by email'), giving clear context for when to use this tool. Does not mention alternatives or when not to use, but the usage context is clear.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_vulnerabilitiesC
List security vulnerability findings with filtering by tool, type, severity, and status
| Name | Required | Description | Default |
|---|---|---|---|
| page_token | No | Pagination token from previous response links.next | |
| page_number | No | Page number (>= 1) | |
| filter_type | No | Vulnerability type (e.g. SqlInjection, Xss, CommandInjection, ComponentWithKnownVulnerability) | |
| filter_tool | No | Detection tool: SAST, SCA, IAST, or Infra | |
| filter_status | No | Status: Open, Muted, Remediated, InProgress, or AutoClosed | |
| filter_cvss_base_severity | No | Base severity: Unknown, None, Low, Medium, High, or Critical | |
| filter_cvss_datadog_severity | No | Datadog-adjusted severity: Unknown, None, Low, Medium, High, or Critical | |
| filter_language | No | Programming language filter | |
| filter_ecosystem | No | Ecosystem: PyPI, Maven, NuGet, Npm, RubyGems, Go, Packagist, Deb, Rpm, Apk, etc. | |
| filter_code_location_file_path | No | Filter by file path in source code | |
| filter_fix_available | No | Filter by fix availability | |
| filter_asset_name | No | Asset name (supports wildcards *) | |
| filter_asset_type | No | Asset type: Repository, Service, Host, HostImage, or Image | |
| filter_asset_environments | No | Filter by asset environments | |
| filter_asset_repository_url | No | Filter by repository URL | |
| filter_asset_risks_in_production | No | Filter assets in production | |
| filter_asset_risks_under_attack | No | Filter assets under active attack |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided; the description does not disclose behavioral traits such as pagination, rate limits, permissions, or data freshness. It only states the basic listing capability.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence, concise and front-loaded. However, it may be too brief given the tool's complexity, missing critical details like output format.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
With 17 parameters, no output schema, and no annotations, the description is insufficient. It does not explain pagination, output structure, or common usage scenarios, leaving significant gaps for an agent.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the baseline is 3. The description does not add extra meaning beyond what each parameter's description already provides, and it omits mention of pagination parameters (page_token, page_number) which could benefit from context.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action ('list') and resource ('security vulnerability findings'), and mentions key filtering dimensions. It is distinct from sibling tools like 'get-security-finding' or 'search-security-findings' but does not explicitly differentiate.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool vs. alternatives (e.g., 'search-security-findings'), nor any prerequisites or exclusions. The description only implies usage for listing with filters.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_webhooksA
List all configured webhook integrations. Useful for auditing alert routing and notification channels.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description bears the full burden of disclosing behavior. It only states that the tool 'List all configured webhook integrations,' which is a read operation, but it does not mention permissions, rate limits, whether it returns only a list of IDs or full details, or any side effects. Given the lack of annotations, this is insufficient.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise, consisting of two short sentences. Every word serves a purpose: stating the function and providing a use case. No fluff or redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given that there are no parameters and no output schema, the description is minimally adequate. It tells the agent what the tool does and a use case, but it omits details about the structure of the response (e.g., fields returned, pagination). For a simple list tool, this might be acceptable, but richer context would improve it.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has zero parameters, so there is no need for the description to explain parameters. The absence of parameters is implicit, and the description does not need to add value here.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states 'List all configured webhook integrations,' specifying a concrete verb and resource. It distinguishes itself from sibling tools by explicitly naming 'webhook integrations,' which is a distinct resource among many list_* tools.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides context: 'Useful for auditing alert routing and notification channels.' This implies when the tool might be used, but it does not explicitly state when to use this tool versus alternatives or when not to use it. No comparison or exclusion criteria are given.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_workflow_executionsB
List execution instances for a Datadog workflow. Shows run history, status, and timing.
| Name | Required | Description | Default |
|---|---|---|---|
| workflow_id | Yes | ||
| page_size | No | ||
| page_number | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description bears full responsibility. It mentions the tool shows run history, status, and timing, but does not disclose read-only nature, authentication needs, rate limits, or other behavioral traits. Minimal disclosure.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two succinct sentences: first states the action, second describes the output. No waste, front-loaded with purpose.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple list tool, the description covers basic purpose and output content but lacks parameter explanations and usage context. With no output schema and no annotations, it is minimally adequate but leaves gaps.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, and the description provides no explanation for the three parameters (workflow_id, page_size, page_number) beyond the tool name. The agent receives no additional meaning beyond the raw schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'List' and the resource 'execution instances for a Datadog workflow', distinguishing it from sibling tool 'list_workflows' which lists the workflows themselves.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No explicit guidance on when to use this tool vs alternatives; the description implies usage by requiring a workflow_id, but does not explain when to choose this over 'list_workflows' or other listing tools.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_workflowsB
List Datadog workflow automations for incident response and remediation
| Name | Required | Description | Default |
|---|---|---|---|
| page_size | No | ||
| page_number | No | ||
| filter_name | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided, so description must convey behavior. It implies a read-only listing operation scoped to incident workflows, but does not mention authentication, rate limits, or if it returns all workflows regardless of scope. Adequate for a simple list tool but lacks depth.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence of 11 words, front-loaded with verb and resource. No wasted words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
No output schema, no parameter descriptions, and no usage guidelines. For a tool with three parameters and no schema documentation, the description is insufficient for an agent to use it effectively without additional context.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0% and the description omits any mention of the three parameters (page_size, page_number, filter_name). The agent receives no guidance on how to use these parameters.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states it lists Datadog workflow automations, specifically for incident response and remediation. This distinguishes it from sibling tools like list_workflow_executions.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives (e.g., list_workflow_executions, get-workflows?). Only states what it does, not the context or exclusion criteria.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
query-metricsA
Query time-series metric data from Datadog. The backbone of observability — use for 'CPU usage over last hour', 'request rate for web service', or any metric query. Query syntax: 'avg:system.cpu.user{host:web-1}'. Returns data points with timestamps.
| Name | Required | Description | Default |
|---|---|---|---|
| query | Yes | Metrics query (e.g., 'avg:system.cpu.user{host:web-1}') | |
| from | Yes | Start time as Unix epoch seconds | |
| to | Yes | End time as Unix epoch seconds |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries full weight. It states the tool returns data points with timestamps, which is helpful. However, it lacks details on rate limits, error behavior, pagination, or any destructive implications. The description is adequate but not comprehensive.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise (4 sentences) and front-loaded with the core purpose. The second sentence is slightly marketing-like but does not detract significantly. Every sentence adds value.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple 3-parameter tool with no output schema, the description covers the essential: purpose, query syntax, and return type. However, it omits details like response format (e.g., array of data points) or potential limitations (e.g., query range limits). It is adequate but not fully complete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so parameters are already documented. The description adds value by providing query syntax examples and real-world use cases ('request rate for web service'), which helps the agent understand parameter semantics beyond the schema descriptions.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states it queries time-series metric data from Datadog, provides concrete examples ('CPU usage over last hour'), and gives query syntax, distinguishing it from sibling tools like get-metrics or get-metric-metadata which likely list metrics rather than query data points.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies usage for metric queries and gives examples, but does not explicitly state when to use this tool versus alternatives like get-metrics or search-metric-volumes. No when-not-to-use or comparison is provided.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
search_audit_logsC
Search Datadog audit logs for configuration changes, user actions, and API calls
| Name | Required | Description | Default |
|---|---|---|---|
| filter_query | No | Audit log search query | |
| filter_from | No | Start time (ISO 8601) | |
| filter_to | No | End time (ISO 8601) | |
| page_limit | No | Max results per page | |
| page_cursor | No | Pagination cursor | |
| sort | No | Sort order (timestamp or -timestamp) |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations available. Description does not disclose behavioral traits such as pagination, rate limits, or result format. Schema parameters like page_limit and page_cursor imply pagination, but description omits this.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence, no redundancy. Front-loaded with key purpose. Could include more detail without being verbose.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Despite high schema coverage, the description lacks details on time range usage, pagination, and output. For a tool with 6 parameters and no output schema, this is insufficient.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% with descriptions for all 6 parameters. Description adds no additional meaning beyond 'search' context. Baseline 3 maintained.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description specifies verb 'Search' and resource 'Datadog audit logs' with clear scope (configuration changes, user actions, API calls). However, sibling tool 'get-audit-events' also deals with audit logs, and the description does not differentiate.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool vs. alternatives like 'get-audit-events' or other search tools. No prerequisites or context provided.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
search-casesC
Search Datadog cases for incident investigation
| Name | Required | Description | Default |
|---|---|---|---|
| page_size | No | Number of results per page | |
| page_offset | No | Page offset | |
| sort_field | No | Field to sort by | |
| filter | No | Filter expression | |
| sort_asc | No | Sort ascending |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, and the description does not disclose behavioral traits such as pagination (page_size, page_offset), rate limits, authentication, or return format. For a search tool with 5 optional parameters, the absence of behavioral context limits transparency.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence with no extraneous information, making it concise. However, it could be slightly more structured by including a brief usage note, but it is not overly lengthy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
With 5 parameters, no output schema, and no annotations, the description is insufficiently complete. It does not explain return format, pagination behavior, or how to construct an effective filter expression, leaving gaps for an agent to infer.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so each parameter already has a meaningful description. The tool description adds no extra context beyond what the schema provides, meeting the baseline of 3 for high coverage.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool searches Datadog cases for incident investigation, identifying the specific resource (cases) and purpose. However, it could be more precise about what 'cases' refers to, and it does not explicitly distinguish from sibling tools like search_incidents.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives like search_incidents or get-incidents. The description implies usage for investigating incidents, but does not specify prerequisites, exclusions, or context that would help an agent decide.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
search_ci_test_eventsB
Search CI test events with filters. Use for 'find flaky tests', 'test failures in last hour', 'test duration analysis'.
| Name | Required | Description | Default |
|---|---|---|---|
| filter | No | ||
| sort | No | ||
| page | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, and the description only says 'search with filters' without disclosing behavioral traits like read-only nature, authentication, rate limits, or pagination behavior.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Extremely concise: one sentence of purpose followed by three usage examples. No wasted words, and front-loaded with key information.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Lacks essential details for a search tool with 3 parameters and nested objects: no explanation of how to use filters, sort, pagination, or what the response looks like (no output schema).
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, and the tool description does not explain any of the parameters (filter, sort, page) beyond the generic phrase 'with filters'.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Clearly states the action (search) and resource (CI test events), with specific example use cases that distinguish it from sibling tools like 'list_ci_tests' or other search tools.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Provides explicit scenarios for use ('find flaky tests', 'test failures in last hour'), giving clear context, but does not mention when not to use or direct alternatives.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
search-error-tracking-eventsA
Search Error Tracking events across services. Use for 'what errors are happening in production', 'error groups for payment service', 'new errors this week'. Returns error groups with counts, first/last seen, and affected services.
| Name | Required | Description | Default |
|---|---|---|---|
| filter | No | ||
| sort | No | Sort order | |
| page | No | ||
| limit | No | Maximum events to return |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The description discloses the return structure (error groups with counts, first/last seen, affected services), which is helpful. However, it does not mention pagination, rate limits, or authentication, and there are no annotations to supplement these aspects. The transparency is adequate but not comprehensive.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is very concise with three sentences, front-loading the purpose, followed by use cases and output description. Every sentence is informative and without redundancy, achieving high efficiency.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
While the description covers the main purpose and output, it lacks details on parameter usage, pagination, and differentiation from similar tools. Given the tool has nested parameters and no output schema, the description leaves some gaps for a complete understanding.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
With 50% schema description coverage, the description adds minimal parameter insight beyond the schema. It provides example queries but does not explain how to construct the filter or handle pagination, so it does not significantly enhance understanding of the parameters.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states 'Search Error Tracking events across services' and provides concrete examples, making the purpose clear. However, it does not differentiate from the sibling tool 'search_error_tracking_issues', which likely focuses on a different aspect, thus not achieving a top score.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives practical use case examples ('what errors are happening in production', 'error groups for payment service'), which provide context. However, it does not mention when not to use this tool or alternatives, missing explicit exclusions.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
search_error_tracking_issuesB
Search Datadog error tracking issues for user-facing errors and exceptions
| Name | Required | Description | Default |
|---|---|---|---|
| filter_query | No | Error tracking search query | |
| filter_from | No | Start time (ISO 8601) | |
| filter_to | No | End time (ISO 8601) | |
| page_limit | No | Max results per page | |
| page_cursor | No | Pagination cursor | |
| sort | No | Sort order |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must disclose behavioral traits. It only states 'search,' implying read-only but does not detail what constitutes an 'issue,' whether the operation is idempotent, requires any permissions, or has rate limits. Significant behavioral gaps remain.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, concise sentence that immediately conveys the tool's purpose. It is front-loaded and wastes no words. However, it could slightly expand without becoming verbose, resulting in a 4 rather than a 5.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no output schema, the description should clarify what the tool returns (e.g., list of issues with structure). It does not. Also, with 6 parameters, the description fails to explain how parameters interact (e.g., does filter_query search issue titles or stack traces?). The tool is underspecified for effective use.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Input schema has 100% coverage, so each parameter has a description (e.g., 'Error tracking search query', 'Start time (ISO 8601)'). The description adds no further meaning beyond the schema, which already sufficiently defines parameter purposes. Baseline score of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's function with a specific verb ('Search'), resource ('Datadog error tracking issues'), and scope ('user-facing errors and exceptions'). It distinguishes itself from sibling tools like search-error-tracking-events by focusing on aggregated issues rather than raw events.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
There is no guidance on when to use this tool versus alternatives. With many sibling search tools (e.g., search-error-tracking-events, search-logs), the description should clarify that this is for error tracking issues specifically and not for other error-related searches, but it does not provide any such direction.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
search_incidentsC
Search Datadog incidents with advanced filtering by severity, status, and time range
| Name | Required | Description | Default |
|---|---|---|---|
| query | Yes | ||
| filter_created_start | No | ||
| filter_created_end | No | ||
| page_size | No | ||
| page_offset | No | ||
| sort | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must carry the burden of behavioral disclosure. It mentions filtering but does not disclose whether the operation is read-only, rate limits, pagination behavior, or result limits. For a search tool, this is insufficient.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence that is front-loaded with the verb and resource. No unnecessary words. Perfectly concise.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
With 6 parameters, no annotations, and no output schema, the description should provide more context about pagination, sorting, and the structure of returned data. The description is too brief for a search tool with advanced filters.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The schema has 0% description coverage, meaning the description must compensate. The description mentions filtering by severity, status, and time range, which are not explicitly in the parameters (except filter_created_start/end for time range). Severity and status are likely part of the query string, but this is not clarified. The description adds some meaning but leaves ambiguity.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states verb 'Search', resource 'Datadog incidents', and mentions advanced filtering by severity, status, and time range. However, it does not differentiate from sibling tools like get-incidents or other search tools, which may have similar functionality.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No explicit guidance on when to use this tool versus alternatives, such as get-incidents or other search tools. No prerequisites or when-not-to-use conditions are provided.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
search-logsA
Search and retrieve log entries from Datadog. Use for 'find errors in auth service', 'show logs from last hour', or investigating issues. Query syntax: 'service:web-app status:error', time range: 'now-15m' to 'now'. Returns actual log messages. Use aggregate-logs for counts/stats instead.
| Name | Required | Description | Default |
|---|---|---|---|
| filter | No | ||
| sort | No | ||
| page | No | ||
| limit | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries full burden. It mentions that returns actual log messages, which is useful. However, it does not disclose behavioral traits like pagination limits, cursor usage, or rate limiting. The parameters page and limit are present in schema but not explained, leaving gaps.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise—two sentences that front-load the purpose and then deliver usage guidelines and alternative. No redundancy or irrelevant information.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no output schema and 4 parameters with nested objects, the description covers purpose and usage but lacks details on pagination, result limits, and output format. For a search tool, it is adequate but not comprehensive.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, so the description must compensate. It provides query syntax examples and time range format for the filter sub-properties, but does not explain sort, page, cursor, or limit parameters. Partial coverage, baseline 3.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'search and retrieve', the resource 'log entries from Datadog', and provides specific example use cases. It distinguishes from the sibling tool 'aggregate-logs' by mentioning its alternative use.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Explicit guidance is provided with concrete examples ('find errors in auth service', 'show logs from last hour'), query syntax, and time range format. It also explicitly states when to use an alternative ('Use aggregate-logs for counts/stats instead'), offering clear decision support.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
search-metric-volumesA
Search metrics by name pattern with volume and ingestion data. Use for 'find metrics matching pattern', 'metric ingestion volume', 'what metrics are configured'.
| Name | Required | Description | Default |
|---|---|---|---|
| filterMetric | No | Metric name filter with wildcard support | |
| filterConfigured | No | Only show configured metrics | |
| filterTagsConfigured | No | Filter by tag configuration | |
| filterActiveWithin | No | Only metrics active within N hours | |
| windowSeconds | No | Time window for volume data |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided, description carries full burden. It states the tool searches with volume and ingestion data but gives no details on pagination, rate limits, side effects, or interpretation of volume. Minimal behavioral context.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two concise sentences: first states function, second lists use cases. No fluff, front-loaded with key information.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Adequate for a search tool with 5 parameters but no output schema or annotations. Lacks details on parameter interactions (e.g., AND/OR logic, defaults, pagination). Could be more complete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so baseline is 3. Description does not add additional meaning beyond the schema; it only mentions 'metric name pattern' which maps to filterMetric. No extra parameter insights.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states the verb (search) and resource (metrics by name pattern with volume and ingestion data), and provides example use cases. It distinguishes from siblings like 'query-metrics' by mentioning volume data, but lacks explicit differentiation.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Explicitly lists use cases: 'find metrics matching pattern', 'metric ingestion volume', 'what metrics are configured'. However, it does not specify when not to use or mention alternatives.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
search-rum-eventsA
Search Real User Monitoring (RUM) events. Use for 'frontend errors in production', 'slow page loads', 'user session analysis'. Query syntax similar to logs: '@type:error @application.id:abc'. Returns user sessions, views, actions, and errors.
| Name | Required | Description | Default |
|---|---|---|---|
| filter | No | ||
| sort | No | Sort order ('timestamp' or '-timestamp') | |
| page | No | ||
| limit | No | Maximum events to return |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the burden. It implies a read-only search operation and lists return types (sessions, views, actions, errors). However, it does not explicitly state side effects, permissions, or rate limits.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is three sentences: purpose, use cases, and output + example. It is front-loaded and contains no extraneous information.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no output schema, the description explains return types. It covers key aspects but does not mention pagination details or differentiate from aggregate-rum-events.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 50%, and the description adds a query syntax example for the filter parameter. This adds some value but does not fully compensate for missing schema descriptions on nested properties.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states it searches RUM events, provides example use cases, and mentions query syntax. However, it does not explicitly differentiate from siblings like aggregate-rum-events or search-logs.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives explicit use cases ('frontend errors', 'slow page loads', 'user session analysis') and hints at query syntax. But it does not mention when to avoid this tool or provide alternatives among siblings.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
search-security-findingsA
List or search Datadog security findings (Cloud Security Management). Use to retrieve findings with a query and optional pagination cursor. Requires security_monitoring_findings_read or appsec_vm_read (OAuth apps still require security_monitoring_findings_read).
| Name | Required | Description | Default |
|---|---|---|---|
| filter | No | ||
| page | No | ||
| limit | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description must disclose behavioral traits. It mentions optional pagination cursor and permission requirements, including a note about OAuth apps. However, it does not clarify pagination behavior, rate limits, or what happens when no results are found, leaving gaps.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise: two sentences, front-loaded with the core purpose, and every sentence adds necessary context. No wasted words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description covers the basic purpose and permissions but lacks details on pagination behavior, return structure, and full parameter explanations. Without output schema or annotations, it is not fully complete for a tool with nested objects and 3 parameters.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The description adds meaning by explaining that 'filter.query' is for querying and 'page.cursor' is for pagination, but it omits the 'limit' parameter and does not describe nested object structures. Given 0% schema description coverage, it partially compensates but not fully.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb ('List or search') and the resource ('Datadog security findings (Cloud Security Management)'), making the tool's purpose specific and easily distinguishable from siblings like 'list-posture-findings' or 'get-security-finding'.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description mentions required permissions but provides no guidance on when to use this tool versus alternatives (e.g., when to search vs. list, or how it differs from 'search-security-signals'). There is no explicit when-to-use or when-not-to-use advice.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
search-security-signalsC
Search security monitoring signals (threat detections, security alerts). Use for 'recent security alerts', 'threat detections', 'security signal search'.
| Name | Required | Description | Default |
|---|---|---|---|
| filter | No | ||
| sort | No | Sort order | |
| page | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must fully disclose behavioral traits. It only says 'search' without mentioning read-only nature, permission requirements, or pagination behavior. This is insufficient for a search tool.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise with two sentences. It is front-loaded with the core purpose and adds example usage. However, it could be slightly more structured to improve readability.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the complexity (3 top-level parameters with nested objects, no output schema, many siblings), the description is incomplete. It does not explain pagination, sorting, or filtering details, nor does it describe what the response contains.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage for top-level parameters is low (33%). The description does not add meaning beyond what is in the schema for parameters like 'filter', 'sort', and 'page'. It fails to compensate for the schema gaps.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's purpose: 'Search security monitoring signals (threat detections, security alerts)'. It uses a specific verb and resource, and provides example usage phrases that help differentiate from siblings like 'search-security-findings'.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives example use cases ('recent security alerts', 'threat detections', 'security signal search') but does not specify when not to use this tool or compare it to alternatives. More explicit guidance would be beneficial given the many sibling tools.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
search_slosB
Search and filter SLOs by query string. Supports pagination and faceted search for finding specific SLOs by name, tags, or other attributes.
| Name | Required | Description | Default |
|---|---|---|---|
| query | No | ||
| page_size | No | ||
| page_number | No | ||
| include_facets | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are present, so the description carries full burden. It mentions pagination and faceted search but does not disclose whether the operation is read-only, destructive, or its side effects. Missing details on auth requirements, rate limits, or error handling.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise with two sentences. The first sentence defines the core purpose, and the second adds key features. No redundant or unnecessary information.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description lacks critical details about return format, pagination specifics, query syntax, and output structure. Given the lack of output schema and annotations, the description does not sufficiently equip an agent to use the tool effectively for complex queries.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
With 0% schema description coverage, the description adds meaning by linking parameters to features: 'query string' for query parameter, 'pagination' for page_size/page_number, 'faceted search' for include_facets. However, it lacks details on parameter formats, constraints, or defaults.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool searches and filters SLOs by query string, with specific features like pagination and faceted search. It specifies the resource (SLOs) and the action (search/filter), distinguishing it from general list tools like 'get-slos'.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies usage for finding specific SLOs by query, but does not explicitly state when to use this tool over siblings like 'get-slos' or when not to use it. No guidance on prerequisites or alternatives is provided.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
search-spansA
Search APM spans/traces. Use for 'find slow requests', 'show errors in payment service', or investigating latency. Query syntax: 'service:web status:error @duration:>1s'. Returns individual spans with trace IDs. Use get-trace for full trace context.
| Name | Required | Description | Default |
|---|---|---|---|
| filter | No | ||
| sort | No | Sort order ('timestamp' or '-timestamp') | |
| page | No | ||
| limit | No | Maximum spans to return |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries full burden. It states the tool returns 'individual spans with trace IDs', but does not disclose pagination behavior, rate limits, authentication needs, or that it is a read-only operation. More transparency would be beneficial.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise: three sentences covering purpose, use cases, query syntax, output, and sibling reference. Every sentence adds value without redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no output schema, the description mentions 'Returns individual spans with trace IDs', which is helpful but not fully comprehensive. It properly references sibling tool 'get-trace' for context. Could include more about time range or pagination, but overall adequate.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 50%, but the description adds significant value by explaining the query syntax with an example ('service:web status:error @duration:>1s'). This helps agents understand how to construct the query parameter beyond the schema's simple description.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's purpose: 'Search APM spans/traces'. It provides specific use cases like 'find slow requests' and 'show errors in payment service', and explicitly distinguishes from sibling tool 'get-trace' by directing users to use that for full trace context.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives explicit when-to-use guidance with example queries and use cases. It also provides an alternative: 'Use get-trace for full trace context', helping agents choose correctly.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections. Dates show when Glama detected each change.
117 tool updates
v1.11.0- First observed
aggregate_network_connections - First observed
aggregate-logs - First observed
aggregate-rum-events - First observed
aggregate-spans - First observed
get_csm_coverage - First observed
get_dbm_query_metrics - First observed
get_error_tracking_issue - First observed
get_estimated_cost - First observed
get_hourly_usage - First observed
get_incident_services - First observed
get_incident_timeline - First observed
get_incident_todos - First observed
get_ip_ranges - First observed
get_logs_archive_order - First observed
get_logs_pipeline_order - First observed
get_metric_tag_config - First observed
get_monitor_config_policies - First observed
get_notebook - First observed
get_organization - First observed
get_sensitive_data_scanner_config - First observed
get_slo_corrections - First observed
get_top_avg_metrics - First observed
get-active-hosts-count - First observed
get-audit-events - First observed
get-ci-pipeline-events - First observed
get-containers - First observed
get-dashboard - First observed
get-dashboards - First observed
get-dbm-samples - First observed
get-downtimes - First observed
get-events - First observed
get-host-tags - First observed
get-hosts - First observed
get-incidents - First observed
get-log-indexes - First observed
get-log-pipelines - First observed
get-logs-archives - First observed
get-logs-indexes - First observed
get-logs-metrics - First observed
get-logs-pipelines - First observed
get-metric-metadata - First observed
get-metrics - First observed
get-monitor - First observed
get-monitors - First observed
get-notebooks - First observed
get-powerpacks - First observed
get-security-finding - First observed
get-service-definition - First observed
get-service-dependencies - First observed
get-services - First observed
get-slo - First observed
get-slo-history - First observed
get-slos - First observed
get-spans-metrics - First observed
get-synthetic-results - First observed
get-synthetic-tests - First observed
get-trace - First observed
get-usage - First observed
list_api_keys - First observed
list_app_keys - First observed
list_authn_mappings - First observed
list_aws_accounts - First observed
list_azure_integration - First observed
list_ci_tests - First observed
list_cloudflare_accounts - First observed
list_confluent_accounts - First observed
list_containers - First observed
list_cost_budgets - First observed
list_csm_threats_agent_rules - First observed
list_dora_deployments - First observed
list_downtime_schedules - First observed
list_fleet_agents - First observed
list_gcp_integration - First observed
list_host_totals - First observed
list_logs_metrics - First observed
list_metric_tag_configs - First observed
list_monitor_notification_rules - First observed
list_network_devices - First observed
list_notebooks - First observed
list_restriction_policies - First observed
list_security_monitoring_rules - First observed
list_security_rules - First observed
list_spans_metrics - First observed
list_synthetics_global_variables - First observed
list_synthetics_locations - First observed
list_synthetics_private_locations - First observed
list_team_members - First observed
list_vulnerabilities - First observed
list_webhooks - First observed
list_workflow_executions - First observed
list_workflows - First observed
list-ci-pipelines - First observed
list-dashboard-lists - First observed
list-permissions - First observed
list-posture-findings - First observed
list-processes - First observed
list-roles - First observed
list-rum-applications - First observed
list-scorecard-outcomes - First observed
list-scorecard-rules - First observed
list-service-definitions - First observed
list-teams - First observed
list-users - First observed
query-metrics - First observed
search_audit_logs - First observed
search_ci_test_events - First observed
search_error_tracking_issues - First observed
search_incidents - First observed
search_slos - First observed
search-cases - First observed
search-error-tracking-events - First observed
search-logs - First observed
search-metric-volumes - First observed
search-rum-events - First observed
search-security-findings - First observed
search-security-signals - First observed
search-spans
TDQS
Many tools have overlapping purposes; for example, multiple list_* tools for cloud integrations and duplicate-like tools such as get-log-indexes and get-logs-indexes. Confusion likely between similar queries like aggregate-logs and search-logs.
Mixed naming conventions: some use kebab-case (e.g., get-active-hosts-count), others snake_case (e.g., aggregate_network_connections). No consistent pattern, making it hard to predict tool names.
117 tools is excessive for a single server, far beyond typical scopes. This overwhelms agents and makes selection inefficient.
Covers many Datadog domains (logs, metrics, APM, RUM, security, synthetics), but the organization is messy with redundancies, leaving gaps in tool discovery and usability.
Maintenance
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.
Related MCP Connectors
Read-only MCP access to a documented IT fleet: state, changes, posture. 15 tools.
Query your org's data in natural language — read-only MCP access to SQL, NoSQL, files & warehouses.
The Cortex MCP server provides read-only access to real-time engineering context from the Cortex developer portal, allowing AI coding assistants to answer natural language questions about your organization's catalog (microservices, libraries, domains, teams, infrastructure), scorecards (engineering standards and best practices), initiatives (goals and deadlines), and Engineering Intelligence metrics. It includes tools for querying documentation, tracking personal entities, and accessing AI-assisted insights across the entire Cortex ecosystem.
Read-only MCP server for AIStatusDashboard status, incidents, metrics, and fallback recommendations.
Related MCP Servers
- AlicenseBqualityDmaintenanceEnables interaction with Datadog's monitoring and observability platform through the MCP protocol. Supports incident management, monitor status checks, log searches, metrics queries, APM traces, dashboard access, RUM analytics, host management, and downtime scheduling.1321Apache 2.0
- AlicenseCqualityDmaintenanceA read-only MCP server that enables users to query Databricks SQL, browse metadata, and monitor Delta Lake tables. It also supports tracking Databricks Jobs, DLT Pipelines, and cluster metrics through natural language interfaces.254MIT
- FlicenseNot gradedqualityDmaintenanceA Model Context Protocol (MCP) server that provides comprehensive Datadog monitoring capabilities, enabling Claude to manage CI/CD pipelines, analyze logs, query metrics, and handle monitors and SLOs.-
- AlicenseNot gradedqualityDmaintenanceAn MCP server that provides comprehensive read/write access to Datadog APIs, enabling management of monitors, dashboards, logs, incidents, and more via natural language commands.MIT
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/dreamiurg/datadog-mcp'
If you have feedback or need assistance with the MCP directory API, please join our Discord server