Skip to main content
Glama

configure_inference_scenario

Idempotent

Create or replace a typed inference replay scenario configuration without executing it. Define server, provider, and workload parameters for subsequent benchmark runs.

Instructions

Create or replace one typed inference replay scenario without executing it.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
nameYes
seedNo
providerYes
operationYes
streamingNo
burstinessNoRequires request_rate when supplied.
concurrencyNo
num_promptsNo
server_nameYes
request_rateNo
endpoint_typeNochat
speedup_ratioNo
random_input_lenNo
random_output_lenNo
trace_artifact_idNoMooncake JSONL artifact; supported only by the AIPerf provider.
random_range_ratioNo
warmup_request_countNo
semantic_oracle_workloadNoDeclared workload with an oracle contract, not an ordinary workload.
expected_configuration_idNo

Output Schema

TableJSON Schema
NameRequiredDescriptionDefault

No arguments

Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already flag the operation as non-read-only and idempotent. The description adds that it does not execute the scenario and that it can replace an existing configuration, which is useful context but does not go into further detail about side effects or permissions. No contradiction with annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The entire description is a single concise sentence that effectively front-loads the core purpose and the non-execution behavior. No wasted words, every part adds meaning.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with 19 parameters and a complex configuration task, this description is far too sparse. It omits what a 'typed inference replay scenario' is, how it relates to servers or workloads, and does not guide the user through parameter selection, despite having an output schema that can't convey configuration semantics.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is only 16% and the tool description provides no parameter explanations, leaving 19 parameters to be interpreted solely from the schema. The description doesn't even mention the required parameters, so it fails to compensate for the low coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses specific verbs 'Create or replace' and identifies the resource as 'typed inference replay scenario', with the qualifier 'without executing it' clearly distinguishing it from execution tools like run_inference_scenario. This differentiates the tool's purpose from siblings such as plan_inference_scenario and run_inference_scenario.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The phrase 'without executing it' implies the tool is for configuration rather than execution, but the description does not explicitly state when to use it over alternatives like run_inference_scenario or plan_inference_scenario, nor does it mention prerequisites or exclusions. This is implied usage rather than explicit guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Install Server

Other Tools

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/morluto/flameox'

If you have feedback or need assistance with the MCP directory API, please join our Discord server