Skip to main content
Glama

generate_with_controlnet

Generate an image using a ControlNet model to condition on a preprocessed image (pose, depth, canny edges) combined with a text prompt. Provide the control image URL and model filename from ComfyUI's models/controlnet/ directory.

Instructions

Generate an image conditioned by a ControlNet preprocessed image (pose, depth, canny, etc.) plus a prompt. Requires a ControlNet model installed in ComfyUI's models/controlnet/ directory. The control_image_url must already be the preprocessed conditioning image — this tool does not run preprocessors itself.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
promptYesText prompt for the generated image.
negative_promptNo
control_image_urlYesURL of the conditioning image (pose skeleton, depth map, canny edges, normal map, etc.). Must already match the control type — ControlNet expects preprocessed input.
controlnet_modelYesControlNet model filename from your ComfyUI `models/controlnet/` directory. Examples: 'control_v11p_sd15_openpose.safetensors', 'control_v11f1p_sd15_depth.safetensors', 'control_v11p_sd15_canny.safetensors', 'controlnet-union-sdxl-1.0.safetensors'.
strengthNoHow strongly ControlNet influences generation. 1.0 = full.
start_percentNoFraction of the sampling timeline at which ControlNet starts.
end_percentNoFraction of the sampling timeline at which ControlNet stops.
widthNo
heightNo
stepsNo
cfgNo
seedNo
checkpointNo
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full responsibility. It discloses the requirement for a ControlNet model in a specific directory and that the input image must be preprocessed, but it omits potential failure modes, rate limits, or output format. For a complex tool, this is insufficient.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is three sentences, each essential. It front-loads the core purpose, then adds prerequisites, then a key constraint. No unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given 13 parameters, no output schema, and no annotations, the description is incomplete. It does not explain return values, error conditions, or how to obtain valid preprocessed images beyond stating they must be preprocessed. Users are left with many unknowns.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 46%, and the description adds context for control_image_url (must be preprocessed) and controlnet_model (with examples). However, many parameters lack explanation in both schema and description, and the description does not fully compensate for the low coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool generates an image conditioned by a ControlNet preprocessed image plus a prompt. It specifies the resource (image generation with ControlNet) and verb (generate), effectively distinguishing it from siblings like 'generate_image' and 'generate_with_ip_adapter'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly states when to use the tool (when you have a preprocessed conditioning image and a prompt) and what it does not do (run preprocessors). It does not directly name alternatives but the sibling list provides implicit guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Install Server

Other Tools

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/miller-joe/comfyui-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server