generate_with_controlnet
Generate an image using a ControlNet model to condition on a preprocessed image (pose, depth, canny edges) combined with a text prompt. Provide the control image URL and model filename from ComfyUI's models/controlnet/ directory.
Instructions
Generate an image conditioned by a ControlNet preprocessed image (pose, depth, canny, etc.) plus a prompt. Requires a ControlNet model installed in ComfyUI's models/controlnet/ directory. The control_image_url must already be the preprocessed conditioning image — this tool does not run preprocessors itself.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| prompt | Yes | Text prompt for the generated image. | |
| negative_prompt | No | ||
| control_image_url | Yes | URL of the conditioning image (pose skeleton, depth map, canny edges, normal map, etc.). Must already match the control type — ControlNet expects preprocessed input. | |
| controlnet_model | Yes | ControlNet model filename from your ComfyUI `models/controlnet/` directory. Examples: 'control_v11p_sd15_openpose.safetensors', 'control_v11f1p_sd15_depth.safetensors', 'control_v11p_sd15_canny.safetensors', 'controlnet-union-sdxl-1.0.safetensors'. | |
| strength | No | How strongly ControlNet influences generation. 1.0 = full. | |
| start_percent | No | Fraction of the sampling timeline at which ControlNet starts. | |
| end_percent | No | Fraction of the sampling timeline at which ControlNet stops. | |
| width | No | ||
| height | No | ||
| steps | No | ||
| cfg | No | ||
| seed | No | ||
| checkpoint | No |