generate_with_controlnet
Generate images conditioned on ControlNet preprocessed maps (pose, depth, canny) and text prompts. Upload the control image first, then provide its filename and prompt.
Instructions
Generate an image conditioned by a ControlNet preprocessed image (pose skeleton, depth, canny, normal, etc.) plus a text prompt. Upload the control image first with upload_image, then pass its filename as control_image. Unspecified params fall back to your defaults; checkpoint and controlnet_model auto-resolve from local models. Returns prompt_id immediately; asset_id arrives in the completion notification. control_image must already be a preprocessed map (this tool does not run the preprocessor); requires a running ComfyUI with a matching controlnet model in models/controlnet/.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| prompt | Yes | Positive text prompt | |
| control_image | Yes | Filename of the (already-uploaded) control image in ComfyUI's input dir | |
| controlnet_model | No | ControlNet model file (in models/controlnet/); auto-selected if omitted | |
| strength | No | ControlNet conditioning strength, typically 0.0-2.0 (default 1.0); higher = stronger adherence to the control image | |
| negative_prompt | No | Negative prompt (default: empty / from defaults) | |
| width | No | Image width in pixels | |
| height | No | Image height in pixels | |
| steps | No | Sampling steps | |
| cfg | No | CFG scale | |
| sampler | No | Sampler name (e.g. euler, dpmpp_2m) | |
| scheduler | No | Scheduler (e.g. normal, karras) | |
| seed | No | Seed (omit to randomize) | |
| checkpoint | No | Checkpoint filename; auto-selected if omitted |