generate_with_controlnet
Generate images guided by a ControlNet preconditioned image (e.g., pose, depth, canny) and a text prompt. Upload the control image first, then pass its filename. Returns a prompt ID immediately.
Instructions
Generate an image conditioned by a ControlNet preprocessed image (pose skeleton, depth, canny, normal, etc.) plus a text prompt. Upload the control image first with upload_image, then pass its filename as control_image. Unspecified params fall back to your defaults; checkpoint and controlnet_model auto-resolve from local models. Returns prompt_id immediately; asset_id arrives in the completion notification. control_image must already be a preprocessed map (this tool does not run the preprocessor); requires a running ComfyUI with a matching controlnet model in models/controlnet/.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| prompt | Yes | Positive text prompt | |
| control_image | Yes | Filename of the (already-uploaded) control image in ComfyUI's input dir | |
| controlnet_model | No | ControlNet model file (in models/controlnet/); auto-selected if omitted | |
| strength | No | ControlNet conditioning strength, typically 0.0-2.0 (default 1.0); higher = stronger adherence to the control image | |
| negative_prompt | No | Negative prompt (default: empty / from defaults) | |
| width | No | Image width in pixels | |
| height | No | Image height in pixels | |
| steps | No | Sampling steps | |
| cfg | No | CFG scale | |
| sampler | No | Sampler name (e.g. euler, dpmpp_2m) | |
| scheduler | No | Scheduler (e.g. normal, karras) | |
| seed | No | Seed (omit to randomize) | |
| checkpoint | No | Checkpoint filename; auto-selected if omitted |