ComfyMCP Studio

ComfyMCP Studio is an MCP (Model Context Protocol) server for generating 2D game assets using AI workflows powered by ComfyUI.

What you get

• ComfyUI-backed generation

  • Production-quality SDXL/SD1.5 workflows

• High-quality outputs by default

  • Render at preset resolution (SDXL-native) then downscale for cleaner details

• Consistent character animations (img2img)

  • Generate multiple poses from a single reference image

• Viewpoint control with ControlNet (top-down / side / front / 3/4)

  • Generate top-down assets with stronger camera-angle consistency

• Presets for common game styles

  • Icon, character, tileset, top-down presets, pixel presets

• Post-processing

  • Resize, remove background, add outline

• Unity export + batch generation

Requirements

• Python: 3.10+

• ComfyUI: running locally (default 127.0.0.1:8188)

• Stable Diffusion checkpoint

  • SDXL recommended (default configured: sd_xl_base_1.0.safetensors)

• (Optional) ControlNet models

  • Required only for generate_with_viewpoint / generate_topdown_asset

Installation

Configuration

Copy .env.example to .env and configure:

ComfyUI setup

• Start ComfyUI (example):

• Checkpoint

  • Make sure your checkpoint exists in ComfyUI (example: ComfyUI/models/checkpoints/).

  • This server reads COMFYUI_CHECKPOINT from .env.

ControlNet setup (for viewpoint locking)

If you use viewpoint tools, you must install a ControlNet model in: ComfyUI/models/controlnet/

• SDXL depth model (example)

  • diffusers_xl_depth_full.safetensors

Restart ComfyUI after adding models.

If you see HTTP 400 Bad Request when calling /prompt, it usually means:

• The controlnet_model name is wrong, or

• The ControlNet nodes/models are not installed/available.

Run as MCP server (Windsurf)

Add this to your MCP settings (or copy from mcp_config.json):

Tools

• ping - Backend health check

• list_available_presets - Lists preset names + configs

• generate_sprite - Single image generation from prompt

• generate_icons - Batch icons + optional atlas

• generate_tileset - Tileable tiles by theme

• generate_character - Character generation (prompt-driven)

• generate_character_animations - Img2img multi-pose animations from a reference image

• generate_with_viewpoint - ControlNet depth-guided generation for stable camera angle

• generate_topdown_asset - Convenience wrapper for top-down assets (prop, character, creature, tile, effect)

• process_image - Resize / remove background / add outline

• create_sprite_atlas - Combine images to spritesheet

• export_to_unity - Export output PNGs into a Unity project folder

• batch_generate - Batch generation with prompts

Presets

You can list presets via list_available_presets.

General

• default - General purpose game asset

• icon / icon_item - Game icons

• character / character_portrait - Character sprites

• tileset - Seamless tileable textures

• environment - Background/environment art

• prop - Game props (3/4 view)

Top-down (ControlNet)

• topdown_prop - Top-down props

• topdown_character - Top-down characters

• topdown_creature - Top-down creatures/enemies

• topdown_tile - Top-down tiles

Effects & UI

• effect / magic_effect - VFX and spell effects

• ui_button / ui_frame - UI elements

Creatures

• creature - Fantasy creatures/monsters

Style-specific

• handpainted - Hand-painted art style

• flat_ui - Flat design UI

• isometric - Isometric game assets

• pixel_art / pixel_character - Pixel art style

• pixel_16 / pixel_32 / pixel_64 - Specific pixel sizes

Testing

Quick smoke test

ControlNet viewpoint tests

Character animation tests (img2img)

Output

Generated images are saved under OUTPUT_DIR when you call tools with save_to_file=true. Typical folders:

• output/controlnet/

• output/icons/

• output/characters/

• output/tilesets/

Troubleshooting

• HTTP 400 Bad Request

  • Check ControlNet model file exists in ComfyUI/models/controlnet/

  • Verify the exact filename passed as controlnet_model

  • Restart ComfyUI after installing models

• Results still not top-down

  • Increase control_strength (try 0.90 to 1.0)

  • Use preset=topdown_character/topdown_prop

• Duplicated/fragmented weapons/armor

  • Add explicit constraints to prompt: single character, one sword, one shield

License

MIT