Skip to content

Regional Prompt Control

Kahsolt edited this page Mar 30, 2024 · 1 revision

Regional Prompt Control

Draw large images by fusing multiple regions together.

⚠ we recommend you use custom regions to fill the whole canvas.

ℹ Normally, all tiles share the same main prompt. So you can't draw meaningful objects with the main prompt, it will draw your object everywhere and ruin your image. ℹ To handle this, we provide the powerful region prompt control tool.

Tab

  1. First, enable the region prompt control.
    • NOTE: When you enable the control, the default tiling behavior will be disabled.
    • If your custom regions can't fill the whole canvas, it will produce brown color (MultiDiffusion) or noises (Mixture of Diffusers) in those uncovered areas.
    • We recommend you use your own regions to fill the canvas, as it can be much faster when generation.
    • If you are lazy to draw, you can also enable the Draw full canvas background. However, this will be much slower when generation.
  2. Upload an image or click the button to create an empty image as a reference.
  3. Click the enable in Region 1, you will see a red rectangle appears in the image.
    • Click and drag the region with your mouse to move and resize them.
  4. Select region type. If you want to draw objects, select Foreground. Otherwise select Background.
    • Feather will appear if you select foreground.
    • The larger value will give you more smooth edges.
  5. Type in your prompt and negative prompt for the region.
    • Note: your prompt will be appended to the prompt at the top of the page.
    • You can leverage this to save your words, i.e., write common things like "masterpiece, best quality, highres..." and use embedding like EasyNegative at the top of the page.
    • You can also use Textual Inversion and LoRA in the prompt

Example 1: draw multiple characters at a high resolution

  • Params:

    • Ckpt: Anything V4.5, 1920 * 1280 (no highres), method=Mixture of Diffusers
    • Main prompt = masterpiece, best quality, highres, extremely clear 8k wallpaper, white room, sunlight
    • Negative prompt = ng_deepnegative_v1_75t EasyNegative
    • The tile size parameters become useless; just ignore them.
  • Regions:

    • Region 1: Prompt = sofa, Type = Background
    • Region 2: Prompt = 1girl, gray skirt, (white sweater), (slim) waist, medium breast, long hair, black hair, looking at viewer, sitting on sofa, Type = Foreground, Feather = 0.2
    • Region 3: Prompt = 1girl, red silky dress, (black hair), (slim) waist, large breast, short hair, laughing, looking at viewer, sitting on sofa, Type = Foreground, Feather = 0.2
  • Region Layout: MultiCharacterRegions

  • Result (2 out of 4) MultiCharacter MultiCharacter

Example 2: draw a full-body character

ℹ Usually, it is difficult to draw a full-body character at a high resolution (e.g., it may concatenate two bodies). ℹ By putting your character in your background, it becomes much easier.

  • Params:

    • Ckpt: Anything V4.5, width = 1280, height = 1600 (no highres), method=MultiDiffusion
    • Main prompt: masterpiece, best quality, highres, extremely clear 8k wallpaper, beach, sea, forest
    • Neg prompt: ng_deepnegative_v1_75t EasyNegative
  • Regions:

    • Region 1 Prompt = 1girl, black bikini, (white hair), (slim) waist, giant breast, long hair, Type = Foreground, Feather: 0.2
    • Region 2 Prompt = (empty), Type: Background
  • Region Layout FullBodyRegions

  • Result: 32s, 4729 MB on NVIDIA V100. I was lucky to get this at once without cherry-picks. FullBody

  • Also works well for 2.5D characters. For example, the 1024*1620 image generation

  • Great thanks to all settings from @辰熙. Click here for more of her artworks: https://space.bilibili.com/179819685

  • Cherry-picked from 20 generations. FullBody2