Upscaling breaks the image in InPaint

[h3rmit-git]

Using upscaling in Reactor seems to break the image in InPaint.

The unmasked portion of the original image seems to be copied inside the upscaled image, as demonstrated below.

Steps to reproduce:

1. Load an image in InPaint and paint a masking area.
2. Enable the Reactor plugin and load a face.
3. Select an upscaler, e.g. ESRGAN_4x
4. Scale by a factor greater than 1, e.g. 1.3.
5. Generate

INPUT IMAGE:

OUTPUT IMAGE:

[Kuzlata]

I can't replicate your issue. Face replacement works as intended. Using the "only masked" option.

[h3rmit-git]

I'm using the "Whole picture" option, which is the default in InPaint.

Indeed, the error goes away in "Only masked" mode.

[Gourieff]

Hm... I will note this trait in more detail in the README
Thank you guys for pointing this out

[h3rmit-git]

Would it be possible to fix it?

[Gourieff]

Would it be possible to fix it?

Hard to say, I will try to investigate it later

[Kuzlata]

@h3rmit-git
I have tried the "whole picture" mode with your provided source picture and still cannot replicate this issue. I have gone through all resize modes, denoise straight and resolutions back and forth. The faceswap works as expected.
Maybe there are other extensions that interfere your faceswap process or something is broken inside your Automatic1111 installation.

[h3rmit-git]

Alright. I'm using:

• WebUI v1.3.0
• Python 3.10.6
• Torch: 2.0.1 + cu118
• xformers: 0.0.17
• Gradio: 3.31.0
• Reactor 0.4.0

Also:

• All other plugins have been disabled for this test.
• All settings are in their default values, except for Reactor's "Enable", "Upscaler" and "Scale by".

Steps to reproduce:

1. Load an image in InPaint and paint a masking area.
2. Enable the Reactor plugin and load a face.
3. Select an upscaler in Reactor, e.g. ESRGAN_4x.
4. Set Reactor's upscaler to scale by a factor greater than 1, e.g. 1.3.
5. Generate the image.

INPUT IMAGE:

REPLACEMENT FACE:

SETTINGS:

RESULT:

@Vulatera Please confirm that you are using the exact same settings and you are not getting the same issue with the attached input image & replacement face.

[Gourieff]

Confirmed!

If Upscaler is used inside ReActor, the "Whole picture" area doesn't work properly
So, if you need to upscale while using the "Whole picture" area, you'd better do it in Extras tab or via the "Script" option below (e.g. with Ultimate SD upscale)

[Kuzlata]

@h3rmit-git
With your exact same settings I can replicate this issue. The solution above works,