We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
My ip adapter in controlnet does not work. In this case, the image is generated, but without an IP adapter.
Launch stable diffusion. Turn on IP adapter. Generate.
The image should have been generated using the IP adapter preprocessor and the IP adapter model.
webui: Commit hash: 67fdead6280bfe1f37c466d5279d54344c6305cf controlnet: ControlNet v1.1.455
Google Chrome
Нет
LDSR built-in None
Lora built-in None
ScuNET built-in None
SwinIR built-in None
canvas-zoom-and-pan built-in None
extra-options-section built-in None
hypertile built-in None
mobile built-in None
postprocessing-for-training built-in None
prompt-bracket-checker built-in None
soft-inpainting built-in None
TripoSR https://github.com/VAST-AI-Research/TripoSR.git main [d26e3318](https://github.com/VAST-AI- Research/TripoSR/commit/d26e33181947bbbc4c6fc0f5734e1ec6c080956e) 2024-05-14 15:24:35 unknown
a-person-mask-generator https://github.com/djbielejeski/a-person-mask-generator.git main 5590766a 2024-07-31 16:47:31 unknown
adetailer https://github.com/Bing-su/adetailer.git main 25e7509f 2024-08-03 07:20:15 unknown
canvas-zoom https://github.com/richrobber2/canvas-zoom.git main b9c3cff8 2024-08-13 15:02:30 unknown
clip-interrogator-ext https://github.com/pharmapsychotic/clip-interrogator-ext.git main 0f1a4591 2023-09-10 04:35:46 unknown
extension-style-vars https://github.com/SirVeggie/extension-style-vars master b308fbe4 2024-04-01 05:23:34 unknown
openpose-editor https://github.com/fkunn1326/openpose-editor.git master c9357715 2023-10-11 12:04:20 unknown
sd-webui-3d-open-pose-editor https://github.com/nonnonstop/sd-webui-3d-open-pose-editor.git main f2d5aac5 2023-04-15 16:21:06 unknown
sd-webui-agentattention https://github.com/v0xie/sd-webui-agentattention.git master 8c2fd24e 2024-04-22 09:35:06 unknown
sd-webui-cli-interruption https://github.com/light-and-ray/sd-webui-cli-interruption.git master 72ebefaf 2024-04-05 22:39:29 unknown
sd-webui-controlnet https://github.com/Mikubill/sd-webui-controlnet.git main 56cec5b2 2024-07-25 23:52:52 unknown
sd-webui-depth-lib https://github.com/wywywywy/sd-webui-depth-lib.git main 9fecb8df 2023-11-30 01:55:41 unknown
sd-webui-detail-daemon https://github.com/muerrilla/sd-webui-detail-daemon.git main 6e918d67 2024-07-08 01:14:47 unknown
sd-webui-extended-style-saver https://github.com/harukei-tech/sd-webui-extended-style-saver.git master 7750cc6b 2024-01-07 08:45:31 unknown
sd-webui-negpip https://github.com/hako-mikan/sd-webui-negpip.git main 3b11e54b 2024-04-01 18:02:33 unknown
sd-webui-resharpen https://github.com/Haoming02/sd-webui-resharpen.git main 4aab64fc 2024-07-09 06:31:32 unknown
stable-diffusion-webui-state https://github.com/ilian6806/stable-diffusion-webui-state.git main ce1ca3a1 2024-05-04 20:02:00 unknown
ControlNet preprocessor location: C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\annotator\downloads 2024-08-17 11:10:06,491 - ControlNet - INFO - ControlNet v1.1.455 Loading weights [879db523c3] from C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\models\Stable-diffusion\dreamshaper_8.safetensors Creating model from config: C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\configs\v1-inference.yaml 2024-08-17 11:10:07,658 - ControlNet - INFO - ControlNet UI callback registered. C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\venv\lib\site-packages\huggingface_hub\file_download.py:1150: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`. warnings.warn( Running on local URL: http://127.0.0.1:7860 To create a public link, set `share=True` in `launch()`. Startup time: 26.2s (prepare environment: 27.1s, initialize shared: 2.0s, load scripts: 2.8s, create ui: 1.2s, gradio launch: 0.8s). Applying attention optimization: sub-quadratic... done. Model loaded in 5.5s (load weights from disk: 0.2s, load config: 0.1s, create model: 1.1s, apply weights to model: 1.2s, apply float(): 0.6s, calculate empty prompt: 2.2s). Starting job task(beknahsdxy9z2qr) INFO:modules.shared_state:Starting job task(beknahsdxy9z2qr) 2024-08-17 11:11:01,068 - ControlNet - INFO - unit_separate = False, style_align = False 2024-08-17 11:11:01,248 - ControlNet - INFO - Loading model: ip-adapter-faceid-plus_sd15 [d86a490f] 2024-08-17 11:11:01,312 - ControlNet - INFO - Loaded state_dict from [C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\models\ControlNet\ip-adapter-faceid-plus_sd15.pth] 2024-08-17 11:11:01,771 - ControlNet - INFO - ControlNet model ip-adapter-faceid-plus_sd15 [d86a490f](ControlModelType.IPAdapter) loaded. 2024-08-17 11:11:01,774 - ControlNet - INFO - Using preprocessor: ip-adapter-auto 2024-08-17 11:11:01,774 - ControlNet - INFO - preprocessor resolution = 512 2024-08-17 11:11:01,775 - ControlNet - INFO - ip-adapter-auto => ip-adapter_face_id_plus download_path: C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\annotator\downloads\insightface\models\buffalo_l Downloading C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\annotator\downloads\insightface\models\buffalo_l.zip from https://github.com/deepinsight/insightface/releases/download/v0.7/buffalo_l.zip... 100%|████████████████████████████████████████████████████████████████████████| 281857/281857 [02:57<00:00, 1591.32KB/s] Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}} find model: C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\annotator\downloads\insightface\models\buffalo_l\1k3d68.onnx landmark_3d_68 ['None', 3, 192, 192] 0.0 1.0 Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}} find model: C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\annotator\downloads\insightface\models\buffalo_l\2d106det.onnx landmark_2d_106 ['None', 3, 192, 192] 0.0 1.0 Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}} find model: C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\annotator\downloads\insightface\models\buffalo_l\det_10g.onnx detection [1, 3, '?', '?'] 127.5 128.0 Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}} find model: C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\annotator\downloads\insightface\models\buffalo_l\genderage.onnx genderage ['None', 3, 96, 96] 0.0 1.0 Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}} find model: C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\annotator\downloads\insightface\models\buffalo_l\w600k_r50.onnx recognition ['None', 3, 112, 112] 127.5 127.5 set det-size: (640, 640) C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\venv\lib\site-packages\insightface\utils\transform.py:68: FutureWarning: `rcond` parameter will change to the default of machine precision times ``max(M, N)`` where M and N are the input matrix dimensions. To use the future default and silence this warning we advise to pass `rcond=None`, to keep using the old, explicitly pass `rcond=-1`. P = np.linalg.lstsq(X_homo, Y)[0].T # Affine matrix. 3 x 4 *** Error running process: C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\scripts\controlnet.py Traceback (most recent call last): File "C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\modules\scripts.py", line 825, in process script.process(p, *script_args) File "C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\scripts\controlnet.py", line 1228, in process self.controlnet_hack(p) File "C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\scripts\controlnet.py", line 1213, in controlnet_hack self.controlnet_main_entry(p) File "C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\scripts\controlnet.py", line 941, in controlnet_main_entry controls, hr_controls, additional_maps = get_control( File "C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\scripts\controlnet.py", line 290, in get_control controls, hr_controls = list(zip(*[preprocess_input_image(img) for img in optional_tqdm(input_images)])) File "C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\scripts\controlnet.py", line 290, in <listcomp> controls, hr_controls = list(zip(*[preprocess_input_image(img) for img in optional_tqdm(input_images)])) File "C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\scripts\controlnet.py", line 242, in preprocess_input_image result = preprocessor.cached_call( File "C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\scripts\supported_preprocessor.py", line 198, in cached_call result = self._cached_call(input_image, *args, **kwargs) File "C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\scripts\utils.py", line 82, in decorated_func return cached_func(*args, **kwargs) File "C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\scripts\utils.py", line 66, in cached_func return func(*args, **kwargs) File "C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\scripts\supported_preprocessor.py", line 211, in _cached_call return self(*args, **kwargs) File "C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\scripts\preprocessor\ip_adapter_auto.py", line 25, in __call__ return p(*args, **kwargs) File "C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\scripts\preprocessor\legacy\legacy_preprocessors.py", line 105, in __call__ result, is_image = self.call_function( File "C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\scripts\preprocessor\legacy\processor.py", line 769, in face_id_plus clip_embed, _ = clip(img, config='clip_h', low_vram=low_vram) File "C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\scripts\preprocessor\legacy\processor.py", line 394, in clip clip_encoder[config] = ClipVisionDetector(config, low_vram) File "C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\extensions\sd-webui-controlnet\annotator\clipvision\__init__.py", line 121, in __init__ sd = torch.load(file_path, map_location=self.device) File "C:\Users\desir\SD-2024_3\stable-diffusion-webui-amdgpu\modules\dml\hijack\torch.py", line 27, in load data[k][weight] = data[k][weight].to(device) IndexError: tensors used as indices must be long, int, byte or bool tensors --- 25%|████████████████████▊ | 5/20 [00:21<00:59, 3.94s/it]Received interrupt request████████████▊ | 5/20 [00:15<00:49, 3.30s/it] INFO:modules.shared_state:Received interrupt request 30%|████████████████████████▉ | 6/20 [00:24<00:57, 4.08s/it] Total progress: 30%|████████████████████ | 6/20 [00:19<00:46, 3.31s/it] Ending job task(beknahsdxy9z2qr) (220.79 seconds) | 6/20 [00:19<00:46, 3.34s/it] INFO:modules.shared_state:Ending job task(beknahsdxy9z2qr) (220.79 seconds)
No response #IP-Adapter.
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Is there an existing issue for this?
What happened?
My ip adapter in controlnet does not work. In this case, the image is generated, but without an IP adapter.
Steps to reproduce the problem
Launch stable diffusion.
Turn on IP adapter.
Generate.
What should have happened?
The image should have been generated using the IP adapter preprocessor and the IP adapter model.
Commit where the problem happens
webui: Commit hash: 67fdead6280bfe1f37c466d5279d54344c6305cf
controlnet: ControlNet v1.1.455
What browsers do you use to access the UI ?
Google Chrome
Command Line Arguments
List of enabled extensions
LDSR built-in None
Lora built-in None
ScuNET built-in None
SwinIR built-in None
canvas-zoom-and-pan built-in None
extra-options-section built-in None
hypertile built-in None
mobile built-in None
postprocessing-for-training built-in None
prompt-bracket-checker built-in None
soft-inpainting built-in None
TripoSR https://github.com/VAST-AI-Research/TripoSR.git main [d26e3318](https://github.com/VAST-AI-
Research/TripoSR/commit/d26e33181947bbbc4c6fc0f5734e1ec6c080956e) 2024-05-14 15:24:35 unknown
a-person-mask-generator https://github.com/djbielejeski/a-person-mask-generator.git main 5590766a 2024-07-31 16:47:31 unknown
adetailer https://github.com/Bing-su/adetailer.git main 25e7509f 2024-08-03 07:20:15 unknown
canvas-zoom https://github.com/richrobber2/canvas-zoom.git main b9c3cff8 2024-08-13 15:02:30 unknown
clip-interrogator-ext https://github.com/pharmapsychotic/clip-interrogator-ext.git main 0f1a4591 2023-09-10 04:35:46 unknown
extension-style-vars https://github.com/SirVeggie/extension-style-vars master b308fbe4 2024-04-01 05:23:34 unknown
openpose-editor https://github.com/fkunn1326/openpose-editor.git master c9357715 2023-10-11 12:04:20 unknown
sd-webui-3d-open-pose-editor https://github.com/nonnonstop/sd-webui-3d-open-pose-editor.git main f2d5aac5 2023-04-15 16:21:06 unknown
sd-webui-agentattention https://github.com/v0xie/sd-webui-agentattention.git master 8c2fd24e 2024-04-22 09:35:06 unknown
sd-webui-cli-interruption https://github.com/light-and-ray/sd-webui-cli-interruption.git master 72ebefaf 2024-04-05 22:39:29 unknown
sd-webui-controlnet https://github.com/Mikubill/sd-webui-controlnet.git main 56cec5b2 2024-07-25 23:52:52 unknown
sd-webui-depth-lib https://github.com/wywywywy/sd-webui-depth-lib.git main 9fecb8df 2023-11-30 01:55:41 unknown
sd-webui-detail-daemon https://github.com/muerrilla/sd-webui-detail-daemon.git main 6e918d67 2024-07-08 01:14:47 unknown
sd-webui-extended-style-saver https://github.com/harukei-tech/sd-webui-extended-style-saver.git master 7750cc6b 2024-01-07 08:45:31 unknown
sd-webui-negpip https://github.com/hako-mikan/sd-webui-negpip.git main 3b11e54b 2024-04-01 18:02:33 unknown
sd-webui-resharpen https://github.com/Haoming02/sd-webui-resharpen.git main 4aab64fc 2024-07-09 06:31:32 unknown
stable-diffusion-webui-state https://github.com/ilian6806/stable-diffusion-webui-state.git main ce1ca3a1 2024-05-04 20:02:00 unknown
Console logs
Additional information
No response
#IP-Adapter.
The text was updated successfully, but these errors were encountered: