conversion can fail at ControlNet on machines with 16GB of system memory #369
Labels
model/diffusion
pipeline/controlnet
scope/convert
status/fixed
issues that have been fixed and released
Milestone
Converting models on a system with 16GB of system memory, without the onnx-fp16 or torch-fp16 optimizations, can lead to an out of memory error:
This appears to be related to the ControlNet conversion, which makes some sense, because that is effectively a copy of the UNet and the UNet is already the largest model. However, @HoopyFreud reports this was not happening on the previous conversion method, so it may also be related to #337
I have not documented the minimum specs yet, but would like to support 4c/16GB machines with 4GB of VRAM.
The text was updated successfully, but these errors were encountered: