[enhancement]: need to support fp8

[licyk]

Is there an existing issue for this?

• I have searched the existing issues

Contact Details

[email protected]

What should this feature add?

Need to support fp8 to reduce vram usage.

My graphics card is 4060 8GB. When I use the SDXL model and controlnet openpose in invokeai, I encounter a "torch.cuda.OutOfMemoryError" error.

However, in the stable diffusion webui, I can reduce the video memory usage by enabling fp8, and using the SDXL model and controlnet openpose, so I can generate images normally without any "torch.cuda.OutOfMemoryError" issues.

Alternatives

No response

Additional Content

No response

[licyk]

This is the fp8 implementation in stable diffusion webui: AUTOMATIC1111/stable-diffusion-webui#14031