Skip to content

v21.5.10

Compare
Choose a tag to compare
@bmaltais bmaltais released this 09 May 19:08
· 1644 commits to master since this release
feb6728

Make sure to re-run .\setup.bat after pulling this release.

  • 2023/04/07 (v21.5.10)
    • Fix issue #734
    • The documentation has been moved to the docs folder. If you have links, please change them.
    • DAdaptAdaGrad, DAdaptAdan, and DAdaptSGD are now supported by DAdaptation. PR#455 Thanks to sdbds!
      • DAdaptation needs to be installed. Also, depending on the optimizer, DAdaptation may need to be updated. Please update with pip install --upgrade dadaptation.
    • Added support for pre-calculation of LoRA weights in image generation scripts. Specify --network_pre_calc.
      • The prompt option --am is available. Also, it is disabled when Regional LoRA is used.
    • Added Adaptive noise scale to each training script. Specify a number with --adaptive_noise_scale to enable it.
      • Experimental option. It may be removed or changed in the future.
      • This is an original implementation that automatically adjusts the value of the noise offset according to the absolute value of the mean of each channel of the latents. It is expected that appropriate noise offsets will be set for bright and dark images, respectively.
      • Specify it together with --noise_offset.
      • The actual value of the noise offset is calculated as noise_offset + abs(mean(latents, dim=(2,3))) * adaptive_noise_scale. Since the latent is close to a normal distribution, it may be a good idea to specify a value of about 1/10 to the same as the noise offset.
      • Negative values can also be specified, in which case the noise offset will be clipped to 0 or more.
    • Other minor fixes.