Release v22.4.0 · bmaltais/kohya_ss

Fixed to work tools/convert_diffusers20_original_sd.py. Thanks to Disty0! PR #1016
The issues in multi-GPU training are fixed. Thanks to Isotr0py! PR #989 and #1000
- --ddp_gradient_as_bucket_view and --ddp_bucket_viewoptions are added to sdxl_train.py. Please specify these options for multi-GPU training.
IPEX support is updated. Thanks to Disty0!
Fixed the bug that the size of the bucket becomes less than min_bucket_reso. Thanks to Cauldrath! PR #1008
--sample_at_first option is added to each training script. This option is useful to generate images at the first step, before training. Thanks to shirayu! PR #907
--ss option is added to the sampling prompt in training. You can specify the scheduler for the sampling like --ss euler_a. Thanks to shirayu! PR #906
keep_tokens_separator is added to the dataset config. This option is useful to keep (prevent from shuffling) the tokens in the captions. See #975 for details. Thanks to Linaqruf!
- You can specify the separator with an option like --keep_tokens_separator "|||" or with keep_tokens_separator: "|||" in .toml. The tokens before ||| are not shuffled.
Attention processor hook is added. See #961 for details. Thanks to rockerBOO!
The optimizer PagedAdamW is added. Thanks to xzuyn! PR #955
NaN replacement in SDXL VAE is sped up. Thanks to liubo0902! PR #1009
Fixed the path error in finetune/make_captions.py. Thanks to CjangCjengh! PR #986

What's Changed

Full Changelog: v22.3.1...v22.4.0