Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

v21.8.6 #1332

Merged
merged 70 commits into from
Aug 5, 2023
Merged

v21.8.6 #1332

merged 70 commits into from
Aug 5, 2023

Commits on Jul 17, 2023

  1. vram leak fix

    @pamparamm
    pamparamm committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    8a073ee View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2023

  1. Support for bitsandbytes 0.39.1 with Paged Optimizer(AdamW8bit and Li… 

    …on8bit) (#631)

* ADD libbitsandbytes.dll for 0.38.1

* Delete libbitsandbytes_cuda116.dll

* Delete cextension.py

* add main.py

* Update requirements.txt for bitsandbytes 0.38.1

* Update README.md for bitsandbytes-windows

* Update README-ja.md  for bitsandbytes 0.38.1

* Update main.py for return cuda118

* Update train_util.py for lion8bit

* Update train_README-ja.md for lion8bit

* Update train_util.py for add DAdaptAdan and DAdaptSGD

* Update train_util.py for DAdaptadam

* Update train_network.py for dadapt

* Update train_README-ja.md for DAdapt

* Update train_util.py for DAdapt

* Update train_network.py for DAdaptAdaGrad

* Update train_db.py for DAdapt

* Update fine_tune.py for DAdapt

* Update train_textual_inversion.py for DAdapt

* Update train_textual_inversion_XTI.py for DAdapt

* Revert "Merge branch 'qinglong' into main"

This reverts commit b65c023083d6d1e8a30eb42eddd603d1aac97650, reversing
changes made to f6fda20caf5e773d56bcfb5c4575c650bb85362b.

* Revert "Update requirements.txt for bitsandbytes 0.38.1"

This reverts commit 83abc60dfaddb26845f54228425b98dd67997528.

* Revert "Delete cextension.py"

This reverts commit 3ba4dfe046874393f2a022a4cbef3628ada35391.

* Revert "Update README.md for bitsandbytes-windows"

This reverts commit 4642c52086b5e9791233007e2fdfd97f832cd897.

* Revert "Update README-ja.md  for bitsandbytes 0.38.1"

This reverts commit fa6d7485ac067ebc49e6f381afdb8dd2f12caa8f.

* Update train_util.py

* Update requirements.txt

* support PagedAdamW8bit/PagedLion8bit

* Update requirements.txt

* update for PageAdamW8bit and PagedLion8bit

* Revert

* revert main
    @sdbds
    sdbds committed Jul 22, 2023
    Configuration menu
    Copy the full SHA
    d131bde View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2023

  1. init unet with empty weights

    @Isotr0py
    Isotr0py committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    bb167f9 View commit details
    Browse the repository at this point in the history

  2. fix safetensors error: device invalid

    @Isotr0py
    Isotr0py committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    eec6aad View commit details
    Browse the repository at this point in the history

  3. Merge branch 'dev' of https://github.com/kohya-ss/sd-scripts into sdx… 

    …l-dev
    @bmaltais
    bmaltais committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    4849ea8 View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2023

  1. Fix finetuner gui code issues

    @bmaltais
    bmaltais committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    fcf087c View commit details
    Browse the repository at this point in the history

  2. format by black

    @kohya-ss
    kohya-ss committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    e83ee21 View commit details
    Browse the repository at this point in the history

  3. support sdxl

    @kohya-ss
    kohya-ss committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    2b969e9 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'sdxl' of https://github.com/kohya-ss/sd-scripts into sd… 

    …xl-dev
    @bmaltais
    bmaltais committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    12f7ca8 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2023

  1. remove unused func

    @kohya-ss
    kohya-ss committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    b78c0e2 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'sdxl' of https://github.com/kohya-ss/sd-scripts into sd… 

    …xl-dev
    @bmaltais
    bmaltais committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    101d263 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2023

  1. Update extract LoRA and add sdpa

    @bmaltais
    bmaltais committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    a9ec90c View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2023

  1. increased max norms to 10

    @M4X1K02
    M4X1K02 committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    334a551 View commit details
    Browse the repository at this point in the history

  2. appended relevant infor to info text

    @M4X1K02
    M4X1K02 committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    32aaa40 View commit details
    Browse the repository at this point in the history

  3. fix pipeline dtype

    @Isotr0py
    Isotr0py committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    50544b7 View commit details
    Browse the repository at this point in the history

  4. add dtype to u-net loading

    @Isotr0py
    Isotr0py committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    96a52d9 View commit details
    Browse the repository at this point in the history

Commits on Jul 28, 2023

  1. Merge pull request #1272 from M4X1K02/max_norm_adjust 

    Max norm adjust
    @bmaltais
    bmaltais committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    a6a66dd View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into dev2

    @bmaltais
    bmaltais committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    7de217a View commit details
    Browse the repository at this point in the history

  3. Merge branch 'dev2' into sdxl-dev

    @bmaltais
    bmaltais committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    f4941ca View commit details
    Browse the repository at this point in the history

  4. Merge branch 'sdxl' into sdxl

    @Isotr0py
    Isotr0py committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    272dd99 View commit details
    Browse the repository at this point in the history

  5. Update README.md

    @Noyii
    Noyii committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    4a1b92d View commit details
    Browse the repository at this point in the history

  6. refactor model loading to catch error

    @Isotr0py
    Isotr0py committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    315fbc1 View commit details
    Browse the repository at this point in the history

  7. fix mismatch dtype

    @Isotr0py
    Isotr0py committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    fdb58b0 View commit details
    Browse the repository at this point in the history

  8. fix typo

    @Isotr0py
    Isotr0py committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    1199eac View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2023

  1. Merge branch 'main' into dev

    @kohya-ss
    kohya-ss committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    38b59a9 View commit details
    Browse the repository at this point in the history

  2. Merge pull request #693 from kohya-ss/dev 

    Support for bitsandbytes 0.39.1 with Paged Optimizer
    @kohya-ss
    kohya-ss committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    3a7326a View commit details
    Browse the repository at this point in the history

  3. support ckpt without position id in sd v1 #687

    @kohya-ss
    kohya-ss committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    1e4512b View commit details
    Browse the repository at this point in the history

  4. Merge pull request #694 from kohya-ss/dev 

    support ckpt without position id in sd v1 #687
    @kohya-ss
    kohya-ss committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    fb1054b View commit details
    Browse the repository at this point in the history

  5. Merge pull request #688 from Noyii/main 

    fix typo
    @kohya-ss
    kohya-ss committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    cf80210 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into sdxl

    @kohya-ss
    kohya-ss committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    4072f72 View commit details
    Browse the repository at this point in the history

  7. fix typos for _load_state_dict

    @Isotr0py
    Isotr0py committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    d9180c0 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'sdxl' of https://github.com/kohya-ss/sd-scripts into dev2

    @bmaltais
    bmaltais committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    814191b View commit details
    Browse the repository at this point in the history

  9. Merge branch 'sdxl-dev' into dev2

    @bmaltais
    bmaltais committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    6f6bf88 View commit details
    Browse the repository at this point in the history

  10. Updated to bitsandbytes version for linux and windows

    @bmaltais
    bmaltais committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    c55606e View commit details
    Browse the repository at this point in the history

  11. Allow DB training on SDXL models.

    @bmaltais
    bmaltais committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    72f9fdc View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2023

  1. Merge pull request #676 from Isotr0py/sdxl 

    Fix RAM leak when loading SDXL model in lowram device
    @kohya-ss
    kohya-ss committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    e20b6ac View commit details
    Browse the repository at this point in the history

  2. Add Paged/ adam8bit/lion8bit for Sdxl bitsandbytes 0.39.1 cuda118 on … 

    …windows (#623)

* ADD libbitsandbytes.dll for 0.38.1

* Delete libbitsandbytes_cuda116.dll

* Delete cextension.py

* add main.py

* Update requirements.txt for bitsandbytes 0.38.1

* Update README.md for bitsandbytes-windows

* Update README-ja.md  for bitsandbytes 0.38.1

* Update main.py for return cuda118

* Update train_util.py for lion8bit

* Update train_README-ja.md for lion8bit

* Update train_util.py for add DAdaptAdan and DAdaptSGD

* Update train_util.py for DAdaptadam

* Update train_network.py for dadapt

* Update train_README-ja.md for DAdapt

* Update train_util.py for DAdapt

* Update train_network.py for DAdaptAdaGrad

* Update train_db.py for DAdapt

* Update fine_tune.py for DAdapt

* Update train_textual_inversion.py for DAdapt

* Update train_textual_inversion_XTI.py for DAdapt

* Revert "Merge branch 'qinglong' into main"

This reverts commit b65c023083d6d1e8a30eb42eddd603d1aac97650, reversing
changes made to f6fda20caf5e773d56bcfb5c4575c650bb85362b.

* Revert "Update requirements.txt for bitsandbytes 0.38.1"

This reverts commit 83abc60dfaddb26845f54228425b98dd67997528.

* Revert "Delete cextension.py"

This reverts commit 3ba4dfe046874393f2a022a4cbef3628ada35391.

* Revert "Update README.md for bitsandbytes-windows"

This reverts commit 4642c52086b5e9791233007e2fdfd97f832cd897.

* Revert "Update README-ja.md  for bitsandbytes 0.38.1"

This reverts commit fa6d7485ac067ebc49e6f381afdb8dd2f12caa8f.

* Update train_util.py for DAdaptLion

* Update train_README-zh.md for dadaptlion

* Update train_README-ja.md for DAdaptLion

* add DAdatpt V3

* Alignment

* Update train_util.py for experimental

* Update train_util.py V3

* Update train_util.py

* Update requirements.txt

* Update train_README-zh.md

* Update train_README-ja.md

* Update train_util.py fix

* Update train_util.py

* support Prodigy

* add lower

* Update main.py

* support PagedAdamW8bit/PagedLion8bit

* Update requirements.txt

* update for PageAdamW8bit and PagedLion8bit

* Revert

* revert main

* Update train_util.py

* update for bitsandbytes 0.39.1

* Update requirements.txt

* vram leak fix

---------

Co-authored-by: Pam <[email protected]>
    @sdbds @pamparamm
    sdbds and pamparamm committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    9ec7025 View commit details
    Browse the repository at this point in the history

  3. Merge pull request #658 from pamparamm/cache_latents_leak_fix 

    Cache latents VRAM leak fix
    @kohya-ss
    kohya-ss committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    54a4aa2 View commit details
    Browse the repository at this point in the history

  4. move releasing cache outside of the loop

    @kohya-ss
    kohya-ss committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    e6034b7 View commit details
    Browse the repository at this point in the history

  5. change method name, add comments

    @kohya-ss
    kohya-ss committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    b62185b View commit details
    Browse the repository at this point in the history

  6. refactor optimizer selection for bnb

    @kohya-ss
    kohya-ss committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    a296654 View commit details
    Browse the repository at this point in the history

  7. format by black

    @kohya-ss
    kohya-ss committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    2a4ae88 View commit details
    Browse the repository at this point in the history

  8. fix ControlNet not working

    @kohya-ss
    kohya-ss committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    0eacadf View commit details
    Browse the repository at this point in the history

  9. fix batch generation not working

    @kohya-ss
    kohya-ss committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    8856c19 View commit details
    Browse the repository at this point in the history

  10. arbitrary args for diffusers lr scheduler

    @kohya-ss
    kohya-ss committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    496c3f2 View commit details
    Browse the repository at this point in the history

  11. remove dependency for albumenations

    @kohya-ss
    kohya-ss committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    f61996b View commit details
    Browse the repository at this point in the history

  12. fix recorded seed in highres fix

    @kohya-ss
    kohya-ss committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    7e474d2 View commit details
    Browse the repository at this point in the history

  13. add adding v-pred like loss for noise pred

    @kohya-ss
    kohya-ss committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    0636399 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2023

  1. fix vae crashes in large reso

    @kohya-ss
    kohya-ss committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    89aae3e View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2023

  1. Update requirements and others

    @bmaltais
    bmaltais committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    ebcb6ef View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2023

  1. format by black

    @kohya-ss
    kohya-ss committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    db80c5a View commit details
    Browse the repository at this point in the history

  2. fix ControlNet with regional LoRA, add shuffle cap

    @kohya-ss
    kohya-ss committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    6b1cf6c View commit details
    Browse the repository at this point in the history

  3. fix ControlNet with regional LoRA

    @kohya-ss
    kohya-ss committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    cf68328 View commit details
    Browse the repository at this point in the history

  4. Add workaround for clip's bug for pooled output

    @kohya-ss
    kohya-ss committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    c6d52fd View commit details
    Browse the repository at this point in the history

  5. remove debug print

    @kohya-ss
    kohya-ss committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    9d7619d View commit details
    Browse the repository at this point in the history

  6. remove debug print

    @kohya-ss
    kohya-ss committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    f3be995 View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2023

  1. make bitsandbytes optional

    @kohya-ss
    kohya-ss committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    9d85509 View commit details
    Browse the repository at this point in the history

  2. Merge pull request #714 from kohya-ss/dev 

    pool output fix, v_pred loss like etc.
    @kohya-ss
    kohya-ss committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    f4935dd View commit details
    Browse the repository at this point in the history

  3. Updates

    @bmaltais
    bmaltais committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    78bae16 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'sdxl' of https://github.com/kohya-ss/sd-scripts into dev2

    @bmaltais
    bmaltais committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    90d2160 View commit details
    Browse the repository at this point in the history

  5. Update release

    @bmaltais
    bmaltais committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    8b46fe3 View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2023

  1. fix sdxl_gen_img not working

    @kohya-ss
    kohya-ss committed Aug 5, 2023
    Configuration menu
    Copy the full SHA
    25d8cd4 View commit details
    Browse the repository at this point in the history

  2. Merge pull request #716 from kohya-ss/dev 

    fix sdxl_gen_img not working
    @kohya-ss
    kohya-ss committed Aug 5, 2023
    Configuration menu
    Copy the full SHA
    2dfa26c View commit details
    Browse the repository at this point in the history

  3. Merge branch 'sdxl' of https://github.com/kohya-ss/sd-scripts into dev2

    @bmaltais
    bmaltais committed Aug 5, 2023
    Configuration menu
    Copy the full SHA
    7c55ca3 View commit details
    Browse the repository at this point in the history

  4. fix training textencoder in sdxl not working

    @kohya-ss
    kohya-ss committed Aug 5, 2023
    Configuration menu
    Copy the full SHA
    e5f9772 View commit details
    Browse the repository at this point in the history

  5. Merge pull request #720 from kohya-ss/dev 

    fix training textencoder in sdxl not working
    @kohya-ss
    kohya-ss committed Aug 5, 2023
    Configuration menu
    Copy the full SHA
    cd54af0 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'sdxl' of https://github.com/kohya-ss/sd-scripts into dev2

    @bmaltais
    bmaltais committed Aug 5, 2023
    Configuration menu
    Copy the full SHA
    08eb3ad View commit details
    Browse the repository at this point in the history

  7. Updates

    @bmaltais
    bmaltais committed Aug 5, 2023
    Configuration menu
    Copy the full SHA
    3e64386 View commit details
    Browse the repository at this point in the history

  8. Update presets

    @bmaltais
    bmaltais committed Aug 5, 2023
    Configuration menu
    Copy the full SHA
    5eef71e View commit details
    Browse the repository at this point in the history

  9. Update readme

    @bmaltais
    bmaltais committed Aug 5, 2023
    Configuration menu
    Copy the full SHA
    5042975 View commit details
    Browse the repository at this point in the history