Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

double --caption_dropout_every_n_epochs="3" #554

Closed
g558800 opened this issue Apr 6, 2023 · 4 comments
Closed

double --caption_dropout_every_n_epochs="3" #554

g558800 opened this issue Apr 6, 2023 · 4 comments
Labels
bug Something isn't working

Comments

@g558800
Copy link

g558800 commented Apr 6, 2023

Why do I print training command, it looks like this:
accelerate launch --num_cpu_threads_per_process=2 "train_network.py" --enable_bucket --pretrained_model_name_or_path="/root/autodl_tmp/chilloutmix_NiPrunedFp32Fix.safetensors" --train_data_dir="/root/autodl-tmp/train_output/img" --resolution=768,768 --output_dir="/root/autodl-tmp/train_output/model" --logging_dir="/root/autodl-tmp/train_output/log" --network_alpha="80" --save_model_as=safetensors --network_module=lycoris.kohya --network_args "conv_dim=1" "conv_alpha=1" "algo=lora" --text_encoder_lr=0.00005 --unet_lr=0.00001 --network_dim=160 --gradient_accumulation_steps=4 --output_name="wengmeiling_girl" --lr_scheduler_num_cycles="18" --learning_rate="0.000001" --lr_scheduler="constant_with_warmup" --lr_warmup_steps="1228" --train_batch_size="4" --max_train_steps="12285" --save_every_n_epochs="1" --mixed_precision="fp16" --save_precision="fp16" --cache_latents --optimizer_type="AdamW" --max_data_loader_n_workers="6" --caption_dropout_every_n_epochs="3" --caption_dropout_every_n_epochs="3" --bucket_reso_steps=64 --shuffle_caption --xformers --bucket_no_upscale --noise_offset=0.1

double "--caption_dropout_every_n_epochs="3" ".There is no parameter for 'Rate of caption dropout'.

@bmaltais
Copy link
Owner

bmaltais commented Apr 6, 2023

This look like a bug... I will look into it once electricity is back. Currently going through the result of an ice storm around my place.

@bmaltais bmaltais added the bug Something isn't working label Apr 6, 2023
@g558800
Copy link
Author

g558800 commented Apr 7, 2023

ok,thank you!

@bmaltais
Copy link
Owner

bmaltais commented Apr 7, 2023

OK... this was caused by an entry that was supposed to handle the caption_dropout_rate. This will actually enable proper caption_dropout_rate during training... before it was just not used... doh.

@bmaltais
Copy link
Owner

bmaltais commented Apr 7, 2023

Fixed via: 1f15362

@bmaltais bmaltais closed this as completed Apr 7, 2023
@bmaltais bmaltais mentioned this issue Apr 9, 2023
bmaltais pushed a commit that referenced this issue Jun 2, 2023
* Update train_network.py

* Update train_network.py

* Update train_network.py

* Update train_network.py

* Update train_network.py

* Update train_network.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants