Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support HunyuanDiT finetuning all parameters #6

Merged
merged 1 commit into from
Jun 30, 2024

Conversation

Jarvis73
Copy link

An initial version of HunyuanDiT funetuning scripts. Only support save as ckpt.

The scripts support HunyuanDiT v1.1 and v1.2(default).

Differences between v1.1 and v1.2:

  • V1.1 uses a noise schedule of scaled_linear(0.00085, 0.03), while v1.2 uses scaled_linear(0.00085, 0.018).
  • V1.1 must enable --use_extra_cond for using image size condition and style condition, while v1.2 doesn't rely them any more (the PR's default behaviour).

Both versions must enable v_parameterization for training.

In a word, finetuning HunyuanDiT requires following arguments:

# Version 1.1
--use_extra_cond --beta_end 0.03 --v_parameterization --save_model_as ckpt

# Version 1.2
--v_parameterization --save_model_as ckpt

Finetuning CLIP and mT5 text encoder is not yet supported.

@KohakuBlueleaf KohakuBlueleaf merged commit 4141c7a into KohakuBlueleaf:HunYuanDiT Jun 30, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants