Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Calculating weights for Gradient Blending for new datasets #133

Open
AntiLibrary5 opened this issue Jul 28, 2021 · 1 comment
Open

Calculating weights for Gradient Blending for new datasets #133

AntiLibrary5 opened this issue Jul 28, 2021 · 1 comment

Comments

@AntiLibrary5
Copy link

Hi,
Are there any additional resources about calculating the normalizing constants for the blending weights from a practical implementation point of view apart from the literature (what makes training multi-modal classification networks hard?).

The weights for the datasets used are given : https://github.com/facebookresearch/VMZ/blob/master/c2/tutorials/gradient_blending.md
But I couldn't find any code where their calculation is implemented.

But more importantly how to find them for a new dataset? The proof of the proposition for gradient blending is not helpful in this regard. Also going through the repo, they are considered an argument:

return model_builder.build_model(

in the "add_weighted_loss()" method and I couldn't find any helper functions which might have been used to calculate them.

Thank you for your response.

@jc5201
Copy link

jc5201 commented Dec 29, 2022

Any changes here?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants