Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Different default parameter values than what is mentioned in the paper. #9

Open
sharadkak opened this issue Nov 10, 2020 · 0 comments

Comments

@sharadkak
Copy link

sharadkak commented Nov 10, 2020

Hi

Thanks for the paper and code.

I noticed that a few argument values in search/src/args.py differ from what is mentioned in the paper like max_weight_decay, mul_factor.

Also if I understood it right, in the paper most plots seem to indicate that overfitting is reduced with drop_path_prob >= 0.5, yet the default value of it in code is given 0.2

The value of "factor" parameter (the threshold for eigenvalues) is also different in the paper than code.

Could you please clarify about the good/default value of all these 3 parameters as per your experiments?

Thank You!

@sharadkak sharadkak changed the title Different parameter values than what mentioned in the paper. Different default parameter values than what is mentioned in the paper. Nov 10, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant