Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about apex #1

Open
ziyuwwang opened this issue Jun 25, 2021 · 3 comments
Open

Question about apex #1

ziyuwwang opened this issue Jun 25, 2021 · 3 comments

Comments

@ziyuwwang
Copy link

Hello ! Thanks for releasing the code ! While "--apex-amp" is included in the training command, "apex" is not mentioned in requirements. So I wonder whether the "apex amp" is used in your experiments. Besides, I would be grateful if you provide the training log in 8 V100 for me to check the correctness of my reproduction.

@houqb
Copy link
Owner

houqb commented Jun 26, 2021

Thanks for your comments. This is really important. As you suggested, I will release the training log soon.

@ziyuwwang
Copy link
Author

Thanks. And do you use "apex amp" in your experiments?

@houqb
Copy link
Owner

houqb commented Jun 28, 2021

I do use, but it depends on your hardware. Sometimes, apex amp works better in terms of training efficiency.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants