-
Notifications
You must be signed in to change notification settings - Fork 18
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Experimental results in paper #14
Comments
Hi, Indeed, closing the seed config will change the results. In experiments, however, this can change results so much that it is hard to select the parameters. So I fix the random seed. I am not sure if fixing random seed is common or not in DG task, but it is common in other tasks. If you want to close the seed configs, please see my updated notice which may be useful for you. Yes, I reported the results selected by val-set. You can see my training logs in the testing section. |
Dear authors, I have the same problem. I have try 3 runs and got the average result 82.50. Besides, when I test the model you released, I got the same results you reported in art, sketch, photo. But my cartoon result is 76.75, and your report is 81.61. The environment and seed are the same of yours.@Justinhzy |
@gscahhh |
Dear authors, thank you for work,
I run your implementation and got lower results than ones reported in the paper. I have some questions:
Your results reported in the paper (average ~85.15) is selected by test-set?
I got average results from your implementation:
Thank you for your contribution!
The text was updated successfully, but these errors were encountered: