Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can not reproduce results on VOC dataset after base training. #41

Open
Jaraxxus-Me opened this issue Jun 10, 2021 · 5 comments
Open

Can not reproduce results on VOC dataset after base training. #41

Jaraxxus-Me opened this issue Jun 10, 2021 · 5 comments

Comments

@Jaraxxus-Me
Copy link

Hi, thanks for your work.
I tried to reproduce the results on VOC2007 test dataset, but got confused.
First, I tried to finetune the model provided, which is base trained. I got similar results as reported.
Second, I tried to train from base stage to fine tune stage and I got much worse results, mAP nearly 0. I tried 3 times parallel training, none of the attempt worked well. (first split) All steps were following the README file.
Can you help explain this problem? Thanks.

@hanhao2019102935
Copy link

@Jaraxxus-Me Can you tell me set?how you built this VOC data ?I am also very surprised that this question arises.

@Jaraxxus-Me
Copy link
Author

Hi, thanks so much for your response.
About VOC dataset, I downloaded from this mirror web since the official one seems to be down. Then just follow your instruction in the README file.
I've carefully inspected this problem today. I tried to continue train both your provided model and my self-trained model in the first stage (see attached figures). The loss of your model seems to be much lower (0.3) than mine (1.5), and my meta loss seems to remain 0.1806.
Then I re-implemented my experiment again from the beginning. Found that the loss seems to remain around 1.5 since the forth epoch. Even more wired is that, the meta loss in all 3 splits seem to remain 0.1806 after several epochs (higher than yours).
I'm still stuck on this problem.
Can you offer me some advice maybe?
Thanks.
training_provided_model
training_self-trained_model

@Jaraxxus-Me
Copy link
Author

Besides, I randomly got this situation, which continues to confuse me. I have to try several times before getting
Screenshot from 2021-06-11 20-18-18
it normal. I didn't modify your code. After building up the dataset, I simply ran the .sh files.

@qindengda
Copy link

Hi, thanks so much for your response.
About VOC dataset, I downloaded from this mirror web since the official one seems to be down. Then just follow your instruction in the README file.
I've carefully inspected this problem today. I tried to continue train both your provided model and my self-trained model in the first stage (see attached figures). The loss of your model seems to be much lower (0.3) than mine (1.5), and my meta loss seems to remain 0.1806.
Then I re-implemented my experiment again from the beginning. Found that the loss seems to remain around 1.5 since the forth epoch. Even more wired is that, the meta loss in all 3 splits seem to remain 0.1806 after several epochs (higher than yours).
I'm still stuck on this problem.
Can you offer me some advice maybe?
Thanks.
training_provided_model
training_self-trained_model

Hi,have you solved the problem? I have the same problems as you.

@Jaraxxus-Me
Copy link
Author

Hi, thanks so much for your response.
About VOC dataset, I downloaded from this mirror web since the official one seems to be down. Then just follow your instruction in the README file.
I've carefully inspected this problem today. I tried to continue train both your provided model and my self-trained model in the first stage (see attached figures). The loss of your model seems to be much lower (0.3) than mine (1.5), and my meta loss seems to remain 0.1806.
Then I re-implemented my experiment again from the beginning. Found that the loss seems to remain around 1.5 since the forth epoch. Even more wired is that, the meta loss in all 3 splits seem to remain 0.1806 after several epochs (higher than yours).
I'm still stuck on this problem.
Can you offer me some advice maybe?
Thanks.
training_provided_model
training_self-trained_model

Hi,have you solved the problem? I have the same problems as you.

Unfortunately not, I still don't know why and have to find another code base for my project..

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants