Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to replicate the results with the pretrained model #52

Open
mohitiitb opened this issue Oct 12, 2020 · 1 comment
Open

Unable to replicate the results with the pretrained model #52

mohitiitb opened this issue Oct 12, 2020 · 1 comment

Comments

@mohitiitb
Copy link

Hi @anewell,

The evaluation of the pre-trained model is not producing the expected results.
The mAP results for the single and multi-scale settings on the pretrained model are 0.107 and 0.154, which is far less than the expected output of 0.59 and 0.66.
The mAP evaluation for a model trained from scratch(for 100 epochs with batch-size 8) is similarly producing poor results, mAP score of 0.137 on the multi-scale evaluation setting.

Thanks!

PS: Adding Arjun and Rishabh to the thread. @stencilman @rishabhdabral

@MehwishG
Copy link

MehwishG commented Oct 23, 2020

Hi
I am also facing the same issue. I have tested the pretrained network on coco 2017 dataset. It's not giving results as reported in paper.
Did you solve it?
please reply @mohitiitb

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants