Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Using the pretrained model get AUC=80.1310% on ped2 #26

Open
AndersonZhangyq opened this issue Sep 16, 2021 · 3 comments
Open

Using the pretrained model get AUC=80.1310% on ped2 #26

AndersonZhangyq opened this issue Sep 16, 2021 · 3 comments

Comments

@AndersonZhangyq
Copy link

I used the provided pretrained model, but got AUC=80.1310% on ped2, which is much lower than the AUC reported in the paper(Ours w DPU: 96.9)
I moved the pretrained model (i.e., ped2_model_1000.pth) to folder exp/ped2/log/, and run the command as

python Test.py --model_dir /home/zyq/code/MPN/exp/ped2/log/ped2_model_1000.pth

Is there anything wrong with my procedure? How can I reproduce the result reported in the paper?

@abhishekaich27
Copy link

I observed similar issue for Shanghai-Tech as well. Although I trained the model by myself.

@devashishlohani
Copy link

devashishlohani commented Oct 27, 2021

I also got the AUC=80.13% with the pre-trained model on Ped2 dataset in the unsupervised setting (Test.py).
However, after training the model on Ped2, I retested after 1000 epochs.
The result is 96.13%.
Note, I used alpha (weight for feature anomaly score) as 0.6. Hope it helps!

@1449362433
Copy link

How do you reproduce it?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants