Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

re-trained model cannot get the IS score as the thesis provides #9

Open
lovelychao opened this issue Dec 27, 2019 · 9 comments
Open

Comments

@lovelychao
Copy link

hello, I retrained the model as your thesis say, but the best IS score I get is only 3.89, is there any trick in training the model? or can you provide your model?

@MartinPernus
Copy link

MartinPernus commented Jul 15, 2020

Same problem here, following the instructions, the final inception score on CUB is only 4.00

EDIT: By evaluating many trained models, one of them achieved IS of 4.26. I would be grateful if anyone has tips/tricks for improving this.

@Kerry-zzx
Copy link

there is no pretrained model!

@WhereISmyroad
Copy link

Hello sir
I can train MirrorGAN by myself, but I need (image caption/text encoder) pretrained model( coco/CUB), too. The model (text encode/image caption)provided by K, I get 4.41 (batch size=12, batch num:3 , G&D LR:0.002)...
I just want to do a comparative experiment, Can anyone help me?

@YangShengLiQQ
Copy link

Hello sir
I can train MirrorGAN by myself, but I need (image caption/text encoder) pretrained model( coco/CUB), too. The model (text encode/image caption)provided by K, I get 4.41 (batch size=12, batch num:3 , G&D LR:0.002)...
I just want to do a comparative experiment, Can anyone help me?

Hello @WhereISmyroad
how did you get 4.41?
is your code of inception score from
https://github.com/hanzhanggit/StackGAN-inception-model ?

@WhereISmyroad
Copy link

Hello sir
I can train MirrorGAN by myself, but I need (image caption/text encoder) pretrained model( coco/CUB), too. The model (text encode/image caption)provided by K, I get 4.41 (batch size=12, batch num:3 , G&D LR:0.002)...
I just want to do a comparative experiment, Can anyone help me?

Hello @WhereISmyroad
how did you get 4.41?
is your code of inception score from
https://github.com/hanzhanggit/StackGAN-inception-model ?

Yes, you are the same problem?

@YangShengLiQQ
Copy link

@WhereISmyroad Yes, I only got 4.0 at epoch 250, and 3.7 at epoch 650.
I guess my code of inception score is wrong, because I use netG provided by author to generate about 29000 images. Then I
use the code to evaluate them, but the score I got is only 2.5
Did you use the config file provided by author?
How many epochs do you train?
Could you share your config file with me?
Thanks!

@WhereISmyroad
Copy link

@WhereISmyroad Yes, I only got 4.0 at epoch 250, and 3.7 at epoch 650.
I guess my code of inception score is wrong, because I use netG provided by author to generate about 29000 images. Then I
use the code to evaluate them, but the score I got is only 2.5
Did you use the config file provided by author?
How many epochs do you train?
Could you share your config file with me?
Thanks!

I use the config file provided by this project, epoch=600
How you get the pretrained model? Its author didn't provide it

@YangShengLiQQ
Copy link

@WhereISmyroad Yes, I only got 4.0 at epoch 250, and 3.7 at epoch 650.
I guess my code of inception score is wrong, because I use netG provided by author to generate about 29000 images. Then I
use the code to evaluate them, but the score I got is only 2.5
Did you use the config file provided by author?
How many epochs do you train?
Could you share your config file with me?
Thanks!

I use the config file provided by this project, epoch=600
How you get the pretrained model? Its author didn't provide it

The path of netG is \data\output\bird\Model, where the data is provided by author.
https://drive.google.com/file/d/1CuW5ognTSkNbyx9TWoUFrgwqxZNk1cl0/view
I don't know if it is pretrained model, because the score is only 2.5.

@WhereISmyroad
Copy link

@WhereISmyroad Yes, I only got 4.0 at epoch 250, and 3.7 at epoch 650.
I guess my code of inception score is wrong, because I use netG provided by author to generate about 29000 images. Then I
use the code to evaluate them, but the score I got is only 2.5
Did you use the config file provided by author?
How many epochs do you train?
Could you share your config file with me?
Thanks!

I use the config file provided by this project, epoch=600
How you get the pretrained model? Its author didn't provide it

The path of netG is \data\output\bird\Model, where the data is provided by author.
https://drive.google.com/file/d/1CuW5ognTSkNbyx9TWoUFrgwqxZNk1cl0/view
I don't know if it is pretrained model, because the score is only 2.5.

I am not testing it yet, but I thank there is no problem with the IS Score code
Do you have STREAM coco pretrained model? I train it by myself but get a bad score......

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants