Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AutoMetaCal performance #49

Open
andrevitorelli opened this issue May 3, 2022 · 0 comments
Open

AutoMetaCal performance #49

andrevitorelli opened this issue May 3, 2022 · 0 comments
Assignees
Labels
bug Something isn't working investigation Issues related to investigating a given question testing

Comments

@andrevitorelli
Copy link
Member

andrevitorelli commented May 3, 2022

Currently, amc handles 100k galaxies in 10min in a single Titan Xp.*
This is about the same ngmix takes with a 2x Xeon Silver 4214 (using 48 threads) setup w/ 125GiB RAM.*

However, the Addons>ResamplerGrad conversion to a tf graph returns the warning:
WARNING:tensorflow:Using a while_loop for converting Addons>ResamplerGrad

...which I think might be affecting performance greatly. This issue is to ask @Dr-Zero to look into this.

This is also where I will report performance comparisons in general.

*In this test we use simple fixed-width gaussmoms for both codes. I want to do a model fitting run with @b-remy and see how that compares.

@andrevitorelli andrevitorelli added bug Something isn't working investigation Issues related to investigating a given question testing labels May 3, 2022
@andrevitorelli andrevitorelli self-assigned this May 3, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working investigation Issues related to investigating a given question testing
Projects
None yet
Development

No branches or pull requests

1 participant