Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

benchmark: add dvc repo with 20000 stages/dvcfiles #73

Closed
efiop opened this issue Jun 16, 2020 · 2 comments
Closed

benchmark: add dvc repo with 20000 stages/dvcfiles #73

efiop opened this issue Jun 16, 2020 · 2 comments

Comments

@efiop
Copy link
Contributor

efiop commented Jun 16, 2020

SC use case.

@skshetry
Copy link
Member

We should start with 10-100 stages for now, 20000 stages to always test is crazy. The "levels of 10" benchmarks should give us pretty good results, which we can extrapolate to 20000. It is just too much.

@efiop
Copy link
Contributor Author

efiop commented Aug 12, 2021

For the record: need to get back to this after pytest-benchmark migration, we need to start with making dataset testing comfy first and then we could do the same for dag #294

@skshetry skshetry closed this as not planned Won't fix, can't repro, duplicate, stale Aug 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants