-
Notifications
You must be signed in to change notification settings - Fork 77
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
General benchmarking framework #86
Conversation
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## master #86 +/- ##
==========================================
+ Coverage 89.47% 91.07% +1.60%
==========================================
Files 9 9
Lines 399 538 +139
==========================================
+ Hits 357 490 +133
- Misses 42 48 +6 ☔ View full report in Codecov by Sentry. |
Looks cool. A couple things.
|
Yes, I was planning to look into better handling the extra dependencies too. And documentation will also come in due course :) |
…e configuration, backends. Reverted the dependencies added in WaterLily, and these are now included in the benchmarks environment. To run the benchmarks, the benchmarks environment is activated, while WaterLily is marked as a development package.
…ubproject dependencies.
Co-authored-by: Mosè Giordano <[email protected]>
Co-authored-by: Mosè Giordano <[email protected]>
- juliaup now uses the +{version} approach instead of modifying the default juliaup version - Pkg.develop now uses dirname(@__DIR__) Also moved docs to the new README.md file to improve readability.
I think this is finished @weymouth. We can add more benchmark examples in the future, additionally to the |
Automated benchmarks generation to improve in reproducibility, and profiling of new code.
When completed, it should be able to automatically run and compare benchmarks across multiple: