Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Regression tests for ODE solver and integration tests for production model is in place #1695

Merged
merged 63 commits into from
Aug 13, 2024

Conversation

Jingru923
Copy link
Contributor

@Jingru923 Jingru923 commented Aug 5, 2024

Fixes #462
Fixes #1412

At some points, both issues are depending on the MiniO bucket. And I would like to try to set up the TC as fur as I can during the waiting time. So two issues will be closed at the same time by this PR.

This PR has a working regression test for ODE solver, and a integration test for HWS model.

For the regression tests, only 4 models was chosen for regression testing. In trivial model, because it is a very simple model, all the solvers are tested under 4 different settings of autodiff and sparsity. No arrow file was used for benchmarking the trivial model because it has only one basin, and the results from different settings/solvers doesn't vary much. For other 3 models, only the default solver was tested. It is tested under 4 settings of autodiff and sparsity. The benchmark arrow files will be in MiniO bucket instead of repository.

For integration test, the benchmark arrow file for HWS model will be in MiniO bucket as well.

Now if you enter pixi run test-ribasim-regression in terminal, regression tests are run. And pixi run model-integration-test, integration test is run.

@visr can you review the Julia part?
@Manangka can you review the Kotlin part?

@Jingru923 Jingru923 linked an issue Aug 5, 2024 that may be closed by this pull request
@Jingru923 Jingru923 requested a review from visr August 5, 2024 12:54
@evetion
Copy link
Member

evetion commented Aug 9, 2024

Take note of your revert merge commit, you should eventually merge main again and make sure that any conflicts are resolved by using --theirs (as this PR now proposes to undo commits present in the main branch).

@Jingru923 Jingru923 marked this pull request as ready for review August 12, 2024 08:51
@Jingru923 Jingru923 requested a review from visr August 12, 2024 09:49
Copy link
Member

@visr visr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🥳

.idea/.gitignore Outdated Show resolved Hide resolved
@Jingru923 Jingru923 merged commit 123c752 into main Aug 13, 2024
32 of 34 checks passed
@Jingru923 Jingru923 deleted the bench-large-model branch August 13, 2024 13:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

PoC: Testbench for model integration tests Regression testing
4 participants