Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kani's slow tests are failing #1818

Closed
fzaiser opened this issue Oct 31, 2022 · 3 comments
Closed

Kani's slow tests are failing #1818

fzaiser opened this issue Oct 31, 2022 · 3 comments

Comments

@fzaiser
Copy link
Contributor

fzaiser commented Oct 31, 2022

... and have been failing for a while: https://github.com/model-checking/kani/actions/workflows/slow-tests.yml

Cc @danielsn because he suggested them.

@fzaiser
Copy link
Contributor Author

fzaiser commented Nov 1, 2022

The relevant line in the logs is CBMC failed with status 137, indicating an out-of-memory error. They started failing on 28 September. The only relevant commit on the day before seems to be #1717 ("Build custom sysroot with --always-encode-mir on").
@celinval Do you know what the reason of this could be? I'm observing something similar in the CI tests for #1659.

@celinval
Copy link
Contributor

celinval commented Nov 2, 2022

Hi @fzaiser, #1717 fixed the issue with missing symbols from the standard library. The downside is that the goto program we generate can be much bigger, which may slow down the verification or cause cbmc to run out of memory.

@fzaiser
Copy link
Contributor Author

fzaiser commented Dec 16, 2022

The tests started passing again a few days ago, probably because of #1941. They also run much quicker (~100 seconds instead of minutes) now! 🎉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants