-
Notifications
You must be signed in to change notification settings - Fork 87
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
testsuite: Treat not tested as non failure and reduce verbosity #1665
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
rdmark
changed the title
testsuite: Treat not tested as non failure
testsuite: Treat not tested as non failure and reduce verbosity
Oct 21, 2024
rdmark
force-pushed
the
1663-testsuite-treat-not-tested-as-non-failure
branch
from
October 21, 2024 22:54
579de2c
to
a757160
Compare
rdmark
force-pushed
the
1663-testsuite-treat-not-tested-as-non-failure
branch
from
October 22, 2024 13:04
835b3ad
to
89be90c
Compare
rdmark
force-pushed
the
1663-testsuite-treat-not-tested-as-non-failure
branch
6 times, most recently
from
October 22, 2024 17:37
15827b5
to
254a667
Compare
rdmark
force-pushed
the
1663-testsuite-treat-not-tested-as-non-failure
branch
from
October 22, 2024 17:55
254a667
to
9b04a06
Compare
Quality Gate passedIssues Measures |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Overhaul of testsuite to reduce default verbosity for more readable test logs, and treat NOT TESTED and SKIPPED as non-failure for more consistent results in a CI environment.
Restore a handful of tests that were made functional by recent code improvements.
Standardize on
-v
for medium verbosity and-V
for high level of verbosity logging.Refashion the
-x
(Exclude) option for flagging tests that are failing with Netatalk 4.0 for unknown reasons. Investigation required.Colorize also the SKIPPED test results.
All of this results in a cleaner test log and test report generated by spectest.sh that is much more readable. Sample: