SuiteReportFeatures
There is possibility to accept failed test on each level (suite, test and URL) for the test cases in which the pattern is used (for now acceptable cases are: cookie compare, layout for screen and source "Source"). It is possible to revert certain acceptation, but for now only if changes are not saved. Accepting on suite level makes all acceptable test accepted, on test level it provides acceptation of each URL in certain test case. The lowest level is accepting certain URLs.
Accepting pattern example:
Reverting pattern example:
There is possibility to add notes to each level of the report. Notes are useful to give some information about test case e.g. why failed test was accepted.
Every test case has one of the following states:
- passed — if the comparator doesn't find any change, i.e. validation passes,
- passed with warnings — if there are some warnings, but they are not very important,
- conditionally passed - if the comparator finds some change, but the change is smaller or equal to error threshold
- failed — if the comparator detects some changes or some validation rules are broken,
- accepted — if failed test was accepted.
Tests and URLs may be filtered by:
- text included in the test name or URL,
- test status.
Filtering by status works as an alternative: if one selects passed and failed tests both should be visible.
It is possible to search tests and URLs by the query. Searched fields are the URL and test name.
It is possible to find currently opened test/URL in Side Panel by using the crosshair buttons. Moreover, every URL has information to which test group it belongs.
It is possible to view current suite's history by clicking current suite's name and version in the top toolbar. User can also navigate through versions by clicking next/previous arrow next to suite's version.
Clicking the suite's name in the top toolbar will show a popup in which the user can see every suite's version that is still available in the database. User can also directly go to the newest version of the suite by clicking the step-forward icon (the one furthest to the right in the image above).
Bold version means that this version is the same as the version that's currently being viewed. Blue version means that it is a rebased version of previous suite - this is also shown by the timestamps which are identical for original and rebased suite versions.
- press q to expand/collapse all items
- press e to expand/collapse all error items
- use [ / ] to navigate between test's urls
- press m to show/hide layout mask (when available)
- press ← / → to navigate between url's tabs
- press a for accepting suite/test/url
- press r for reverting suite/test/url
- shift modifier that will define that the specific opened test case should be accepted/reverted (shift + A - accepts opened test case ; shift + R - reverts opened test case )
This feature is called rerun and may be invoked for the whole suite:
Single test:
Or just one url:
After scheduling task from the report progress bar will be presented. When the task is finished, result will be presented on the report.