Skip to content
This repository has been archived by the owner on Sep 11, 2024. It is now read-only.

End to End Tests

End to End Tests #7016

Triggered via workflow run January 25, 2024 19:16
@toger5toger5
completed 95430ce
Status Failure
Total duration 19m 49s
Artifacts 9

end-to-end-tests.yaml

on: workflow_run
Prepare
2s
Prepare
Matrix: tests
Report results
47s
Report results
Fit to window
Zoom out
Zoom in

Annotations

7 errors, 15 warnings, and 1 notice
Run Tests 6/8
The process '/usr/bin/xvfb-run' failed with exit code 1
[Rust Crypto] › read-receipts/high-level.spec.ts:295:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread: matrix-react-sdk/playwright/e2e/read-receipts/high-level.spec.ts#L1
1) [Rust Crypto] › read-receipts/high-level.spec.ts:295:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread Test finished within timeout of 30000ms, but tearing down "homeserver" ran out of time. Please allow more time for the test, since teardown is attributed towards the test timeout budget.
[Rust Crypto] › read-receipts/high-level.spec.ts:295:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread: matrix-react-sdk/playwright/e2e/read-receipts/high-level.spec.ts#L1
1) [Rust Crypto] › read-receipts/high-level.spec.ts:295:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
[Rust Crypto] › read-receipts/high-level.spec.ts:295:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread: matrix-react-sdk/playwright/e2e/read-receipts/index.ts#L590
1) [Rust Crypto] › read-receipts/high-level.spec.ts:295:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toBeVisible() Locator: locator('.mx_RoomView') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for locator('.mx_RoomView') at read-receipts/index.ts:590 588 | await this.page.reload(); 589 | // Wait for the app to reload > 590 | await expect(this.page.locator(".mx_RoomView")).toBeVisible(); | ^ 591 | } 592 | 593 | /** at Helpers.saveAndReload (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/read-receipts/index.ts:590:57) at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/read-receipts/high-level.spec.ts:321:13
[Rust Crypto] › read-receipts/high-level.spec.ts:295:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread: matrix-react-sdk/playwright/e2e/read-receipts/high-level.spec.ts#L1
1) [Rust Crypto] › read-receipts/high-level.spec.ts:295:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Test finished within timeout of 30000ms, but tearing down "homeserver" ran out of time. Please allow more time for the test, since teardown is attributed towards the test timeout budget.
[Legacy Crypto] › crypto/crypto.spec.ts:149:17 › Cryptography › setting up secure key backup should work isDeviceVerified=false › by recovery code: matrix-react-sdk/playwright/e2e/crypto/crypto.spec.ts#L166
2) [Legacy Crypto] › crypto/crypto.spec.ts:149:17 › Cryptography › setting up secure key backup should work isDeviceVerified=false › by recovery code Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('.mx_InteractiveAuthDialog .mx_Dialog_title').getByText('Setting up keys') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for locator('.mx_InteractiveAuthDialog .mx_Dialog_title').getByText('Setting up keys') 164 | if (!isDeviceVerified) { 165 | const uiaDialogTitle = page.locator(".mx_InteractiveAuthDialog .mx_Dialog_title"); > 166 | await expect(uiaDialogTitle.getByText("Setting up keys")).toBeVisible(); | ^ 167 | await expect(uiaDialogTitle.getByText("Setting up keys")).not.toBeVisible(); 168 | } 169 | at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/crypto.spec.ts:166:79
[Rust Crypto] › timeline/timeline.spec.ts:555:13 › Timeline › message displaying › should set inline start padding to a hidden event line: matrix-react-sdk/playwright/e2e/timeline/timeline.spec.ts#L587
3) [Rust Crypto] › timeline/timeline.spec.ts:555:13 › Timeline › message displaying › should set inline start padding to a hidden event line Error: Screenshot comparison failed: 28 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/timeline/timeline.spec.ts/hidden-event-line-zero-padding-irc-layout-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/timeline-timeline-Timeline-message-displaying-should-set-inline-start-padding-to-a-hidden-event-line-Rust-Crypto/hidden-event-line-zero-padding-irc-layout-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/timeline-timeline-Timeline-message-displaying-should-set-inline-start-padding-to-a-hidden-event-line-Rust-Crypto/hidden-event-line-zero-padding-irc-layout-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - waiting for element to be visible and stable - element is visible and stable - 28 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - waiting for element to be visible and stable - element is visible and stable - captured a stable screenshot - 28 pixels (ratio 0.01 of all image pixels) are different. 585 | }; 586 | > 587 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot( | ^ 588 | "hidden-event-line-zero-padding-irc-layout.png", 589 | screenshotOptions, 590 | ); at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/timeline/timeline.spec.ts:587:57
Prepare
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: Sibz/github-status-action@071b5370da85afbb16637d6eed8524a06bc2053e. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Run Tests 2/8
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/cache@v3, coactions/setup-xvfb@b6b4fcfb9f5a895edadc3bc76318fae0ac17c8b3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Run Tests 6/8
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/cache@v3, coactions/setup-xvfb@b6b4fcfb9f5a895edadc3bc76318fae0ac17c8b3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Run Tests 8/8
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/cache@v3, coactions/setup-xvfb@b6b4fcfb9f5a895edadc3bc76318fae0ac17c8b3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Run Tests 4/8
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/cache@v3, coactions/setup-xvfb@b6b4fcfb9f5a895edadc3bc76318fae0ac17c8b3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Run Tests 3/8
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/cache@v3, coactions/setup-xvfb@b6b4fcfb9f5a895edadc3bc76318fae0ac17c8b3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Run Tests 7/8
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/cache@v3, coactions/setup-xvfb@b6b4fcfb9f5a895edadc3bc76318fae0ac17c8b3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Run Tests 1/8
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/cache@v3, coactions/setup-xvfb@b6b4fcfb9f5a895edadc3bc76318fae0ac17c8b3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Run Tests 5/8
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/cache@v3, coactions/setup-xvfb@b6b4fcfb9f5a895edadc3bc76318fae0ac17c8b3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Report results
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: Sibz/github-status-action@071b5370da85afbb16637d6eed8524a06bc2053e, bobheadxi/deployments@88ce5600046c82542f8246ac287d0a53c461bca3, actions/github-script@v6, nwtgck/actions-netlify@7a92f00dde8c92a5a9e8385ec2919775f7647352. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Slow Test: [Rust Crypto] › read-receipts/redactions.spec.ts#L1
[Rust Crypto] › read-receipts/redactions.spec.ts took 6.0m
Slow Test: [Legacy Crypto] › read-receipts/redactions.spec.ts#L1
[Legacy Crypto] › read-receipts/redactions.spec.ts took 5.4m
Slow Test: [Rust Crypto] › read-receipts/high-level.spec.ts#L1
[Rust Crypto] › read-receipts/high-level.spec.ts took 5.1m
Slow Test: [Rust Crypto] › read-receipts/new-messages.spec.ts#L1
[Rust Crypto] › read-receipts/new-messages.spec.ts took 4.2m
Slow Test: [Legacy Crypto] › read-receipts/high-level.spec.ts#L1
[Legacy Crypto] › read-receipts/high-level.spec.ts took 3.7m
🎭 Playwright Run Summary
1 failed [Rust Crypto] › read-receipts/high-level.spec.ts:295:13 › Read receipts › Paging up › Looking in thread view to find old threads that were never read makes the room unread 2 flaky [Legacy Crypto] › crypto/crypto.spec.ts:149:17 › Cryptography › setting up secure key backup should work isDeviceVerified=false › by recovery code [Rust Crypto] › timeline/timeline.spec.ts:555:13 › Timeline › message displaying › should set inline start padding to a hidden event line 117 skipped 630 passed (17.8m)

Artifacts

Produced during runtime
Name Size
all-blob-reports-1 Expired
4.32 MB
all-blob-reports-2 Expired
428 KB
all-blob-reports-3 Expired
984 KB
all-blob-reports-4 Expired
1000 KB
all-blob-reports-5 Expired
1000 KB
all-blob-reports-6 Expired
15.5 MB
all-blob-reports-7 Expired
949 KB
all-blob-reports-8 Expired
3.75 MB
html-report--attempt-1 Expired
23.2 MB