iOS end-to-end nightly tests

iOS end-to-end nightly tests #45

Sign in to view logs

Triggered via schedule September 21, 2024 00:01

buggmagnet

main

Status Failure

Total duration 11m 44s

Artifacts 5

ios-end-to-end-tests-nightly.yml

on: schedule

reuse-e2e-workflow / Set up outputs directory

reuse-e2e-workflow / Define test suites matrix

reuse-e2e-workflow / Build for end to end testing

Matrix: reuse-e2e-workflow / Run tests

reuse-e2e-workflow / Clean up outputs directory

reuse-e2e-workflow / Notify team on failure(if PR related)

Annotations

21 errors and 6 warnings

reuse-e2e-workflow / Run tests (AccountTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110

testLogin, failed - Request failed with status code 403

reuse-e2e-workflow / Run tests (AccountTests): ios/MullvadVPNUITests/Networking/MullvadAPIWrapper.swift#L104

testLogOut, XCTAssertNil failed: "requestError" - Create account error is nil

reuse-e2e-workflow / Run tests (AccountTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110

testTimeLeft, failed - Request failed with status code 403

reuse-e2e-workflow / Run tests (AccountTests)

Process completed with exit code 65.

reuse-e2e-workflow / Run tests (ConnectivityTests): ios/MullvadVPNUITests/Networking/FirewallAPIClient.swift#L105

testAPIConnectionViaBridges, failed - Failed to remove firewall rules - unexpected server response

reuse-e2e-workflow / Run tests (ConnectivityTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110

testAPIReachableWhenBlocked, failed - Request failed with status code 403

reuse-e2e-workflow / Run tests (ConnectivityTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110

testAppStillFunctioningWhenAPIDown, failed - Request failed with status code 403

reuse-e2e-workflow / Run tests (ConnectivityTests)

Process completed with exit code 65.

reuse-e2e-workflow / Run tests (CustomListsTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110

testAddSingleLocationToCustomList, failed - Request failed with status code 403

reuse-e2e-workflow / Run tests (CustomListsTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110

testCreateCustomListPersistAfterAppRestarts, failed - Request failed with status code 403

reuse-e2e-workflow / Run tests (CustomListsTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110

testDeleteCustomList, failed - Request failed with status code 403

reuse-e2e-workflow / Run tests (CustomListsTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110

testEditCustomListLocations, failed - Request failed with status code 403

reuse-e2e-workflow / Run tests (CustomListsTests)

Process completed with exit code 65.

reuse-e2e-workflow / Run tests (RelayTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110

testAdBlockingViaDNS, failed - Request failed with status code 403

reuse-e2e-workflow / Run tests (RelayTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110

testAppConnection, failed - Request failed with status code 403

reuse-e2e-workflow / Run tests (RelayTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110

testConnectionRetryLogic, failed - Request failed with status code 403

reuse-e2e-workflow / Run tests (RelayTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110

testCustomDNS, failed - Request failed with status code 403

reuse-e2e-workflow / Run tests (RelayTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110

testWireGuardOverTCPAutomatically, failed - Request failed with status code 403

reuse-e2e-workflow / Run tests (RelayTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110

testWireGuardOverTCPManually, failed - Request failed with status code 403

reuse-e2e-workflow / Run tests (RelayTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110

testWireGuardPortSettings, failed - Request failed with status code 403

reuse-e2e-workflow / Run tests (RelayTests)

Process completed with exit code 65.

reuse-e2e-workflow / Build for end to end testing

The following actions uses node12 which is deprecated and will be forced to run on node16: actions-rs/[email protected]. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

reuse-e2e-workflow / Build for end to end testing

The following actions use a deprecated Node.js version and will be forced to run on node20: actions-rs/[email protected]. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

reuse-e2e-workflow / Build for end to end testing

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

reuse-e2e-workflow / Build for end to end testing

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

reuse-e2e-workflow / Build for end to end testing

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

reuse-e2e-workflow / Build for end to end testing

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

Artifacts

Produced during runtime

Name	Size
MullvadVPNUITests_AccountTests-test-results	50.3 MB
MullvadVPNUITests_ConnectivityTests-test-results	55.1 MB
MullvadVPNUITests_CustomListsTests-test-results	52.6 MB
MullvadVPNUITests_RelayTests-test-results	90.3 MB
MullvadVPNUITests_SettingsTests-test-results	110 KB