Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

e2e: Fixes for nightly failures #16187

Merged
merged 1 commit into from
Jun 8, 2023
Merged

e2e: Fixes for nightly failures #16187

merged 1 commit into from
Jun 8, 2023

Conversation

yevh-berdnyk
Copy link
Contributor

No description provided.

@yevh-berdnyk yevh-berdnyk requested a review from churik as a code owner June 5, 2023 16:02
@yevh-berdnyk yevh-berdnyk self-assigned this Jun 5, 2023
@status-im-auto
Copy link
Member

status-im-auto commented Jun 5, 2023 •
edited
Loading

Jenkins Builds

Click to see older builds (8)
❔ Commit #️⃣ Finished (UTC) Duration Platform Result
❌ 7a10507 #1 2023-06-05 16:04:58 ~2 min tests 📄log
✔️ 7a10507 #1 2023-06-05 16:07:54 ~5 min android-e2e 🤖apk 📲
✔️ 7a10507 #1 2023-06-05 16:07:55 ~5 min android 🤖apk 📲
✔️ 7a10507 #1 2023-06-05 16:09:03 ~6 min ios 📱ipa 📲
✔️ f345352 #2 2023-06-05 23:19:06 ~5 min android 🤖apk 📲
✔️ f345352 #2 2023-06-05 23:19:28 ~5 min android-e2e 🤖apk 📲
✔️ f345352 #2 2023-06-05 23:22:30 ~8 min tests 📄log
✔️ f345352 #2 2023-06-05 23:28:15 ~14 min ios 📱ipa 📲
❔ Commit #️⃣ Finished (UTC) Duration Platform Result
✔️ cef8ebb #3 2023-06-08 00:49:14 ~5 min android-e2e 🤖apk 📲
✔️ cef8ebb #3 2023-06-08 00:49:33 ~5 min android 🤖apk 📲
✔️ cef8ebb #3 2023-06-08 00:50:45 ~6 min ios 📱ipa 📲
✔️ cef8ebb #3 2023-06-08 00:51:39 ~7 min tests 📄log
✔️ f3b5a9d #4 2023-06-08 02:12:36 ~5 min android 🤖apk 📲
✔️ f3b5a9d #4 2023-06-08 02:12:46 ~5 min android-e2e 🤖apk 📲
✔️ f3b5a9d #4 2023-06-08 02:14:11 ~6 min ios 📱ipa 📲
✔️ f3b5a9d #4 2023-06-08 02:15:45 ~8 min tests 📄log

@yevh-berdnyk yevh-berdnyk force-pushed the tests/fixes-for-nightly-failures branch from 7a10507 to f345352 Compare June 5, 2023 23:13
@status-im-auto
Copy link
Member

61% of end-end tests have passed

Total executed tests: 28
Failed tests: 11
Passed tests: 17
Not executed tests: 5

IDs of not executed tests: 702846,702742,703133,702850,702851 

IDs of failed tests: 702838,703086,702844,702840,702841,702733,702859,702732,703194,702894,702731

Not executed tests (5)

Click to expand
  • Rerun not executed tests

    • Failed tests (11)

    Click to expand
  • Rerun failed tests

    • Class TestCommunityMultipleDeviceMerged:

    1. test_community_message_send_check_timestamps_sender_username, id: 702838

    Device 1: Find `Text` by `xpath`: `//*[starts-with(@text,'hello')]/ancestor::android.view.ViewGroup[@content-desc='chat-item']`
    Device 1: Tap on found: Text 

    critical/test_public_chat_browsing.py:458: in test_community_message_send_check_timestamps_sender_username
    self.channel_1.chat_element_by_text(message).wait_for_status_to_be('Delivered', timeout=120)
../views/chat_view.py:227: in wait_for_status_to_be
    raise TimeoutException("Message status was not changed to %s" % expected_status)
 Message status was not changed to Delivered



    Device sessions

    2. test_community_mark_all_messages_as_read, id: 703086

    Device 1: Find Button by accessibility id: jump-to 

    critical/test_public_chat_browsing.py:764: in test_community_mark_all_messages_as_read
    self.channel_1.jump_to_communities_home()
../views/base_view.py:605: in jump_to_communities_home
    self.jump_to_button.click()
../views/base_element.py:91: in click
    self.find_element().click()
../views/base_element.py:80: in find_element
    raise NoSuchElementException(
 Device 1: Button by accessibility id: `jump-to` is not found on the screen



    Device sessions

    3. test_community_links_with_previews_github_youtube_twitter_gif_send_enable, id: 702844

    Device 2: Tap on found: SendMessageButton
    Device 1: Getting preview message for link: #11707 

    critical/test_public_chat_browsing.py:649: in test_community_links_with_previews_github_youtube_twitter_gif_send_enable
    self.channel_1.get_preview_message_by_text(url).wait_for_element(60)
../views/base_element.py:117: in wait_for_element
    raise TimeoutException(
 Device `1`: `PreviewMessage` by` xpath`: `//*[starts-with(@text,'https://github.com/status-im/status-mobile/pull/11707')]/ancestor::android.view.ViewGroup[@content-desc='chat-item']` is not found on the screen after wait_for_element



    Device sessions

    4. test_community_emoji_send_copy_paste_reply, id: 702840

    Device 1: Sending message 'emoji' 

    critical/test_public_chat_browsing.py:579: in test_community_emoji_send_copy_paste_reply
    self.channel_1.send_message(emoji_message)
../views/chat_view.py:954: in send_message
    self.chat_message_input.wait_for_element(wait_chat_input_sec)
../views/base_element.py:117: in wait_for_element
    raise TimeoutException(
 Device `1`: `ChatMessageInput` by` accessibility id`: `chat-message-input` is not found on the screen after wait_for_element



    Device sessions

    5. test_community_unread_messages_badge, id: 702841

    Device 1: Find Button by accessibility id: jump-to 

    critical/test_public_chat_browsing.py:668: in test_community_unread_messages_badge
    self.channel_1.jump_to_communities_home()
../views/base_view.py:605: in jump_to_communities_home
    self.jump_to_button.click()
../views/base_element.py:91: in click
    self.find_element().click()
../views/base_element.py:80: in find_element
    raise NoSuchElementException(
 Device 1: Button by accessibility id: `jump-to` is not found on the screen



    Device sessions

    6. test_community_one_image_send_reply, id: 702859

    Device 1: Tap on found: Text
    Device 1: Find Text by xpath: //*[starts-with(@text,'description')]/ancestor::android.view.ViewGroup[@content-desc='chat-item'] 

    critical/test_public_chat_browsing.py:505: in test_community_one_image_send_reply
    self.channel_1.chat_element_by_text(image_description).wait_for_status_to_be('Delivered', timeout=120)
../views/chat_view.py:224: in wait_for_status_to_be
    if self.status == expected_status:
../views/chat_view.py:213: in status
    Text(self.driver, xpath=self.locator).click()
../views/base_element.py:91: in click
    self.find_element().click()
../views/base_element.py:80: in find_element
    raise NoSuchElementException(
 Device 1: Text by xpath: `//*[starts-with(@text,'description')]/ancestor::android.view.ViewGroup[@content-desc='chat-item']` is not found on the screen



    Device sessions

    7. test_community_several_images_send_reply, id: 703194

    # STEP: Send several images in 1-1 chat from Gallery
    Device 1: Find Button by accessibility id: open-images-button 

    critical/test_public_chat_browsing.py:555: in test_community_several_images_send_reply
    self.channel_1.send_images_with_description(image_description, [0, 1])
../views/chat_view.py:1159: in send_images_with_description
    self.show_images_button.click()
../views/base_element.py:91: in click
    self.find_element().click()
../views/base_element.py:80: in find_element
    raise NoSuchElementException(
 Device 1: Button by accessibility id: `open-images-button` is not found on the screen



    Device sessions

    8. test_community_contact_block_unblock_offline, id: 702894

    Device 1: Find Button by accessibility id: jump-to 

    critical/test_public_chat_browsing.py:687: in test_community_contact_block_unblock_offline
    [home.jump_to_card_by_text('# %s' % self.channel_name) for home in self.homes]
critical/test_public_chat_browsing.py:687: in <listcomp>
    [home.jump_to_card_by_text('# %s' % self.channel_name) for home in self.homes]
../views/base_view.py:609: in jump_to_card_by_text
    self.jump_to_button.click()
../views/base_element.py:91: in click
    self.find_element().click()
../views/base_element.py:80: in find_element
    raise NoSuchElementException(
 Device 1: Button by accessibility id: `jump-to` is not found on the screen



    Device sessions

    Class TestGroupChatMultipleDeviceMergedNewUI:

    1. test_group_chat_pin_messages, id: 702732 

    Test is not run, e2e blocker

    [[reason: [NOTRUN] Pin feature is in development]]

    Class TestOneToOneChatMultipleSharedDevicesNewUi:

    1. test_1_1_chat_text_message_delete_push_disappear, id: 702733

    Device 2: Find Text by xpath: //*[starts-with(@text,'message to delete for me')]/ancestor::android.view.ViewGroup[@content-desc='chat-item']//*[@content-desc='message-status']/android.widget.TextView
    Device 2: Text is Sent 

    critical/chats/test_1_1_public_chats.py:1163: in test_1_1_chat_text_message_delete_push_disappear
    self.chat_2.chat_element_by_text(message_to_delete_for_me).wait_for_status_to_be("Delivered")
../views/chat_view.py:227: in wait_for_status_to_be
    raise TimeoutException("Message status was not changed to %s" % expected_status)
 Message status was not changed to Delivered



    Device sessions

    2. test_1_1_chat_pin_messages, id: 702731 

    Test is not run, e2e blocker

    [[reason: [NOTRUN] Pin feature is in development]]

    Passed tests (17)

    Click to expand

    Class TestCommunityMultipleDeviceMerged:

    1. test_community_message_edit, id: 702843
    Device sessions

    2. test_community_message_delete, id: 702839
    Device sessions

    3. test_community_mentions_push_notification, id: 702786
    Device sessions

    4. test_community_leave, id: 702845
    Device sessions

    Class TestActivityMultipleDevicePR:

    1. test_navigation_jump_to, id: 702936
    Device sessions

    2. test_activity_center_admin_notification_accept_swipe, id: 702958
    Device sessions

    3. test_activity_center_mentions, id: 702957
    Device sessions

    4. test_activity_center_reply_read_unread_delete_filter_swipe, id: 702947
    Device sessions

    Class TestOneToOneChatMultipleSharedDevicesNewUi:

    1. test_1_1_chat_is_shown_message_sent_delivered_from_offline, id: 702783
    Device sessions

    2. test_1_1_chat_push_emoji, id: 702813
    Device sessions

    3. test_1_1_chat_emoji_send_reply_and_open_link, id: 702782
    Device sessions

    4. test_1_1_chat_delete_via_long_press_relogin, id: 702784
    Device sessions

    5. test_1_1_chat_message_reaction, id: 702730
    Device sessions

    6. test_1_1_chat_non_latin_messages_stack_update_profile_photo, id: 702745
    Device sessions

    7. test_1_1_chat_edit_message, id: 702855
    Device sessions

    Class TestGroupChatMultipleDeviceMergedNewUI:

    1. test_group_chat_join_send_text_messages_push, id: 702807
    Device sessions

    2. test_group_chat_offline_pn, id: 702808
    Device sessions

    @yevh-berdnyk yevh-berdnyk force-pushed the tests/fixes-for-nightly-failures branch from f345352 to cef8ebb Compare June 8, 2023 00:43
    @status-im-auto
    Copy link
    Member

    71% of end-end tests have passed

    Total executed tests: 21
Failed tests: 6
Passed tests: 15
Not executed tests: 12

    IDs of not executed tests: 702807,702732,702808,702846,702742,703133,702850,702851,702936,702947,702957,702958 

    IDs of failed tests: 702838,702782,702859,703194,702894,702731

    Not executed tests (12)

    Click to expand
  • Rerun not executed tests

    • Failed tests (6)

    Click to expand
  • Rerun failed tests

    • Class TestOneToOneChatMultipleSharedDevicesNewUi:

    1. test_1_1_chat_emoji_send_reply_and_open_link, id: 702782

    Device 1: Find `SendMessageButton` by `accessibility id`: `send-message-button`
    Device 1: Tap on found: SendMessageButton 

    critical/chats/test_1_1_public_chats.py:929: in test_1_1_chat_emoji_send_reply_and_open_link
    self.chat_2.element_starts_with_text(url_message, 'button').wait_for_visibility_of_element(120)
../views/base_element.py:135: in wait_for_visibility_of_element
    raise TimeoutException(
 Device 2: Button by xpath:`//*[starts-with(@text,'http://status.im')]` is not found on the screen after wait_for_visibility_of_element



    Device sessions

    2. test_1_1_chat_pin_messages, id: 702731 

    Test is not run, e2e blocker

    [[reason: [NOTRUN] Pin feature is in development]]

    Class TestCommunityMultipleDeviceMerged:

    1. test_community_message_send_check_timestamps_sender_username, id: 702838

    Device 1: Find Text by xpath: //*[starts-with(@text,'hello')]/ancestor::android.view.ViewGroup[@content-desc='chat-item']
    Device 1: Tap on found: Text 

    critical/test_public_chat_browsing.py:458: in test_community_message_send_check_timestamps_sender_username
    self.channel_1.chat_element_by_text(message).wait_for_status_to_be('Delivered', timeout=120)
../views/chat_view.py:227: in wait_for_status_to_be
    raise TimeoutException("Message status was not changed to %s" % expected_status)
 Message status was not changed to Delivered



    Device sessions

    2. test_community_one_image_send_reply, id: 702859

    Device 1: Waiting for message to be sent for 120 sec
    Device 1: Find Text by xpath: //*[starts-with(@text,'description')]/ancestor::android.view.ViewGroup[@content-desc='chat-item'] 

    critical/test_public_chat_browsing.py:505: in test_community_one_image_send_reply
    self.channel_1.chat_element_by_text(image_description).wait_for_status_to_be('Delivered', timeout=120)
../views/chat_view.py:224: in wait_for_status_to_be
    if self.status == expected_status:
../views/chat_view.py:200: in status
    Text(self.driver, xpath=self.locator).click()
../views/base_element.py:91: in click
    self.find_element().click()
../views/base_element.py:80: in find_element
    raise NoSuchElementException(
 Device 1: Text by xpath: `//*[starts-with(@text,'description')]/ancestor::android.view.ViewGroup[@content-desc='chat-item']` is not found on the screen



    Device sessions

    3. test_community_several_images_send_reply, id: 703194

    Device 2: Tap on found: SendMessageButton
    Device 1: Looking for a message by text: reply to gallery 

    critical/test_public_chat_browsing.py:572: in test_community_several_images_send_reply
    self.errors.verify_no_errors()
base_test_case.py:184: in verify_no_errors
    pytest.fail('\n '.join([self.errors.pop(0) for _ in range(len(self.errors))]))
 Reply message was not received by the sender



    Device sessions

    4. test_community_contact_block_unblock_offline, id: 702894

    Device 1: Find ChatElementByText by xpath: //*[starts-with(@text,'Hurray! unblocked')]/ancestor::android.view.ViewGroup[@content-desc='chat-item']
    Device 1: Find MemberPhoto by xpath: //*[starts-with(@text,'Hurray! unblocked')]/ancestor::android.view.ViewGroup[@content-desc='chat-item']//*[@content-desc='user-avatar'] 

    critical/test_public_chat_browsing.py:742: in test_community_contact_block_unblock_offline
    chat_element.member_photo.click()
../views/base_element.py:91: in click
    self.find_element().click()
../views/base_element.py:80: in find_element
    raise NoSuchElementException(
 Device 1: MemberPhoto by xpath: `//*[starts-with(@text,'Hurray! unblocked')]/ancestor::android.view.ViewGroup[@content-desc='chat-item']//*[@content-desc='user-avatar']` is not found on the screen



    Device sessions

    Passed tests (15)

    Click to expand

    Class TestOneToOneChatMultipleSharedDevicesNewUi:

    1. test_1_1_chat_is_shown_message_sent_delivered_from_offline, id: 702783
    Device sessions

    2. test_1_1_chat_push_emoji, id: 702813
    Device sessions

    3. test_1_1_chat_text_message_delete_push_disappear, id: 702733
    Device sessions

    4. test_1_1_chat_delete_via_long_press_relogin, id: 702784
    Device sessions

    5. test_1_1_chat_message_reaction, id: 702730
    Device sessions

    6. test_1_1_chat_non_latin_messages_stack_update_profile_photo, id: 702745
    Device sessions

    7. test_1_1_chat_edit_message, id: 702855
    Device sessions

    Class TestCommunityMultipleDeviceMerged:

    1. test_community_mark_all_messages_as_read, id: 703086
    Device sessions

    2. test_community_links_with_previews_github_youtube_twitter_gif_send_enable, id: 702844
    Device sessions

    3. test_community_emoji_send_copy_paste_reply, id: 702840
    Device sessions

    4. test_community_message_edit, id: 702843
    Device sessions

    5. test_community_message_delete, id: 702839
    Device sessions

    6. test_community_unread_messages_badge, id: 702841
    Device sessions

    7. test_community_mentions_push_notification, id: 702786
    Device sessions

    8. test_community_leave, id: 702845
    Device sessions

    @yevh-berdnyk yevh-berdnyk force-pushed the tests/fixes-for-nightly-failures branch from cef8ebb to f3b5a9d Compare June 8, 2023 02:07
    @yevh-berdnyk yevh-berdnyk merged commit f3b5a9d into develop Jun 8, 2023
    @yevh-berdnyk yevh-berdnyk deleted the tests/fixes-for-nightly-failures branch June 8, 2023 02:16
    Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
    Reviewers

    @qoqobolo qoqobolo qoqobolo approved these changes

    @churik churik Awaiting requested review from churik churik is a code owner

    Assignees

    @yevh-berdnyk yevh-berdnyk

    Labels
    tests
    Projects
    No open projects
    Legacy QA Automation Project
    Archived in project
    Milestone
    No milestone
    Development

    Successfully merging this pull request may close these issues.
    3 participants
    @yevh-berdnyk @status-im-auto @qoqobolo