search

status-im / status-mobile

a free (libre) open source, mobile OS for Ethereum
https://status.app
Mozilla Public License 2.0
3.92k stars 984 forks source link

chore: bump status-go #21664

Closed osmaczko closed 3 days ago

osmaczko commented 4 days ago

Run regression tests for: https://github.com/status-im/status-go/pull/6025

osmaczko commented 4 days ago

@qfrank can you please check if logging works as expected on mobile? Thanks :pray:

status-im-auto commented 4 days ago

Jenkins Builds

:grey_question: Commit :hash: Finished (UTC) Duration Platform Result
:heavy_check_mark: 50ed3dac #1 2024-11-21 20:51:25 ~6 min tests :page_facing_up:log
:heavy_check_mark: 50ed3dac #1 2024-11-21 20:55:18 ~10 min android-e2e :robot:apk :calling:
:heavy_check_mark: 50ed3dac #1 2024-11-21 20:55:21 ~10 min ios :iphone:ipa :calling:
:heavy_check_mark: 50ed3dac #1 2024-11-21 20:56:58 ~12 min android :robot:apk :calling:
qfrank commented 3 days ago

@qfrank can you please check if logging works as expected on mobile? Thanks 🙏

LGTM though I only checked geth.log and requests.log with ios build

osmaczko commented 3 days ago

@qfrank can you please check if logging works as expected on mobile? Thanks 🙏

LGTM though I only checked geth.log and requests.log with ios build

Thank you!

status-im-auto commented 3 days ago

56% of end-end tests have passed

Total executed tests: 55
Failed tests: 4
Expected to fail tests: 20
Passed tests: 31
IDs of failed tests: 702808,703503,702777,740222 
IDs of expected to fail tests: 702845,702840,702894,703086,702947,702958,702786,702844,702841,702839,702809,702838,704615,702948,702859,703629,702957,702843,739307,703194

Failed tests (4)

Click to expand
  • Rerun failed tests

    • Class TestGroupChatMultipleDeviceMergedNewUI:

    1. test_group_chat_offline_pn, id: 702808

    Device 3: Looking for a message by text: message from new member
    Device 1: Looking for a message by text: message from new member

    ``` critical/chats/test_group_chat.py:350: in test_group_chat_offline_pn self.errors.verify_no_errors() base_test_case.py:192: in verify_no_errors pytest.fail('\n '.join([self.errors.pop(0) for _ in range(len(self.errors))])) message from new member if not shown for device 0 ```

    Device sessions

    Class TestCommunityOneDeviceMerged:

    1. test_community_discovery, id: 703503

    ## Sign in (password: qwerty1234)
    Device 1: Getting username card by 'first user'

    ``` critical/chats/test_public_chat_browsing.py:246: in test_community_discovery self.sign_in.sign_in(user_name=self.username) ../views/sign_in_view.py:306: in sign_in self.get_user_profile_by_name(user_name).click() ../views/sign_in_view.py:370: in get_user_profile_by_name return expected_element if expected_element.is_element_displayed(10) else self.driver.fail( base_test_case.py:180: in fail pytest.fail('Device %s: %s' % (self.number, text)) Device 1: User first user is not found! ```

    Device sessions

    Class TestActivityCenterContactRequestMultipleDevicePR:

    1. test_add_contact_field_validation, id: 702777

    Device 1: Tap on found: Button
    ## New multiaccount is created successfully!

    ``` activity_center/test_activity_center.py:175: in test_add_contact_field_validation self.loop.run_until_complete(run_in_parallel(((_device_1_creates_user, {}), /usr/lib/python3.10/asyncio/base_events.py:649: in run_until_complete return future.result() __init__.py:52: in run_in_parallel returns.append(await k) /usr/lib/python3.10/concurrent/futures/thread.py:58: in run result = self.fn(*self.args, **self.kwargs) activity_center/test_activity_center.py:172: in _device_2_sign_in self.device_2.show_profiles_button.wait_and_click() ../views/base_element.py:100: in wait_and_click self.wait_for_visibility_of_element(sec) ../views/base_element.py:147: in wait_for_visibility_of_element raise TimeoutException( Device 2: Button by accessibility id:`show-profiles` is not found on the screen after wait_for_visibility_of_element ```

    Device sessions

    Class TestFallbackMultipleDevice:

    1. test_fallback_validate_seed_phrase, id: 740222

    # STEP: Device 2: try syncing profile
    Device 2: Wait for element `Button` for max 30s and click when it is available

    ``` critical/test_fallback.py:167: in test_fallback_validate_seed_phrase self.sign_in_2.sync_profile(sync_code=self.sync_code, first_user=False) ../views/sign_in_view.py:293: in sync_profile self.show_profiles_button.wait_and_click() ../views/base_element.py:100: in wait_and_click self.wait_for_visibility_of_element(sec) ../views/base_element.py:147: in wait_for_visibility_of_element raise TimeoutException( Device 2: Button by accessibility id:`show-profiles` is not found on the screen after wait_for_visibility_of_element ```

    Device sessions

    Expected to fail tests (20)

    Click to expand

    Class TestActivityMultipleDevicePRTwo:

    1. test_activity_center_admin_notification_accept_swipe, id: 702958
    ``` Test is not run, e2e blocker ``` [[reason: [NOTRUN] Skipped due to waku issue on staging fleet]]

    2. test_activity_center_mentions, id: 702957
    ``` Test is not run, e2e blocker ``` [[reason: [NOTRUN] Skipped due to waku issue on staging fleet]]

    Class TestDeepLinksOneDevice:

    1. test_deep_links_communities, id: 739307
    ``` Test is not run, e2e blocker ``` [[reason: [NOTRUN] Skipped due to waku issue on staging fleet]]

    Class TestActivityMultipleDevicePR:

    1. test_activity_center_reply_read_unread_delete_filter_swipe, id: 702947
    ``` Test is not run, e2e blocker ``` [[reason: [NOTRUN] Skipped due to waku issue on staging fleet]]

    Class TestCommunityMultipleDeviceMerged:

    1. test_community_emoji_send_copy_paste_reply, id: 702840
    ``` Test is not run, e2e blocker ``` [[reason: [NOTRUN] Skipped due to waku issue on staging fleet]]

    2. test_community_contact_block_unblock_offline, id: 702894
    ``` Test is not run, e2e blocker ``` [[reason: [NOTRUN] Skipped due to waku issue on staging fleet]]

    3. test_community_mark_all_messages_as_read, id: 703086
    ``` Test is not run, e2e blocker ``` [[reason: [NOTRUN] Skipped due to waku issue on staging fleet]]

    4. test_community_links_with_previews_github_youtube_twitter_gif_send_enable, id: 702844
    ``` Test is not run, e2e blocker ``` [[reason: [NOTRUN] Skipped due to waku issue on staging fleet]]

    5. test_community_unread_messages_badge, id: 702841
    ``` Test is not run, e2e blocker ``` [[reason: [NOTRUN] Skipped due to waku issue on staging fleet]]

    6. test_community_message_delete, id: 702839
    ``` Test is not run, e2e blocker ``` [[reason: [NOTRUN] Skipped due to waku issue on staging fleet]]

    7. test_community_message_send_check_timestamps_sender_username, id: 702838
    ``` Test is not run, e2e blocker ``` [[reason: [NOTRUN] Skipped due to waku issue on staging fleet]]

    8. test_community_edit_delete_message_when_offline, id: 704615
    ``` Test is not run, e2e blocker ``` [[reason: [NOTRUN] Skipped due to waku issue on staging fleet]]

    9. test_community_one_image_send_reply, id: 702859
    ``` Test is not run, e2e blocker ``` [[reason: [NOTRUN] Skipped due to waku issue on staging fleet]]

    10. test_community_message_edit, id: 702843
    ``` Test is not run, e2e blocker ``` [[reason: [NOTRUN] Skipped due to waku issue on staging fleet]]

    11. test_community_several_images_send_reply, id: 703194
    ``` Test is not run, e2e blocker ``` [[reason: [NOTRUN] Skipped due to waku issue on staging fleet]]

    Class TestCommunityMultipleDeviceMergedTwo:

    1. test_community_leave, id: 702845
    ``` Test is not run, e2e blocker ``` [[reason: [NOTRUN] Skipped due to waku issue on staging fleet]]

    2. test_community_mentions_push_notification, id: 702786
    ``` Test is not run, e2e blocker ``` [[reason: [NOTRUN] Skipped due to waku issue on staging fleet]]

    3. test_community_markdown_support, id: 702809
    ``` Test is not run, e2e blocker ``` [[reason: [NOTRUN] Skipped due to waku issue on staging fleet]]

    4. test_community_hashtag_links_to_community_channels, id: 702948
    ``` Test is not run, e2e blocker ``` [[reason: [NOTRUN] Skipped due to waku issue on staging fleet]]

    5. test_community_join_when_node_owner_offline, id: 703629
    ``` Test is not run, e2e blocker ``` [[reason: [NOTRUN] Skipped due to waku issue on staging fleet]]

    Passed tests (31)

    Click to expand

    Class TestOneToOneChatMultipleSharedDevicesNewUi:

    1. test_1_1_chat_edit_message, id: 702855
    Device sessions

    2. test_1_1_chat_message_reaction, id: 702730
    Device sessions

    3. test_1_1_chat_non_latin_messages_stack_update_profile_photo, id: 702745
    Device sessions

    4. test_1_1_chat_pin_messages, id: 702731
    Device sessions

    5. test_1_1_chat_text_message_delete_push_disappear, id: 702733
    Device sessions

    6. test_1_1_chat_push_emoji, id: 702813
    Device sessions

    7. test_1_1_chat_emoji_send_reply_and_open_link, id: 702782
    Device sessions

    8. test_1_1_chat_send_image_save_and_share, id: 703391
    Device sessions

    Class TestGroupChatMultipleDeviceMergedNewUI:

    1. test_group_chat_reactions, id: 703202
    Device sessions

    2. test_group_chat_join_send_text_messages_push, id: 702807
    Device sessions

    3. test_group_chat_pin_messages, id: 702732
    Device sessions

    4. test_group_chat_send_image_save_and_share, id: 703297
    Device sessions

    5. test_group_chat_mute_chat, id: 703495
    Device sessions

    Class TestFallbackMultipleDevice:

    1. test_fallback_sync_with_error, id: 740220
    Device sessions

    2. test_fallback_with_correct_seed_phrase, id: 740221
    Device sessions

    Class TestWalletOneDevice:

    1. test_wallet_add_remove_regular_account, id: 727231
    2. test_wallet_balance_mainnet, id: 740490

    Class TestDeepLinksOneDevice:

    1. test_links_open_universal_links_from_chat, id: 704613
    Device sessions

    2. test_links_deep_links_profile, id: 702775
    Device sessions

    Class TestWalletMultipleDevice:

    1. test_wallet_send_asset_from_drawer, id: 727230
    2. test_wallet_send_eth, id: 727229

    Class TestOneToOneChatMultipleSharedDevicesNewUiTwo:

    1. test_1_1_chat_mute_chat, id: 703496
    Device sessions

    2. test_1_1_chat_is_shown_message_sent_delivered_from_offline, id: 702783
    Device sessions

    3. test_1_1_chat_delete_via_long_press_relogin, id: 702784
    Device sessions

    Class TestActivityCenterContactRequestMultipleDevicePR:

    1. test_activity_center_contact_request_accept_swipe_mark_all_as_read, id: 702851
    Device sessions

    2. test_activity_center_contact_request_decline, id: 702850
    Device sessions

    Class TestCommunityOneDeviceMerged:

    1. test_restore_multiaccount_with_waku_backup_remove_profile_switch, id: 703133
    Device sessions

    2. test_community_copy_and_paste_message_in_chat_input, id: 702742
    Device sessions

    3. test_community_navigate_to_channel_when_relaunch, id: 702846
    Device sessions

    4. test_community_undo_delete_message, id: 702869
    Device sessions

    5. test_community_mute_community_and_channel, id: 703382
    Device sessions

    status-im-auto commented 3 days ago

    25% of end-end tests have passed

    Total executed tests: 4
Failed tests: 3
Expected to fail tests: 0
Passed tests: 1
    IDs of failed tests: 703503,702777,740222

    Failed tests (3)

    Click to expand
  • Rerun failed tests

    • Class TestFallbackMultipleDevice:

    1. test_fallback_validate_seed_phrase, id: 740222

    # STEP: Device 2: try syncing profile
    Device 2: Wait for element `Button` for max 30s and click when it is available

    ``` critical/test_fallback.py:167: in test_fallback_validate_seed_phrase self.sign_in_2.sync_profile(sync_code=self.sync_code, first_user=False) ../views/sign_in_view.py:293: in sync_profile self.show_profiles_button.wait_and_click() ../views/base_element.py:100: in wait_and_click self.wait_for_visibility_of_element(sec) ../views/base_element.py:147: in wait_for_visibility_of_element raise TimeoutException( Device 2: Button by accessibility id:`show-profiles` is not found on the screen after wait_for_visibility_of_element ```

    Device sessions

    Class TestActivityCenterContactRequestMultipleDevicePR:

    1. test_add_contact_field_validation, id: 702777

    Device 1: Tap on found: Button
    ## New multiaccount is created successfully!

    ``` activity_center/test_activity_center.py:175: in test_add_contact_field_validation self.loop.run_until_complete(run_in_parallel(((_device_1_creates_user, {}), /usr/lib/python3.10/asyncio/base_events.py:649: in run_until_complete return future.result() __init__.py:52: in run_in_parallel returns.append(await k) /usr/lib/python3.10/concurrent/futures/thread.py:58: in run result = self.fn(*self.args, **self.kwargs) activity_center/test_activity_center.py:172: in _device_2_sign_in self.device_2.show_profiles_button.wait_and_click() ../views/base_element.py:100: in wait_and_click self.wait_for_visibility_of_element(sec) ../views/base_element.py:147: in wait_for_visibility_of_element raise TimeoutException( Device 2: Button by accessibility id:`show-profiles` is not found on the screen after wait_for_visibility_of_element ```

    Device sessions

    Class TestCommunityOneDeviceMerged:

    1. test_community_discovery, id: 703503

    ## Sign in (password: qwerty1234)
    Device 1: Getting username card by 'first user'

    ``` critical/chats/test_public_chat_browsing.py:246: in test_community_discovery self.sign_in.sign_in(user_name=self.username) ../views/sign_in_view.py:306: in sign_in self.get_user_profile_by_name(user_name).click() ../views/sign_in_view.py:370: in get_user_profile_by_name return expected_element if expected_element.is_element_displayed(10) else self.driver.fail( base_test_case.py:180: in fail pytest.fail('Device %s: %s' % (self.number, text)) Device 1: User first user is not found! ```

    Device sessions

    Passed tests (1)

    Click to expand

    Class TestGroupChatMultipleDeviceMergedNewUI:

    1. test_group_chat_offline_pn, id: 702808
    Device sessions

    pavloburykh commented 3 days ago

    @osmaczko thanks for the PR. e2e results are fine, failures are not PR related. Do we need any additional manual testing of this PR? If yes, could you please provide some details on what specifically should be tested and which areas are affected?

    osmaczko commented 3 days ago

    @osmaczko thanks for the PR. e2e results are fine, failures are not PR related. Do we need any additional manual testing of this PR? If yes, could you please provide some details on what specifically should be tested and which areas are affected?

    @pavloburykh thank you very much. e2e and confirmation from @qfrank is more than enough :ok_hand: