Integration tests failing on ARM

[maxknv]

• [x] test_profile_max_sessions_for_user/test.py::test_profile_max_sessions_for_user_tcp_and_others
• [x] test_profile_max_sessions_for_user/test.py::test_profile_max_sessions_for_user_grpc
• [x] test_grpc_protocol_ssl/test.py::test_secure_channel
• [x] test_non_default_compression/test.py::test_preconfigured_deflateqpl_codec

report

• [x] test_server_reload/test.py::test_change_grpc_port
• [x] test_server_reload/test.py::test_remove_grpc_port
• [x] test_disk_types/test.py::test_different_types
• [x] test_backward_compatibility/test_short_strings_aggregation.py::test_backward_compatability
• [x] test_disk_types/test.py::test_select_by_type
• [x] test_session_log/test.py::test_parallel_sessions
• [x] test_session_log/test.py::test_grpc_session

report

• [x] test_catboost_evaluate/test.py::testAmazonModelManyRows
• [x] test_catboost_evaluate/test.py::testAmazonModelSingleRow
• [x] test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString
• [x] test_catboost_evaluate/test.py::testConstantFeatures
• [x] test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric
• [x] test_catboost_evaluate/test.py::testModelUpdate
• [x] test_catboost_evaluate/test.py::testNonConstantFeatures
• [x] test_catboost_evaluate/test.py::testOnLowCardinalityFeatures
• [x] test_catboost_evaluate/test.py::testOnNullableFeatures
• [x] test_catboost_evaluate/test.py::testRecoveryAfterCrash
• [x] test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh
• [x] test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments
• [x] test_send_crash_reports/test.py::test_send_segfault

report

• [x] test_crash_log/test.py::test_pkill
• [x] test_crash_log/test.py::test_pkill_query_log
• [x] test_backup_restore_on_cluster/test.py::test_replicated_database_async
• [x] test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries
• [x] test_backup_restore_on_cluster/test.py::test_replicated_database
• [x] test_odbc_interaction/test.py::test_postgres_insert
• [x] test_odbc_interaction/test.py::test_many_connections
• [x] test_odbc_interaction/test.py::test_sqlite_simple_select_function_works
• [x] test_odbc_interaction/test.py::test_sqlite_table_function
• [x] test_odbc_interaction/test.py::test_odbc_postgres_conversions
• [x] test_odbc_interaction/test.py::test_odbc_postgres_date_data_type
• [x] test_odbc_interaction/test.py::test_postgres_odbc_hashed_dictionary_with_schema
• [x] test_odbc_interaction/test.py::test_odbc_long_text
• [x] test_odbc_interaction/test.py::test_sqlite_simple_select_storage_works
• [x] test_odbc_interaction/test.py::test_sqlite_odbc_hashed_dictionary
• [x] test_odbc_interaction/test.py::test_no_connection_pooling
• [x] test_odbc_interaction/test.py::test_mysql_simple_select_works
• [x] test_odbc_interaction/test.py::test_odbc_cyrillic_with_varchar
• [x] test_odbc_interaction/test.py::test_mysql_insert
• [x] test_odbc_interaction/test.py::test_odbc_long_column_names
• [x] test_odbc_interaction/test.py::test_sqlite_odbc_cached_dictionary
• [x] test_odbc_interaction/test.py::test_concurrent_queries
• [x] test_odbc_interaction/test.py::test_postgres_odbc_hashed_dictionary_no_tty_pipe_overflow

report

[alesapin]

test_backup_restore_on_cluster was just flaky, works locally:

PASSED
test_backup_restore_on_cluster/test.py::test_empty_replicated_table PASSED
test_backup_restore_on_cluster/test.py::test_replicated_database PASSED
test_backup_restore_on_cluster/test.py::test_replicated_database_compare_parts PASSED
test_backup_restore_on_cluster/test.py::test_different_tables_on_nodes PASSED
test_backup_restore_on_cluster/test.py::test_backup_restore_on_single_replica PASSED
test_backup_restore_on_cluster/test.py::test_table_with_parts_in_queue_considered_non_empty PASSED
test_backup_restore_on_cluster/test.py::test_replicated_table_with_uuid_in_zkpath PASSED
test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_insert PASSED
test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_merge PASSED
test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_bigger_cluster PASSED
test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_smaller_cluster PASSED
test_backup_restore_on_cluster/test.py::test_replicated_database_async PASSED
test_backup_restore_on_cluster/test.py::test_replicated_database_with_special_macro_in_zk_path[uuid] PASSED
test_backup_restore_on_cluster/test.py::test_replicated_database_with_special_macro_in_zk_path[database] PASSED
test_backup_restore_on_cluster/test.py::test_keeper_value_max_size PASSED
test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[native-True] PASSED
test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-True] PASSED
test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-False] PASSED
test_backup_restore_on_cluster/test.py::test_required_privileges PASSED
test_backup_restore_on_cluster/test.py::test_system_users PASSED
test_backup_restore_on_cluster/test.py::test_system_functions PASSED
test_backup_restore_on_cluster/test.py::test_projection PASSED
test_backup_restore_on_cluster/test.py::test_file_deduplication PASSED
test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_def PASSED
test_backup_restore_on_cluster/test.py::test_table_in_replicated_database_with_not_synced_def PASSED
test_backup_restore_on_cluster/test.py::test_mutation PASSED
test_backup_restore_on_cluster/test.py::test_tables_dependency PASSED
test_backup_restore_on_cluster/test.py::test_get_error_from_other_host PASSED
test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[False] PASSED
test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[True] PASSED

========================================================================================== 31 passed in 488.91s (0:08:08) ==========================================================================================

[alesapin]

The same for test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries:

sudo -E pytest -ss  test_checking_s3_blobs_paranoid/test.py 
=============================================================================================== test session starts ================================================================================================
platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.4.0
rootdir: /home/ubuntu/code/cpp/ClickHouse/tests/integration
configfile: pytest.ini
plugins: order-1.0.0, xdist-3.5.0, random-0.2, reportlog-0.4.0, repeat-0.9.3, timeout-2.2.0
timeout: 900.0s
timeout method: signal
timeout func_only: False
collected 27 items                                                                                                                                                                                                 

test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works Copy common default production configuration from /home/ubuntu/code/cpp/ClickHouse/programs/server. Files: config.xml, users.xml
Copy common default production configuration from /home/ubuntu/code/cpp/ClickHouse/programs/server. Files: config.xml, users.xml
PASSED
test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none] PASSED
test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip] PASSED
test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br] PASSED
test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz] PASSED
test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd] PASSED
test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2] PASSED
test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate] PASSED
test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4] PASSED
test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none] PASSED
test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip] PASSED
test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br] PASSED
test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz] PASSED
test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd] PASSED
test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2] PASSED
test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate] PASSED
test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4] PASSED
test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_refused_is_retried PASSED
test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[True] PASSED
test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[False] PASSED  
test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[True] PASSED
test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[False] PASSED
test_checking_s3_blobs_paranoid/test.py::test_when_s3_broken_pipe_at_upload_is_retried PASSED
test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries PASSED
test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node] PASSED
test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries] PASSED
test_checking_s3_blobs_paranoid/test.py::test_no_key_found_disk PASSED

========================================================================================== 27 passed in 243.24s (0:04:03) ==========================================================================================

[alesapin]

test_grpc_protocol_ssl/test.py works:

sudo -E pytest -ss   test_grpc_protocol_ssl/test.py 
=============================================================================================== test session starts ================================================================================================
platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.4.0
rootdir: /home/ubuntu/code/cpp/ClickHouse/tests/integration
configfile: pytest.ini
plugins: order-1.0.0, xdist-3.5.0, random-0.2, reportlog-0.4.0, repeat-0.9.3, timeout-2.2.0
timeout: 900.0s
timeout method: signal
timeout func_only: False
collected 3 items                                                                                                                                                                                                  

test_grpc_protocol_ssl/test.py::test_secure_channel Copy common default production configuration from /home/ubuntu/code/cpp/ClickHouse/programs/server. Files: config.xml, users.xml
PASSED
test_grpc_protocol_ssl/test.py::test_insecure_channel PASSED
test_grpc_protocol_ssl/test.py::test_wrong_client_certificate PASSED

================================================================================================ 3 passed in 31.06s ================================================================================================

[alesapin]

The same for test_server_reload:

sudo -E pytest -ss    test_server_reload/test.py
=============================================================================================== test session starts ================================================================================================
platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.4.0
rootdir: /home/ubuntu/code/cpp/ClickHouse/tests/integration
configfile: pytest.ini
plugins: order-1.0.0, xdist-3.5.0, random-0.2, reportlog-0.4.0, repeat-0.9.3, timeout-2.2.0
timeout: 900.0s
timeout method: signal
timeout func_only: False
collected 13 items                                                                                                                                                                                                 

test_server_reload/test.py::test_change_tcp_port Copy common default production configuration from /home/ubuntu/code/cpp/ClickHouse/programs/server. Files: config.xml, users.xml
PASSED
test_server_reload/test.py::test_change_http_port PASSED
test_server_reload/test.py::test_change_mysql_port PASSED
test_server_reload/test.py::test_change_postgresql_port PASSED
test_server_reload/test.py::test_change_grpc_port PASSED
test_server_reload/test.py::test_remove_tcp_port PASSED
test_server_reload/test.py::test_remove_http_port PASSED
test_server_reload/test.py::test_remove_mysql_port PASSED
test_server_reload/test.py::test_remove_postgresql_port PASSED
test_server_reload/test.py::test_remove_grpc_port PASSED
test_server_reload/test.py::test_change_listen_host PASSED
test_server_reload/test.py::test_reload_via_client PASSED
test_server_reload/test.py::test_change_http_handlers PASSED

========================================================================================== 13 passed in 139.76s (0:02:19) ==========================================================================================

[alesapin]

The same for test_session_log/test.py:

sudo -E pytest -ss   test_session_log/test.py
=============================================================================================== test session starts ================================================================================================
platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.4.0
rootdir: /home/ubuntu/code/cpp/ClickHouse/tests/integration
configfile: pytest.ini
plugins: order-1.0.0, xdist-3.5.0, random-0.2, reportlog-0.4.0, repeat-0.9.3, timeout-2.2.0
timeout: 900.0s
timeout method: signal
timeout func_only: False
collected 4 items                                                                                                                                                                                                  

test_session_log/test.py::test_grpc_session Copy common default production configuration from /home/ubuntu/code/cpp/ClickHouse/programs/server. Files: config.xml, users.xml
PASSED
test_session_log/test.py::test_mysql_session PASSED
test_session_log/test.py::test_postgres_session PASSED
test_session_log/test.py::test_parallel_sessions PASSED

================================================================================================ 4 passed in 59.27s ================================================================================================

[alesapin]

The same for test_profile_max_sessions_for_user

sudo -E pytest -ss test_profile_max_sessions_for_user/test.py
=============================================================================================== test session starts ================================================================================================
platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.4.0
rootdir: /home/ubuntu/code/cpp/ClickHouse/tests/integration
configfile: pytest.ini
plugins: order-1.0.0, xdist-3.5.0, random-0.2, reportlog-0.4.0, repeat-0.9.3, timeout-2.2.0
timeout: 900.0s
timeout method: signal
timeout func_only: False
collected 9 items                                                                                                                                                                                                  

test_profile_max_sessions_for_user/test.py::test_profile_max_sessions_for_user_tcp Copy common default production configuration from /home/ubuntu/code/cpp/ClickHouse/programs/server. Files: config.xml, users.xml
PASSED
test_profile_max_sessions_for_user/test.py::test_profile_max_sessions_for_user_postgres PASSED
test_profile_max_sessions_for_user/test.py::test_profile_max_sessions_for_user_mysql PASSED
test_profile_max_sessions_for_user/test.py::test_profile_max_sessions_for_user_http PASSED
test_profile_max_sessions_for_user/test.py::test_profile_max_sessions_for_user_http_named_session PASSED
test_profile_max_sessions_for_user/test.py::test_profile_max_sessions_for_user_grpc PASSED
test_profile_max_sessions_for_user/test.py::test_profile_max_sessions_for_user_tcp_and_others PASSED
test_profile_max_sessions_for_user/test.py::test_profile_max_sessions_for_user_setting_in_query PASSED
test_profile_max_sessions_for_user/test.py::test_profile_max_sessions_for_user_client_suggestions_connection PASSED

================================================================================================= warnings summary =================================================================================================
helpers/uclient.py:11
  /home/ubuntu/code/cpp/ClickHouse/tests/integration/helpers/uclient.py:11: DeprecationWarning: invalid escape sequence '\)'
    prompt = ":\) "

helpers/uclient.py:24
  /home/ubuntu/code/cpp/ClickHouse/tests/integration/helpers/uclient.py:24: DeprecationWarning: invalid escape sequence '\$'
    self.client.expect("[#\$] ", timeout=2)

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
========================================================================================== 9 passed, 2 warnings in 55.88s ==========================================================================================

[maxknv]

test_crash_log/test.py::test_pkill test_crash_log/test.py::test_pkill_query_log test_send_crash_reports/test.py::test_send_segfault

Issue created: https://github.com/ClickHouse/ClickHouse/issues/63855

[maxknv]

still not resolved in CI:

report:

• [x] test_profile_max_sessions_for_user/test.py::test_profile_max_sessions_for_user_grpc
• [x] test_profile_max_sessions_for_user/test.py::test_profile_max_sessions_for_user_tcp_and_other
• [x] test_grpc_protocol_ssl/test.py::test_secure_channel

report:

• [x] test_server_reload/test.py::test_remove_grpc_port
• [x] test_server_reload/test.py::test_change_grpc_port
• [x] test_session_log/test.py::test_grpc_session
• [x] test_session_log/test.py::test_parallel_sessions

report:

• [x] test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries

[alesapin]

Fixes tests from Max's comment https://github.com/ClickHouse/ClickHouse/pull/64072 except test_checking_s3_blobs_paranoid (cannot repro)

[alesapin]

Only kerberized kafra fails on ARM