Refactor mam suite - Githubissues

chrzaszcz commented 1 month ago

The goal of this PR is to reduce code repetition and improve maintainability in mam_SUITE, making it possible to easily introduce instrumentation tests.

Export all functions.
Rework init_per_testcase and end_per_testcase.

mongoose-im commented 1 month ago

elasticsearch_and_cassandra_26 / elasticsearch_and_cassandra_mnesia / cd84f679a59e1448df8a1a637019195d89aef3ec Reports root/ big OK: 429 / Failed: 0 / User-skipped: 43 / Auto-skipped: 0

small_tests_25 / small_tests / cd84f679a59e1448df8a1a637019195d89aef3ec Reports root / small

small_tests_26 / small_tests / cd84f679a59e1448df8a1a637019195d89aef3ec Reports root / small

small_tests_26_arm64 / small_tests / cd84f679a59e1448df8a1a637019195d89aef3ec Reports root / small

ldap_mnesia_26 / ldap_mnesia / cd84f679a59e1448df8a1a637019195d89aef3ec Reports root/ big OK: 2275 / Failed: 0 / User-skipped: 895 / Auto-skipped: 0

ldap_mnesia_25 / ldap_mnesia / cd84f679a59e1448df8a1a637019195d89aef3ec Reports root/ big OK: 2275 / Failed: 0 / User-skipped: 895 / Auto-skipped: 0

dynamic_domains_pgsql_mnesia_25 / pgsql_mnesia / cd84f679a59e1448df8a1a637019195d89aef3ec Reports root/ big OK: 4502 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0

dynamic_domains_pgsql_mnesia_26 / pgsql_mnesia / cd84f679a59e1448df8a1a637019195d89aef3ec Reports root/ big OK: 4502 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0

dynamic_domains_mysql_redis_26 / mysql_redis / cd84f679a59e1448df8a1a637019195d89aef3ec Reports root/ big OK: 4468 / Failed: 1 / User-skipped: 144 / Auto-skipped: 0

carboncopy_SUITE:one2one:dropped_client_doesnt_create_duplicate_carbons

```erlang {error, {{badmatch, [{xmlel,<<"message">>, [{<<"from">>, <<"alice_dropped_client_doesnt_create_duplicate_carbons_595@domain.example.com">>}, {<<"to">>, <<"alice_dropped_client_doesnt_create_duplicate_carbons_595@domain.example.com/res2">>}, {<<"xmlns">>,<<"jabber:client">>}, {<<"type">>,<<"chat">>}], [{xmlel,<<"sent">>, [{<<"xmlns">>,<<"urn:xmpp:carbons:2">>}], [{xmlel,<<"forwarded">>, [{<<"xmlns">>,<<"urn:xmpp:forward:0">>}], [{xmlel,<<"message">>, [{<<"from">>, <<"alice_dropped_client_doesnt_create_duplicate_carbons_595@domain.example.com/res1">>}, {<<"type">>,<<"chat">>}, {<<"to">>, <<"bob_dropped_client_doesnt_create_duplicate_carbons_595@domain.example.com/res1">>}, {<<"xmlns">>,<<"jabber:client">>}], [{xmlel,<<"body">>,[], [{xmlcdata, <<"And pious action">>}]}]}]}]}]}]}, [{carboncopy_SUITE, '-dropped_client_doesnt_create_duplicate_carbons/1-fun-0-',4, [{file, "/home/circleci/project/big_tests/tests/carboncopy_SUITE.erl"}, {line,189}]}, {escalus_story,story,4, [{file, "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"}, {line,72}]}, {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]}, {test_server,run_test_c... ``` [Report log](https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4237/210755/mysql_redis.26.1.2-amd64/big/ct_run.test%401adf4394bace.2024-03-07_09.14.49/big_tests.tests.carboncopy_SUITE.logs/run.2024-03-07_09.15.39/carboncopy_suite.dropped_client_doesnt_create_duplicate_carbons.15492.html)

dynamic_domains_mssql_mnesia_26 / odbc_mssql_mnesia / cd84f679a59e1448df8a1a637019195d89aef3ec Reports root/ big OK: 4499 / Failed: 0 / User-skipped: 114 / Auto-skipped: 0

pgsql_cets_26 / pgsql_cets / cd84f679a59e1448df8a1a637019195d89aef3ec Reports root/ big OK: 4425 / Failed: 0 / User-skipped: 178 / Auto-skipped: 0

internal_mnesia_26 / internal_mnesia / cd84f679a59e1448df8a1a637019195d89aef3ec Reports root/ big OK: 2415 / Failed: 0 / User-skipped: 755 / Auto-skipped: 0

pgsql_mnesia_25 / pgsql_mnesia / cd84f679a59e1448df8a1a637019195d89aef3ec Reports root/ big OK: 4891 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0

pgsql_mnesia_26 / pgsql_mnesia / cd84f679a59e1448df8a1a637019195d89aef3ec Reports root/ big OK: 4891 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0

mysql_redis_26 / mysql_redis / cd84f679a59e1448df8a1a637019195d89aef3ec Reports root/ big OK: 4870 / Failed: 0 / User-skipped: 139 / Auto-skipped: 0

mssql_mnesia_26 / odbc_mssql_mnesia / cd84f679a59e1448df8a1a637019195d89aef3ec Reports root/ big OK: 4888 / Failed: 0 / User-skipped: 121 / Auto-skipped: 0

codecov[bot] commented 1 month ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 84.37%. Comparing base (fd0720d) to head (5ea8c57). Report is 9 commits behind head on master.

Additional details and impacted files

```diff @@ Coverage Diff @@ ## master #4237 +/- ## ========================================== + Coverage 84.00% 84.37% +0.36% ========================================== Files 552 552 Lines 33531 33531 ========================================== + Hits 28169 28293 +124 + Misses 5362 5238 -124 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

mongoose-im commented 1 month ago

elasticsearch_and_cassandra_26 / elasticsearch_and_cassandra_mnesia / a35fe79392116e9d2645719f2e76d054600747b2 Reports root/ big OK: 429 / Failed: 0 / User-skipped: 43 / Auto-skipped: 0

small_tests_25 / small_tests / a35fe79392116e9d2645719f2e76d054600747b2 Reports root / small

small_tests_26 / small_tests / a35fe79392116e9d2645719f2e76d054600747b2 Reports root / small

small_tests_26_arm64 / small_tests / a35fe79392116e9d2645719f2e76d054600747b2 Reports root / small

ldap_mnesia_25 / ldap_mnesia / a35fe79392116e9d2645719f2e76d054600747b2 Reports root/ big OK: 2275 / Failed: 0 / User-skipped: 895 / Auto-skipped: 0

ldap_mnesia_26 / ldap_mnesia / a35fe79392116e9d2645719f2e76d054600747b2 Reports root/ big OK: 2275 / Failed: 0 / User-skipped: 895 / Auto-skipped: 0

dynamic_domains_pgsql_mnesia_25 / pgsql_mnesia / a35fe79392116e9d2645719f2e76d054600747b2 Reports root/ big OK: 4502 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0

dynamic_domains_pgsql_mnesia_26 / pgsql_mnesia / a35fe79392116e9d2645719f2e76d054600747b2 Reports root/ big OK: 4502 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0

dynamic_domains_mysql_redis_26 / mysql_redis / a35fe79392116e9d2645719f2e76d054600747b2 Reports root/ big OK: 4469 / Failed: 0 / User-skipped: 144 / Auto-skipped: 0

dynamic_domains_mssql_mnesia_26 / odbc_mssql_mnesia / a35fe79392116e9d2645719f2e76d054600747b2 Reports root/ big OK: 4499 / Failed: 0 / User-skipped: 114 / Auto-skipped: 0

pgsql_cets_26 / pgsql_cets / a35fe79392116e9d2645719f2e76d054600747b2 Reports root/ big OK: 4425 / Failed: 0 / User-skipped: 178 / Auto-skipped: 0

pgsql_mnesia_25 / pgsql_mnesia / a35fe79392116e9d2645719f2e76d054600747b2 Reports root/ big OK: 4891 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0

mysql_redis_26 / mysql_redis / a35fe79392116e9d2645719f2e76d054600747b2 Reports root/ big OK: 4869 / Failed: 1 / User-skipped: 139 / Auto-skipped: 0

carboncopy_SUITE:one2one:dropped_client_doesnt_create_duplicate_carbons

```erlang {error, {{badmatch, [{xmlel,<<"message">>, [{<<"from">>, <<"alice_dropped_client_doesnt_create_duplicate_carbons_588@localhost">>}, {<<"to">>, <<"alice_dropped_client_doesnt_create_duplicate_carbons_588@localhost/res2">>}, {<<"xmlns">>,<<"jabber:client">>}, {<<"type">>,<<"chat">>}], [{xmlel,<<"sent">>, [{<<"xmlns">>,<<"urn:xmpp:carbons:2">>}], [{xmlel,<<"forwarded">>, [{<<"xmlns">>,<<"urn:xmpp:forward:0">>}], [{xmlel,<<"message">>, [{<<"from">>, <<"alice_dropped_client_doesnt_create_duplicate_carbons_588@localhost/res1">>}, {<<"type">>,<<"chat">>}, {<<"to">>, <<"bob_dropped_client_doesnt_create_duplicate_carbons_588@localhost/res1">>}, {<<"xmlns">>,<<"jabber:client">>}], [{xmlel,<<"body">>,[], [{xmlcdata, <<"And pious action">>}]}]}]}]}]}]}, [{carboncopy_SUITE, '-dropped_client_doesnt_create_duplicate_carbons/1-fun-0-',4, [{file, "/home/circleci/project/big_tests/tests/carboncopy_SUITE.erl"}, {line,189}]}, {escalus_story,story,4, [{file, "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"}, {line,72}]}, {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]}, {test_server,run_test_case_eval1,6, [{file,"test_serv... ``` [Report log](https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4237/210791/mysql_redis.26.1.2-amd64/big/ct_run.test%40510f561f7471.2024-03-07_09.32.33/big_tests.tests.carboncopy_SUITE.logs/run.2024-03-07_09.33.22/carboncopy_suite.dropped_client_doesnt_create_duplicate_carbons.15620.html)

pgsql_mnesia_26 / pgsql_mnesia / a35fe79392116e9d2645719f2e76d054600747b2 Reports root/ big OK: 4891 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0

mssql_mnesia_26 / odbc_mssql_mnesia / a35fe79392116e9d2645719f2e76d054600747b2 Reports root/ big OK: 4888 / Failed: 0 / User-skipped: 121 / Auto-skipped: 0

mongoose-im commented 1 month ago

elasticsearch_and_cassandra_26 / elasticsearch_and_cassandra_mnesia / fabb86f5926234dc064fa3d2a73c49d315ca1a91 Reports root/ big OK: 429 / Failed: 0 / User-skipped: 43 / Auto-skipped: 0

small_tests_25 / small_tests / fabb86f5926234dc064fa3d2a73c49d315ca1a91 Reports root / small

small_tests_26 / small_tests / fabb86f5926234dc064fa3d2a73c49d315ca1a91 Reports root / small

small_tests_26_arm64 / small_tests / fabb86f5926234dc064fa3d2a73c49d315ca1a91 Reports root / small

ldap_mnesia_25 / ldap_mnesia / fabb86f5926234dc064fa3d2a73c49d315ca1a91 Reports root/ big OK: 2275 / Failed: 0 / User-skipped: 895 / Auto-skipped: 0

ldap_mnesia_26 / ldap_mnesia / fabb86f5926234dc064fa3d2a73c49d315ca1a91 Reports root/ big OK: 2275 / Failed: 0 / User-skipped: 895 / Auto-skipped: 0

dynamic_domains_pgsql_mnesia_25 / pgsql_mnesia / fabb86f5926234dc064fa3d2a73c49d315ca1a91 Reports root/ big OK: 4502 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0

dynamic_domains_pgsql_mnesia_26 / pgsql_mnesia / fabb86f5926234dc064fa3d2a73c49d315ca1a91 Reports root/ big OK: 4502 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0

dynamic_domains_mysql_redis_26 / mysql_redis / fabb86f5926234dc064fa3d2a73c49d315ca1a91 Reports root/ big OK: 4469 / Failed: 0 / User-skipped: 144 / Auto-skipped: 0

internal_mnesia_26 / internal_mnesia / fabb86f5926234dc064fa3d2a73c49d315ca1a91 Reports root/ big OK: 2415 / Failed: 0 / User-skipped: 755 / Auto-skipped: 0

pgsql_cets_26 / pgsql_cets / fabb86f5926234dc064fa3d2a73c49d315ca1a91 Reports root/ big OK: 4425 / Failed: 0 / User-skipped: 178 / Auto-skipped: 0

dynamic_domains_mssql_mnesia_26 / odbc_mssql_mnesia / fabb86f5926234dc064fa3d2a73c49d315ca1a91 Reports root/ big OK: 4499 / Failed: 0 / User-skipped: 114 / Auto-skipped: 0

pgsql_mnesia_25 / pgsql_mnesia / fabb86f5926234dc064fa3d2a73c49d315ca1a91 Reports root/ big OK: 4891 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0

mysql_redis_26 / mysql_redis / fabb86f5926234dc064fa3d2a73c49d315ca1a91 Reports root/ big OK: 4870 / Failed: 0 / User-skipped: 139 / Auto-skipped: 0

pgsql_mnesia_26 / pgsql_mnesia / fabb86f5926234dc064fa3d2a73c49d315ca1a91 Reports root/ big OK: 4891 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0

mssql_mnesia_26 / odbc_mssql_mnesia / fabb86f5926234dc064fa3d2a73c49d315ca1a91 Reports root/ big OK: 4881 / Failed: 7 / User-skipped: 121 / Auto-skipped: 0

pep_SUITE:pep_tests:pep_caps_test

```erlang {error, {thrown, {{timeout,stream_end}, [{escalus_connection,get_stream_end,2, [{file, "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_connection.erl"}, {line,370}]}, {escalus_connection,end_stream,1, [{file, "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_connection.erl"}, {line,508}]}, {escalus_connection,stop,1, [{file, "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_connection.erl"}, {line,408}]}, {escalus_client,stop,2, [{file, "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_client.erl"}, {line,76}]}, {lists,foreach_1,2,[{file,"lists.erl"},{line,1686}]}, {escalus_story,story,4, [{file, "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"}, {line,76}]}, {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]}, {test_server,run_test_case_eval1,6, [{file,"test_server.erl"},{line,1302}]}]}}} ``` [Report log](https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4237/210853/odbc_mssql_mnesia.26.1.2-amd64/big/ct_run.test%406d120d041555.2024-03-07_11.01.29/big_tests.tests.pep_SUITE.logs/run.2024-03-07_11.19.01/pep_suite.pep_caps_test.125060.html)

pep_SUITE:pep_tests:h_ok_after_notify_test

```erlang {error, {timeout_when_waiting_for_stanza, [{escalus_client,wait_for_stanza, [{client,<<"kate_h_ok_after_notify_test_3492@localhost/res1">>, escalus_tcp,<0.76534.0>, [{event_manager,<0.76492.0>}, {server,<<"localhost">>}, {username,<<"kate_h_ok_after_notify_test_3492">>}, {resource,<<"res1">>}], [{event_client, [{event_manager,<0.76492.0>}, {server,<<"localhost">>}, {username,<<"kate_h_ok_after_notify_test_3492">>}, {resource,<<"res1">>}]}, {resource,<<"res1">>}, {username,<<"kate_h_ok_after_notify_test_3492">>}, {server,<<"localhost">>}, {host,<<"localhost">>}, {port,5222}, {auth,{escalus_auth,auth_plain}}, {wspath,undefined}, {username,<<"kate_h_ok_after_notify_test_3492">>}, {server,<<"localhost">>}, {password,<<"makrowe;p">>}, {stream_management,true}, {stream_id,<<"f7bd9a6c703a4252">>}]}, 5000], [{file, "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_client.erl"}, {line,136}]}, {pep_SUITE,start_caps_clients,2, [{file,"/home/circleci/project/big_tests/tests/pep_SUITE.erl"}, {line,576}]}, {lists,flatmap_1,2,[{file,"lists.erl"},{line,1579}]}, {lists,flatmap_1,2,[{file,"lists.erl"},{line,1579}]}, {escalus_story,story,4, [{fil... ``` [Report log](https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4237/210853/odbc_mssql_mnesia.26.1.2-amd64/big/ct_run.test%406d120d041555.2024-03-07_11.01.29/big_tests.tests.pep_SUITE.logs/run.2024-03-07_11.19.01/pep_suite.h_ok_after_notify_test.126340.html)

pep_SUITE:pep_tests:publish_and_notify_test

```erlang {error,{{assertion_failed,assert_many,false,[is_roster_set],[],[]}, [{escalus_new_assert,assert_true,2, [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_new_assert.erl"}, {line,84}]}, {escalus_story,'-make_all_clients_friends/1-fun-0-',2, [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"}, {line,108}]}, {escalus_utils,'-each_with_index/3-fun-0-',3, [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_utils.erl"}, {line,87}]}, {lists,foldl_1,3,[{file,"lists.erl"},{line,1599}]}, {escalus_utils,'-each_with_index/3-fun-0-',3, [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_utils.erl"}, {line,87}]}, {lists,foldl,3,[{file,"lists.erl"},{line,1594}]}, {escalus_utils,distinct_pairs,2, [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_utils.erl"}, {line,60}]}, {escalus_story,make_all_clients_friends,1, [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"}, {line,106}]}]}} ``` [Report log](https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4237/210853/odbc_mssql_mnesia.26.1.2-amd64/big/ct_run.test%406d120d041555.2024-03-07_11.01.29/big_tests.tests.pep_SUITE.logs/run.2024-03-07_11.19.01/pep_suite.publish_and_notify_test.124932.html)

pep_SUITE:pep_tests:delayed_receive_with_sm

```erlang {error, {timeout_when_waiting_for_stanza, [{escalus_client,wait_for_stanza, [{client,<<"bob_delayed_receive_with_sm_3495@localhost/res1">>, escalus_tcp,<0.76537.0>, [{event_manager,<0.76507.0>}, {server,<<"localhost">>}, {username,<<"bOb_delayed_receive_with_sm_3495">>}, {resource,<<"res1">>}], [{event_client, [{event_manager,<0.76507.0>}, {server,<<"localhost">>}, {username,<<"bOb_delayed_receive_with_sm_3495">>}, {resource,<<"res1">>}]}, {resource,<<"res1">>}, {username,<<"bob_delayed_receive_with_sm_3495">>}, {server,<<"localhost">>}, {host,<<"localhost">>}, {port,5222}, {auth,{escalus_auth,auth_plain}}, {wspath,undefined}, {username,<<"bOb_delayed_receive_with_sm_3495">>}, {server,<<"localhost">>}, {password,<<"makrolika">>}, {stream_id,<<"4b7214258bf4d2e0">>}]}, 5000], [{file, "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_client.erl"}, {line,136}]}, {pep_SUITE,enable_sm,1, [{file,"/home/circleci/project/big_tests/tests/pep_SUITE.erl"}, {line,676}]}, {pep_SUITE,delayed_receive_with_sm_story,3, [{file,"/home/circleci/project/big_tests/tests/pep_SUITE.erl"}, {line,378}]}, {escalus_story,story,4, [{file, "/home/ci... ``` [Report log](https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4237/210853/odbc_mssql_mnesia.26.1.2-amd64/big/ct_run.test%406d120d041555.2024-03-07_11.01.29/big_tests.tests.pep_SUITE.logs/run.2024-03-07_11.19.01/pep_suite.delayed_receive_with_sm.126212.html)

pep_SUITE:pep_tests:disco_sm_items_test

```erlang {error, {timeout_when_waiting_for_stanza, [{escalus_client,wait_for_stanza, [{client,<<"alice_disco_sm_items_test_3489@localhost/res1">>, escalus_tcp,<0.76510.0>, [{event_manager,<0.76477.0>}, {server,<<"localhost">>}, {username,<<"alicE_disco_sm_items_test_3489">>}, {resource,<<"res1">>}], [{event_client, [{event_manager,<0.76477.0>}, {server,<<"localhost">>}, {username,<<"alicE_disco_sm_items_test_3489">>}, {resource,<<"res1">>}]}, {resource,<<"res1">>}, {username,<<"alice_disco_sm_items_test_3489">>}, {server,<<"localhost">>}, {host,<<"localhost">>}, {port,5222}, {auth,{escalus_auth,auth_plain}}, {wspath,undefined}, {username,<<"alicE_disco_sm_items_test_3489">>}, {server,<<"localhost">>}, {password,<<"matygrysa">>}, {stream_id,<<"205a81a56283d650">>}]}, 5000], [{file, "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_client.erl"}, {line,136}]}, {pep_SUITE,'-disco_sm_items_test/1-fun-2-',2, [{file,"/home/circleci/project/big_tests/tests/pep_SUITE.erl"}, {line,184}]}, {escalus_story,story,4, [{file, "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"}, {line,72}]}, {test_server,ts_tc,3,[{file... ``` [Report log](https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4237/210853/odbc_mssql_mnesia.26.1.2-amd64/big/ct_run.test%406d120d041555.2024-03-07_11.01.29/big_tests.tests.pep_SUITE.logs/run.2024-03-07_11.19.01/pep_suite.disco_sm_items_test.125188.html)

pep_SUITE:pep_tests:publish_options_success_test

```erlang {error,{{assertion_failed,assert_many,false,[is_roster_set],[],[]}, [{escalus_new_assert,assert_true,2, [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_new_assert.erl"}, {line,84}]}, {escalus_story,'-make_all_clients_friends/1-fun-0-',2, [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"}, {line,108}]}, {escalus_utils,'-each_with_index/3-fun-0-',3, [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_utils.erl"}, {line,87}]}, {lists,foldl_1,3,[{file,"lists.erl"},{line,1599}]}, {escalus_utils,'-each_with_index/3-fun-0-',3, [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_utils.erl"}, {line,87}]}, {lists,foldl,3,[{file,"lists.erl"},{line,1594}]}, {escalus_utils,distinct_pairs,2, [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_utils.erl"}, {line,60}]}, {escalus_story,make_all_clients_friends,1, [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"}, {line,106}]}]}} ``` [Report log](https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4237/210853/odbc_mssql_mnesia.26.1.2-amd64/big/ct_run.test%406d120d041555.2024-03-07_11.01.29/big_tests.tests.pep_SUITE.logs/run.2024-03-07_11.19.01/pep_suite.publish_options_success_test.125316.html)

pep_SUITE:pep_tests:delayed_receive

```erlang {error, {{assertion_failed,assert_many,false, [is_message,is_iq,is_presence,is_presence], [{xmlel,<<"iq">>, [{<<"from">>,<<"bob_delayed_receive_3491@localhost">>}, {<<"to">>,<<"bob_delayed_receive_3491@localhost/res1">>}, {<<"id">>,<<"pushe73c38e69832b1d6">>}, {<<"type">>,<<"set">>}], [{xmlel,<<"query">>, [{<<"xmlns">>,<<"jabber:iq:roster">>}], [{xmlel,<<"item">>, [{<<"jid">>, <<"alice_delayed_receive_3491@localhost">>}, {<<"subscription">>,<<"to">>}], []}]}]}, {xmlel,<<"presence">>, [{<<"from">>,<<"alice_delayed_receive_3491@localhost">>}, {<<"to">>,<<"bob_delayed_receive_3491@localhost/res1">>}, {<<"type">>,<<"subscribed">>}], []}, {xmlel,<<"presence">>, [{<<"from">>,<<"alice_delayed_receive_3491@localhost/res1">>}, {<<"to">>,<<"bob_delayed_receive_3491@localhost/res1">>}], []}], " "}, [{escalus_new_assert,a... ``` [Report log](https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4237/210853/odbc_mssql_mnesia.26.1.2-amd64/big/ct_run.test%406d120d041555.2024-03-07_11.01.29/big_tests.tests.pep_SUITE.logs/run.2024-03-07_11.19.01/pep_suite.delayed_receive.126084.html)

mongoose-im commented 1 month ago

elasticsearch_and_cassandra_26 / elasticsearch_and_cassandra_mnesia / dfe55300b7464b91596376ecf4b7ce9bebad65dd Reports root/ big OK: 429 / Failed: 0 / User-skipped: 43 / Auto-skipped: 0

small_tests_25 / small_tests / dfe55300b7464b91596376ecf4b7ce9bebad65dd Reports root / small

small_tests_26 / small_tests / dfe55300b7464b91596376ecf4b7ce9bebad65dd Reports root / small

small_tests_26_arm64 / small_tests / dfe55300b7464b91596376ecf4b7ce9bebad65dd Reports root / small

ldap_mnesia_25 / ldap_mnesia / dfe55300b7464b91596376ecf4b7ce9bebad65dd Reports root/ big OK: 2275 / Failed: 0 / User-skipped: 895 / Auto-skipped: 0

dynamic_domains_mysql_redis_26 / mysql_redis / dfe55300b7464b91596376ecf4b7ce9bebad65dd Reports root/ big OK: 4469 / Failed: 0 / User-skipped: 144 / Auto-skipped: 0

dynamic_domains_pgsql_mnesia_25 / pgsql_mnesia / dfe55300b7464b91596376ecf4b7ce9bebad65dd Reports root/ big OK: 4502 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0

dynamic_domains_pgsql_mnesia_26 / pgsql_mnesia / dfe55300b7464b91596376ecf4b7ce9bebad65dd Reports root/ big OK: 4502 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0

internal_mnesia_26 / internal_mnesia / dfe55300b7464b91596376ecf4b7ce9bebad65dd Reports root/ big OK: 2415 / Failed: 0 / User-skipped: 755 / Auto-skipped: 0

dynamic_domains_mssql_mnesia_26 / odbc_mssql_mnesia / dfe55300b7464b91596376ecf4b7ce9bebad65dd Reports root/ big OK: 4498 / Failed: 1 / User-skipped: 114 / Auto-skipped: 0

auth_methods_for_c2s_SUITE:two_methods_enabled:can_login_with_allowed_method

```erlang {error, {"Expected stream features, got {xmlel,<<\"stream:error\">>,[],\n [{xmlel,<<\"host-unknown\">>,\n [{<<\"xmlns\">>,\n <<\"urn:ietf:params:xml:ns:xmpp-streams\">>}],\n []}]}", [{escalus_session,assert_stream_features,3, [{file, "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_session.erl"}, {line,291}]}, {escalus_session,stream_features,2, [{file, "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_session.erl"}, {line,190}]}, {escalus_connection,connection_step,2, [{file, "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_connection.erl"}, {line,161}]}, {lists,foldl_1,3,[{file,"lists.erl"},{line,1599}]}, {escalus_connection,start,2, [{file, "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_connection.erl"}, {line,145}]}, {auth_methods_for_c2s_SUITE,can_login_with_allowed_method,1, [{file, "/home/circleci/project/big_tests/tests/auth_methods_for_c2s_SUITE.erl"}, {line,85}]}, {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]}, {test_server,run_test_case_eval1,6, [{file,"test_server.erl"},{line,1302}]}]}} ``` [Report log](https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4237/210913/odbc_mssql_mnesia.26.1.2-amd64/big/ct_run.test%4001b85ac9d23e.2024-03-07_19.25.17/big_tests.tests.auth_methods_for_c2s_SUITE.logs/run.2024-03-07_19.25.43/auth_methods_for_c2s_suite.can_login_with_allowed_method.12546.html)

pgsql_cets_26 / pgsql_cets / dfe55300b7464b91596376ecf4b7ce9bebad65dd Reports root/ big OK: 4425 / Failed: 0 / User-skipped: 178 / Auto-skipped: 0

mysql_redis_26 / mysql_redis / dfe55300b7464b91596376ecf4b7ce9bebad65dd Reports root/ big OK: 4870 / Failed: 0 / User-skipped: 139 / Auto-skipped: 0

pgsql_mnesia_25 / pgsql_mnesia / dfe55300b7464b91596376ecf4b7ce9bebad65dd Reports root/ big OK: 4891 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0

pgsql_mnesia_26 / pgsql_mnesia / dfe55300b7464b91596376ecf4b7ce9bebad65dd Reports root/ big OK: 4891 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0

mssql_mnesia_26 / odbc_mssql_mnesia / dfe55300b7464b91596376ecf4b7ce9bebad65dd Reports root/ big OK: 4888 / Failed: 0 / User-skipped: 121 / Auto-skipped: 0

dynamic_domains_mssql_mnesia_26 / odbc_mssql_mnesia / dfe55300b7464b91596376ecf4b7ce9bebad65dd Reports root/ big OK: 4498 / Failed: 1 / User-skipped: 114 / Auto-skipped: 0

graphql_muc_light_SUITE:domain_admin:domain_admin_muc_light:admin_create_room_with_unprepped_id

```erlang {error, {{badmatch,null}, [{graphql_muc_light_SUITE,admin_create_room_with_unprepped_id,1, [{file, "/home/circleci/project/big_tests/tests/graphql_muc_light_SUITE.erl"}, {line,1155}]}, {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]}, {test_server,run_test_case_eval1,6, [{file,"test_server.erl"},{line,1302}]}, {test_server,run_test_case_eval,9, [{file,"test_server.erl"},{line,1234}]}]}} ``` [Report log](https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4237/210924/odbc_mssql_mnesia.26.1.2-amd64/big/ct_run.test%400ad40828829f.2024-03-08_07.34.48/big_tests.tests.graphql_muc_light_SUITE.logs/run.2024-03-08_07.39.36/graphql_muc_light_suite.admin_create_room_with_unprepped_id.38147.html)

mongoose-im commented 1 month ago

elasticsearch_and_cassandra_26 / elasticsearch_and_cassandra_mnesia / 3d5ffe08a666286a545564771a68425fd2d8c157 Reports root/ big OK: 429 / Failed: 0 / User-skipped: 43 / Auto-skipped: 0

small_tests_25 / small_tests / 3d5ffe08a666286a545564771a68425fd2d8c157 Reports root / small

small_tests_26 / small_tests / 3d5ffe08a666286a545564771a68425fd2d8c157 Reports root / small

small_tests_26_arm64 / small_tests / 3d5ffe08a666286a545564771a68425fd2d8c157 Reports root / small

dynamic_domains_mysql_redis_26 / mysql_redis / 3d5ffe08a666286a545564771a68425fd2d8c157 Reports root/ big OK: 4469 / Failed: 0 / User-skipped: 144 / Auto-skipped: 0

ldap_mnesia_26 / ldap_mnesia / 3d5ffe08a666286a545564771a68425fd2d8c157 Reports root/ big OK: 2275 / Failed: 0 / User-skipped: 895 / Auto-skipped: 0

ldap_mnesia_25 / ldap_mnesia / 3d5ffe08a666286a545564771a68425fd2d8c157 Reports root/ big OK: 2275 / Failed: 0 / User-skipped: 895 / Auto-skipped: 0

dynamic_domains_pgsql_mnesia_25 / pgsql_mnesia / 3d5ffe08a666286a545564771a68425fd2d8c157 Reports root/ big OK: 4502 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0

internal_mnesia_26 / internal_mnesia / 3d5ffe08a666286a545564771a68425fd2d8c157 Reports root/ big OK: 2414 / Failed: 1 / User-skipped: 755 / Auto-skipped: 0

sm_SUITE:ping_timeout

```erlang {error, {{assertion_failed,assert,is_presence, {xmlel,<<"iq">>, [{<<"from">>,<<"localhost">>}, {<<"to">>, <<"alice_ping_timeout_1984@localhost/escalus-default-resource">>}, {<<"type">>,<<"get">>}, {<<"id">>,<<"72a85fe8c126ad8a">>}], [{xmlel,<<"ping">>,[{<<"xmlns">>,<<"urn:xmpp:ping">>}],[]}]}, ""}, [{escalus_new_assert,assert_true,2, [{file, "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_new_assert.erl"}, {line,84}]}, {sm_helper,initial_presence_step,2, [{file,"/home/circleci/project/big_tests/tests/sm_helper.erl"}, {line,135}]}, {escalus_connection,connection_step,2, [{file, "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_connection.erl"}, {line,163}]}, {lists,foldl_1,3,[{file,"lists.erl"},{line,1599}]}, {escalus_connection,start,2, [{file, "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_connection.erl"}, {line,145}]}, {sm_helper,connect_spec,3, [{file,"/home/circleci/project/big_tests/tests/sm_helper.erl"}, {line,153}]}, {sm_SUITE,ping_timeout,1, [{file,"/home/circleci/project/big_tests/tests/sm_SUITE.erl"}, {line,625}]}, {test_server,ts_tc,3,[{file,"test_ser... ``` [Report log](https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4237/210945/internal_mnesia.26.1.2-amd64/big/ct_run.test%400e6787f31890.2024-03-08_08.27.14/big_tests.tests.sm_SUITE.logs/run.2024-03-08_08.42.36/sm_suite.ping_timeout.html)

dynamic_domains_mssql_mnesia_26 / odbc_mssql_mnesia / 3d5ffe08a666286a545564771a68425fd2d8c157 Reports root/ big OK: 4499 / Failed: 0 / User-skipped: 114 / Auto-skipped: 0

graphql_muc_light_SUITE:admin_cli:admin_muc_light:end_per_group

```erlang {error, {{unregistering_failed, {amount,1}, {unregistered_items, [{{<<"_admin_blocking_list_null_1078">>, [{escalus_event_mgr,<0.24393.0>}, {tc_name,admin_blocking_list_null}, {escalus_cleaner,<0.24392.0>}, {watchdog,<0.24391.0>}, {muc_light_host,<<"muclight.domain.example.com">>}, {secondary_muc_light_host,<<"muclight.domain.example.org">>}, {protocol,cli}, {schema_endpoint,admin}, {{ejabberd_cwd,mongooseim@localhost}, "/home/circleci/project/_build/mim1/rel/mongooseim"}, {preset,"odbc_mssql_mnesia"}, {mim_data_dir, "/home/circleci/project/big_tests/tests/graphql_muc_light_SUITE_data"}, {tc_logfile, "https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4237/210958/odbc_mssql_mnesia.26.1.2-amd64/big/ct_run.test%4046dc86aa53db.2024-03-08_08.27.23/big_tests.tests.graphql_muc_light_SUITE.logs/run.2024-03-08_08.31.37/graphql_muc_light_suite.admin_blocking_list_null.51586.html"}, {tc_group_properties,[{name,admin_muc_light}]}, {tc_group_path,[[{name,admin_cli}]]}, {data_dir, "/home/circleci/project/big_tests/_build/default/lib/mongoose_tests/ebin/graphql_muc_light_SUITE_data/"}, {priv_dir, "https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4237/210958/odbc_mssql_mnesia.26.1.2-amd64/big/ct_run.test%4046dc86aa53db.2024-03-08_08.27.23/big_tests.tests.graphql_muc_light_SUITE.logs/run.2024-03-08_08.31.37/log_private/"}, {{saved_modules,mongooseim@localhost,<<"test type">>}, #{mod_vcard => #{matches => 30, host => {prefix,<<"vjud.">>}, search => true,iqdisc => parallel,ba... ``` [Report log](https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4237/210958/odbc_mssql_mnesia.26.1.2-amd64/big/ct_run.test%4046dc86aa53db.2024-03-08_08.27.23/big_tests.tests.graphql_muc_light_SUITE.logs/run.2024-03-08_08.31.37/graphql_muc_light_suite.end_per_group.51842.html)

pgsql_cets_26 / pgsql_cets / 3d5ffe08a666286a545564771a68425fd2d8c157 Reports root/ big OK: 4425 / Failed: 0 / User-skipped: 178 / Auto-skipped: 0

pgsql_mnesia_25 / pgsql_mnesia / 3d5ffe08a666286a545564771a68425fd2d8c157 Reports root/ big OK: 4891 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0

dynamic_domains_pgsql_mnesia_26 / pgsql_mnesia / 3d5ffe08a666286a545564771a68425fd2d8c157 Reports root/ big OK: 4501 / Failed: 1 / User-skipped: 111 / Auto-skipped: 0

graphql_session_SUITE:admin_session:admin_session_cli:admin_count_users_with_status

```erlang {error, {{assertEqual, [{module,graphql_session_SUITE}, {line,586}, {expression,"Count"}, {expected,2}, {value,0}]}, [{graphql_session_SUITE,assert_count_users_with_status,4, [{file, "/home/circleci/project/big_tests/tests/graphql_session_SUITE.erl"}, {line,586}]}, {graphql_session_SUITE,admin_count_users_with_status_story,3, [{file, "/home/circleci/project/big_tests/tests/graphql_session_SUITE.erl"}, {line,391}]}, {escalus_story,story,4, [{file, "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"}, {line,72}]}, {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]}, {test_server,run_test_case_eval1,6, [{file,"test_server.erl"},{line,1302}]}, {test_server,run_test_case_eval,9, [{file,"test_server.erl"},{line,1234}]}]}} ``` [Report log](https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4237/210959/pgsql_mnesia.26.1.2-amd64/big/ct_run.test%40e3df71bad646.2024-03-08_08.27.14/big_tests.tests.graphql_session_SUITE.logs/run.2024-03-08_08.33.36/graphql_session_suite.admin_count_users_with_status.40964.html)

mysql_redis_26 / mysql_redis / 3d5ffe08a666286a545564771a68425fd2d8c157 Reports root/ big OK: 4870 / Failed: 0 / User-skipped: 139 / Auto-skipped: 0

pgsql_mnesia_26 / pgsql_mnesia / 3d5ffe08a666286a545564771a68425fd2d8c157 Reports root/ big OK: 4891 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0

mssql_mnesia_26 / odbc_mssql_mnesia / 3d5ffe08a666286a545564771a68425fd2d8c157 Reports root/ big OK: 4887 / Failed: 1 / User-skipped: 121 / Auto-skipped: 0

graphql_muc_light_SUITE:domain_admin:domain_admin_muc_light:admin_create_room_with_unprepped_id

```erlang {error, {{badmatch,null}, [{graphql_muc_light_SUITE,admin_create_room_with_unprepped_id,1, [{file, "/home/circleci/project/big_tests/tests/graphql_muc_light_SUITE.erl"}, {line,1155}]}, {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]}, {test_server,run_test_case_eval1,6, [{file,"test_server.erl"},{line,1302}]}, {test_server,run_test_case_eval,9, [{file,"test_server.erl"},{line,1234}]}]}} ``` [Report log](https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4237/210956/odbc_mssql_mnesia.26.1.2-amd64/big/ct_run.test%40f22753f8fe2a.2024-03-08_08.27.16/big_tests.tests.graphql_muc_light_SUITE.logs/run.2024-03-08_08.31.33/graphql_muc_light_suite.admin_create_room_with_unprepped_id.58754.html)

mongoose-im commented 1 month ago

elasticsearch_and_cassandra_26 / elasticsearch_and_cassandra_mnesia / 5ea8c573dcfa6906e2196e2498bc64b179bf8a88 Reports root/ big OK: 429 / Failed: 0 / User-skipped: 43 / Auto-skipped: 0

small_tests_25 / small_tests / 5ea8c573dcfa6906e2196e2498bc64b179bf8a88 Reports root / small

small_tests_26 / small_tests / 5ea8c573dcfa6906e2196e2498bc64b179bf8a88 Reports root / small

small_tests_26_arm64 / small_tests / 5ea8c573dcfa6906e2196e2498bc64b179bf8a88 Reports root / small

ldap_mnesia_25 / ldap_mnesia / 5ea8c573dcfa6906e2196e2498bc64b179bf8a88 Reports root/ big OK: 2275 / Failed: 0 / User-skipped: 895 / Auto-skipped: 0

dynamic_domains_mysql_redis_26 / mysql_redis / 5ea8c573dcfa6906e2196e2498bc64b179bf8a88 Reports root/ big OK: 4469 / Failed: 0 / User-skipped: 144 / Auto-skipped: 0

ldap_mnesia_26 / ldap_mnesia / 5ea8c573dcfa6906e2196e2498bc64b179bf8a88 Reports root/ big OK: 2275 / Failed: 0 / User-skipped: 895 / Auto-skipped: 0

dynamic_domains_pgsql_mnesia_25 / pgsql_mnesia / 5ea8c573dcfa6906e2196e2498bc64b179bf8a88 Reports root/ big OK: 4502 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0

dynamic_domains_pgsql_mnesia_26 / pgsql_mnesia / 5ea8c573dcfa6906e2196e2498bc64b179bf8a88 Reports root/ big OK: 4502 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0

internal_mnesia_26 / internal_mnesia / 5ea8c573dcfa6906e2196e2498bc64b179bf8a88 Reports root/ big OK: 2415 / Failed: 0 / User-skipped: 755 / Auto-skipped: 0

pgsql_cets_26 / pgsql_cets / 5ea8c573dcfa6906e2196e2498bc64b179bf8a88 Reports root/ big OK: 4425 / Failed: 0 / User-skipped: 178 / Auto-skipped: 0

mysql_redis_26 / mysql_redis / 5ea8c573dcfa6906e2196e2498bc64b179bf8a88 Reports root/ big OK: 4870 / Failed: 0 / User-skipped: 139 / Auto-skipped: 0

dynamic_domains_mssql_mnesia_26 / odbc_mssql_mnesia / 5ea8c573dcfa6906e2196e2498bc64b179bf8a88 Reports root/ big OK: 4499 / Failed: 0 / User-skipped: 114 / Auto-skipped: 0

pgsql_mnesia_25 / pgsql_mnesia / 5ea8c573dcfa6906e2196e2498bc64b179bf8a88 Reports root/ big OK: 4891 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0

pgsql_mnesia_26 / pgsql_mnesia / 5ea8c573dcfa6906e2196e2498bc64b179bf8a88 Reports root/ big OK: 4891 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0

mssql_mnesia_26 / odbc_mssql_mnesia / 5ea8c573dcfa6906e2196e2498bc64b179bf8a88 Reports root/ big OK: 4887 / Failed: 1 / User-skipped: 121 / Auto-skipped: 0

sm_SUITE:ping_timeout

```erlang {error,{noproc,{gen_server,call,[<0.95254.0>,get_sm_h]}}} ``` [Report log](https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4237/210981/odbc_mssql_mnesia.26.1.2-amd64/big/ct_run.test%40b4a0c91ec9fd.2024-03-08_08.34.43/big_tests.tests.sm_SUITE.logs/run.2024-03-08_08.53.53/sm_suite.ping_timeout.html)

mssql_mnesia_26 / odbc_mssql_mnesia / 5ea8c573dcfa6906e2196e2498bc64b179bf8a88 Reports root/ big OK: 4888 / Failed: 0 / User-skipped: 121 / Auto-skipped: 0

esl / MongooseIM

Refactor mam suite #4237

Codecov Report