Some suites run the same testcase several times
This means a duplicate key error could occure when registering a new user
This also means some random stanzas would come from another cases
It is especially visible when two cases run in parallel (but it is not a requirement)
bOb_notify_deliver_to_online_user_recipient_privacy_test_86.765794@localhost/res1 in
<stream:error>
<conflict xmlns='urn:ietf:params:xml:ns:xmpp-streams'/>
<text xml:lang='en' xmlns='urn:ietf:params:xml:ns:xmpp-streams'>Replaced by new connection</text>
</stream:error>
You can think, wtf, we use escalus:fresh_story and there is only one story function in the case. Yeah, but amp suite implements a complex trick to run the same testcase several times with different configs. And apparently, circle CI reproduces a collision in suffixes very well (impossible to reproduce on my machine though...)
Some suites run the same testcase several times This means a duplicate key error could occure when registering a new user This also means some random stanzas would come from another cases It is especially visible when two cases run in parallel (but it is not a requirement)
A collision example: https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/3420/91739/pgsql_mnesia.23.1/big/ct_run.test@9111b0329547.2021-12-02_09.32.48/big_tests.tests.amp_big_SUITE.logs/run.2021-12-02_09.33.01/amp_big_suite.notify_deliver_to_online_user_recipient_privacy_test.13699.html
Error in the case:
You can think, wtf, we use escalus:fresh_story and there is only one story function in the case. Yeah, but amp suite implements a complex trick to run the same testcase several times with different configs. And apparently, circle CI reproduces a collision in suffixes very well (impossible to reproduce on my machine though...)
See in logs:
We also have two cases with the same fresh story suffix.
MongooseIM branch, configured with this PR https://github.com/esl/MongooseIM/pull/3429