We encounter a problem when preparing tests in "hand-made" mode, as they sometimes fail when run in CI. As a result, we often have to add sleep commands, which is not very efficient.
We have updated CLT to support a --delay option with a default value of 5ms. We can control this delay using the --delay=5 flag when running tests.
The purpose of this task is to identify tests that meet this criterion (where we had to add sleep because they work when run manually but fail in CI) and try running them with various delay values to determine the optimal delay (possibly increasing it to 10ms or even more).
By doing this, we can eliminate the need for sleep commands and process tests in a manner closer to hand-written commands.
CLT version to use: 0.3.1
Checklist:
To be completed by the assignee. Check off tasks that have been completed or are not applicable.
- [ ] Implementation completed
- [ ] Tests developed
- [ ] Documentation updated
- [ ] Documentation reviewed
- [ ] [Changelog](https://docs.google.com/spreadsheets/d/1mz_3dRWKs86FjRF7EIZUziUDK_2Hvhd97G0pLpxo05s/edit?pli=1&gid=1102439133#gid=1102439133) updated
- [x] OpenAPI YAML updated and issue created to rebuild clients
Proposal:
We encounter a problem when preparing tests in "hand-made" mode, as they sometimes fail when run in CI. As a result, we often have to add
sleepcommands, which is not very efficient.We have updated CLT to support a
--delayoption with a default value of 5ms. We can control this delay using the--delay=5flag when running tests.The purpose of this task is to identify tests that meet this criterion (where we had to add sleep because they work when run manually but fail in CI) and try running them with various delay values to determine the optimal delay (possibly increasing it to 10ms or even more).
By doing this, we can eliminate the need for sleep commands and process tests in a manner closer to hand-written commands.
CLT version to use: 0.3.1
Checklist:
To be completed by the assignee. Check off tasks that have been completed or are not applicable.