search

FlowCrypt / flowcrypt-android

FlowCrypt Android App
https://flowcrypt.com
Other
90 stars 11 forks source link

Fix flaky tests #2642

Open DenBond7 opened 5 months ago

DenBond7 commented 5 months ago
DenBond7 commented 3 months ago

https://flowcrypt.semaphoreci.com/jobs/2f3e6681-e09d-4b39-822b-3d58841b7b44

DenBond7 commented 3 months ago

Some details for history.

We have some flaky tests that depend on an emulator(emulator performance).

For example, on the server, we see the following in the logs Boot completed in 57836 ms

But on my machine I see the following Boot completed in 24322 ms

It means on my machine an emulator works much faster. And that's why I usually can't reproduce some flaky tests. Unfortunately, I can't use for example virtual box to create a slower machine. Because the Android emulator requires virtualization. And the nested virtualization doesn't work well.

But I've found a way. I bought a small and not fast tiny PC like this one

image

Now I can reproduce most flaky tests.

sosnovsky commented 3 months ago

Oh, it was a radical solution, great that it works 👍