BayesianPEIsCorrect test fails probabilistically

microsoft / Quantum

Microsoft Quantum Development Kit Samples

https://docs.microsoft.com/quantum

MIT License

3.88k stars 920 forks source link

BayesianPEIsCorrect test fails probabilistically #622

Open tcNickolas opened 2 years ago

tcNickolas commented 2 years ago

Describe the bug BayesianPEIsCorrect test fails probabilistically. Similarly to https://github.com/microsoft/QuantumLibraries/issues/444, we should fix the seed used in the test, or run several tries in a loop and say that the test passes if at least one of the runs succeeds.

To Reproduce The last failure I've seen.

cgranade commented 2 years ago

At least for fixing the seed, that's unfortunately not currently supported (as per your earlier issue at https://github.com/microsoft/qsharp-runtime/issues/947). In the meantime, adding this to the maintenance backlog to consider your suggestion of looping several times.