Indeterministics test behaviour

[JonathanFoo0523]

For ALTER

DREDD_ENABLED_MUTATION=8115 ./sample_binary/testfixture_alter_mutation ../sqlite-src/test/altercorrupt.test

could pass test or result in segmentation fault.

Note: The difference between 2 run k6, k7

>>> set(k6) - set(k7)
{8115, 8083, 8101}
>>> set(k7) - set(k6)
{2529, 3266, 3298, 3394, 4674, 4678, 6597, 4680, 7235, 3054, 2545, 6584, 7225, 7229}

All of k6 - k7 is caused by Undefined behaviour. All of k7-k6 is caused by timeout.

For ANALYZE

Both run agree

For ATTACH

>>> set(c7) - set(c6)
{121, 72, 1738, 1739, 84, 85, 117, 125, 2100, 89, 93}
>>> set(c6) - set(c7)
{1440, 1857, 1862, 1771, 559, 1839, 1840, 1841, 1842, 1843, 1141, 598, 2015, 1150, 1151}

Except 1440 caused by failing 1 test(tkt3762.test, not reproducible), all difference are caused by timeout.

[JonathanFoo0523]

Upon setting minimum timeout of 0.5s for regression test, 3/3 difference for ALTER caused by timeout 2/3 difference for ANALYZE caused by timeout, the other one being indeterministic behaviour of tkt3762.test 1/1 difference for ATTACH caused by timeout No difference for auth