search

dvoits / z3test

Test and benchmark repository for Z3.
Other
0 stars 0 forks source link

If multiple VMs share same physical machine, they can non-deterministically interfere and affect performance measurements #11

Open dvoits opened 7 years ago

dvoits commented 7 years ago

It doesn't seem to be a reason of performance variety.

dvoits commented 7 years ago

I suggest to run hundreds of z3 performance tasks sequentially on a same VM in Azure Batch to find variation of the performance. The idea is that performance can vary as side effect of the machine sharing, we will see this variation in the process running times.

wintersteiger commented 7 years ago

Also, there may be other processes and VMs belonging to other users that we don't know. I have no idea what Azure's scheduling policy is, but I can very well imagine that on the cheap VMs everything is shared (and thus unpredictable).