This issue documents partial progress towards testing inferno-vc-server for concurrency bugs (#19 , #36).
The basic idea is to use the servant-quickcheck package to test the VC server on arbitrary requests. In order for this to unearth concurrency bugs, the following steps are needed:
Add a concurrent harness to servant-quickcheck so that it makes requests from multiple threads simultaneously. (Partial progress towards this is on my fork here.)
The concurrent harness above is based on the stale package pqc (see my fork for GHC 9), but it needs improvements like early exit when one thread fails the test, logging the concurrent history of requests that caused an error, etc.
Purely random requests are not very good at exercising race conditions and catching bugs. For example, inferno-vc needs to be called with successive stores on the same script in order to exhibit some of the bugs (#36). We should modify the generator to generate requests from a small pool of object hashes so that the tests are more realistic. (Partial progress on the sidk-conc-tests branch)
The default arbitrary generator for Expr generates huge expressions, which causes tests to time out silently. A hacky fix is to add let reqs = resize 2 $ ... in servant-quickcheck's serverSatisfiesMgr. A better way forward would be to also limit the expressions used in test requests.
This issue documents partial progress towards testing
inferno-vc-serverfor concurrency bugs (#19 , #36).The basic idea is to use the
servant-quickcheckpackage to test the VC server on arbitrary requests. In order for this to unearth concurrency bugs, the following steps are needed:servant-quickcheckso that it makes requests from multiple threads simultaneously. (Partial progress towards this is on my fork here.)pqc(see my fork for GHC 9), but it needs improvements like early exit when one thread fails the test, logging the concurrent history of requests that caused an error, etc.inferno-vcneeds to be called with successive stores on the same script in order to exhibit some of the bugs (#36). We should modify the generator to generate requests from a small pool of object hashes so that the tests are more realistic. (Partial progress on thesidk-conc-testsbranch)Exprgenerates huge expressions, which causes tests to time out silently. A hacky fix is to addlet reqs = resize 2 $ ...in servant-quickcheck'sserverSatisfiesMgr. A better way forward would be to also limit the expressions used in test requests.(CC: @smurphy8 )