EVGENIAST / cumulusrdf

Automatically exported from code.google.com/p/cumulusrdf
0 stars 0 forks source link

KnownURIsDictionaryTest is not deteministic. #74

Open GoogleCodeExporter opened 8 years ago

GoogleCodeExporter commented 8 years ago
The test fails randomly and never tests the same thing. It should not randomize 
everything, but use a set seed to ensure that the test is the same all the time.
The seed should be set at the beginning of every test, or in a @begin method. 
Every test method should run a loop to run the test multiple times with 
different values. Also, _isPredicate must not be randomized, but every test 
should run with _isPredicate == true and _isPredicate == false in one execution.

The goal of this is that we can detect a test failure with one execution mvn 
test, and not multiple.
We got random test failures because of this :(

Original issue reported on code.google.com by Isib...@gmail.com on 14 May 2014 at 10:13

GoogleCodeExporter commented 8 years ago

Original comment by a.gazzarini@gmail.com on 14 May 2014 at 12:07

GoogleCodeExporter commented 8 years ago
Hi Sebastian,
could I ask you more details? I'm running and running again this tests and
see no problem. Also, this tests is using mock objects and therefore
shouldn't have any effect on Cassandra tables / column families

Best,
Andrea

2014-05-14 12:13 GMT+02:00 <cumulusrdf@googlecode.com>:

Original comment by a.gazzarini@gmail.com on 14 May 2014 at 12:15

GoogleCodeExporter commented 8 years ago
I fixed the issue in this class today. But this is a design choice, if a test
fails, we want that it fails every build, not randomly just one or the
other.

Original comment by Isib...@gmail.com on 14 May 2014 at 12:20

GoogleCodeExporter commented 8 years ago
Ah ok, sorry I didn't get the point...

2014-05-14 14:20 GMT+02:00 <cumulusrdf@googlecode.com>:

Original comment by a.gazzarini@gmail.com on 14 May 2014 at 12:22