search

pharo-project / pharo

Pharo is a dynamic reflective pure object-oriented language supporting live programming inspired by Smalltalk.
http://pharo.org
Other
1.2k stars 355 forks source link

Tests that pass in Pharo 11 don't pass in Pharo 12 #16808

Open Eliott-Guevel opened 3 months ago

Eliott-Guevel commented 3 months ago

Bug description Some tests that pass in Pharo 11 don't pass in Pharo 12.

To Reproduce Steps to reproduce the behavior:

  1. Load Molecule (dev-incubator branch) 
    Metacello new
baseline: 'Molecule';
repository: 'github://OpenSmock/Molecule:dev-incubator/src';
load.
  2. Execute MolComponentManager's tests in the Molecule-Examples package
  3. testDeepCleanupGarbageCollect, testFlushComponents and testGarbageCollect can fail. Executing them individually doesn't raise errors, and since the tests pass in Pharo 11 it seems more of a Pharo 12 problem than an setUp and tearDown problem.

Expected behavior Tests that pass in Pharo 11 should also pass in Pharo 12.

Screenshots Examples of different outputs image image image

Version information:

Ducasse commented 3 months ago

Thanks Eliot Thank for your report. If your tests works in isolation and not in a group it means that you get a dependency between your tests. The tester runner has been changed to make sure that the tests are not always run in the same order just to spot such hidden and bad dependencies. So can you check your code because to us this is not a Pharo problem. S