Some Muppy tests take a very long time and fail in the new test environment

In the new test environment running the whole test environment takes very
much time and lets a number of tests fail. Python 2.5.2 at Ubuntu Linux 8.04.

If only muppy tests are run, every test passes and the test completes in
about 2-3 minutes:

$ python runtest.py test/muppy

However, if I run the whole test-suite at once, it takes about an hour and
some tests fail:

$ python runtest.py

(see below)

Either the test should be changed to not be affected by environment changes
(how it is called from the testing environment), or we could revert the
testing environment to run every test in its own little world (fix the
symptom). Should be discussed in the mailing list.

___________________________________________________

$ time python runtest.py
Test referent identification. ... ok
Test garbage annotation. ... ok
Test pruning of reference graph. ... ok
Test serialization of log data. ... ok
Test background monitoring. ... ok
Test footprint description. ... ok
Test timestamp of snapshots. ... ok
Test modifying name. ... ok
Test detaching from tracked classes. ... ok
Test lifetime of tracked objects. ... ok
Test registering objects by name. ... ok
Test tracking objects through classes. ... ok
Test tracking new style classes. ... ok
Test lifetime of tracked objects. ... ok
Test recursive sizing and saving of referents. ... ok
Test registering objects by name. ... ok
Test object registration. ... ok
Test intrackable objects. ... ok
Check that only valid codepoints are returned. ... ok
Check if the diff of to object lists is correct. ... ok
Check that only elements within the specified size boundaries ... ok
Check that only elements of a certain type are included, ... ok
Check that referents are included in return value. ... ok
Check that the return value is the sum of the size of all objects. ... ok
Check that (non-)container objects are identified correctly. ... ok
Check that objects returns a non-empty list. ... ok
Verify that this operations returns a duplicate-free lists. ... ok
Check that objects are sorted by size. ... ok
test_get_tree (test.muppy.test_refbrowser.TreeTest) ... ok
Check node functionality. ... ok
Check that the right representation is returned. ... ok
Check that a single object's data is correctly subtracted from a ... ok
test_summarize (test.muppy.test_summary.SummaryTest) ... ok
test_summary_diff (test.muppy.test_summary.SummaryTest) ... ok
Check that all and only empty entries are removed from a summary. ... ok
Check that all objects of a summary are traversed. ... ok
test_otracker_diff (test.muppy.test_tracker.TrackerTest) ... ok
test_otracker_get_objects (test.muppy.test_tracker.TrackerTest) ... ok
Check that a summary is created correctly. ... FAIL
Check that the diff is computed correctly. ... FAIL
Check that a summary is stored under the correct key and most ... FAIL

======================================================================
FAIL: Check that a summary is created correctly.
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/ludwig/Projects/pympler-alpha/test/muppy/test_tracker.py",
line 84, in test_stracker_create_summary
    self.assert_(self._contains_indicator(sn) == None)
AssertionError

======================================================================
FAIL: Check that the diff is computed correctly.
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/ludwig/Projects/pympler-alpha/test/muppy/test_tracker.py",
line 50, in test_stracker_diff
    self.assert_(self._contains_indicator(diff) == -1)
AssertionError

======================================================================
FAIL: Check that a summary is stored under the correct key and most
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/ludwig/Projects/pympler-alpha/test/muppy/test_tracker.py",
line 117, in test_stracker_store_summary
    self.assert_(self._contains_indicator(s) == 1)
AssertionError

----------------------------------------------------------------------
Ran 41 tests in 3323.390s

FAILED (failures=3)

real    55m24.974s
user    55m6.235s
sys 0m8.421s
Original issue reported on code.google.com by lhae...@gmail.com on 14 Oct 2008 at 9:59
aigeano / pympler

Some Muppy tests take a very long time and fail in the new test environment #6
