nose-devs / nose

nose is nicer testing for python
http://readthedocs.org/docs/nose/en/latest/
1.36k stars 396 forks source link

nosetests returns zero exit code while there are many test failures (Py3.x, Ubuntu, Travis CI) #984

Open vasily-v-ryabov opened 8 years ago

vasily-v-ryabov commented 8 years ago

Hi team! I'm trying to understand what's happening in a Travis CI build while running nosetests on Python 3.x (not sure it's py3 specific issue because py2 tests pass 100%).

Python 3.x tests are failing but the job is indicated as green and I see the following message:

The command "nosetests --with-xunit --with-coverage --cover-html --cover-html-dir=Coverage_report --verbosity=3 test/testall.py" exited with 0.

I've already tried to reduce the number of arguments up to nosetests test/testall.py with no success. One more strange thing that is not reproduced on local Ubuntu VM (with py2.7) is second message about strange 1 test that is OK. I don't know from where this magic test has been appeared as a separate test.

Ran 415 tests in 0.263s
FAILED (failures=26, errors=225)
ok

Ran 1 test in 0.467s  # ?????
OK

This magic test might be a root cause. I have no ideas how to fix that. The GitHub project is here.