apache / mxnet

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more
https://mxnet.apache.org
Apache License 2.0
20.77k stars 6.8k forks source link

Flaky test_loss.test_poisson_nllloss failed CI #14723

Open zachgk opened 5 years ago

zachgk commented 5 years ago

test_loss.test_poisson_nllloss failed the CI at http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Funix-cpu/detail/PR-14687/3/pipeline/ on unrelated PR https://github.com/apache/incubator-mxnet/pull/14687.

See output below:

======================================================================

FAIL: test_loss.test_poisson_nllloss

----------------------------------------------------------------------

Traceback (most recent call last):

  File "/usr/local/lib/python2.7/dist-packages/nose/case.py", line 197, in runTest

    self.test(*self.arg)

  File "/work/mxnet/tests/python/unittest/test_loss.py", line 396, in test_poisson_nllloss

    assert_almost_equal(np_loss_no_logits, loss_no_logits.asscalar())

  File "/work/mxnet/python/mxnet/test_utils.py", line 495, in assert_almost_equal

    raise AssertionError(msg)

AssertionError: 

Items are not equal:

Error 4.257397 exceeds tolerance rtol=0.000010, atol=0.000000.  Location of maximum error:(), a=0.000467, b=0.000467

 a: 0.00046688318

 b: 0.00046690306
mxnet-label-bot commented 5 years ago

Hey, this is the MXNet Label Bot. Thank you for submitting the issue! I will try and suggest some labels so that the appropriate MXNet community members can help resolve it. Here are my recommended labels: Test, Flaky, CI

zachgk commented 5 years ago

@mxnet-label-bot add [Test, Flaky, Python]