search

apache / mxnet

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more
https://mxnet.apache.org
Apache License 2.0
20.78k stars 6.79k forks source link

Flaky test: test_gru_bidirectional #11219

Closed eric-haibin-lin closed 6 years ago

eric-haibin-lin commented 6 years ago

http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/incubator-mxnet/detail/PR-11197/7/pipeline

test_operator.test_gru_sym ... ok

test_operator.test_gru_bidirectional ... 

(py2) C:\jenkins_slave\workspace\ut-python-gpu>IF -1073741819 NEQ 0 exit /b 1 

script returned exit code 1
larroy commented 6 years ago

can be reproduced with MXNET_MODULE_SEED=1447306965 python -mnose -v test_operator.py:test_gru_bidirectional

ThomasDelteil commented 6 years ago

duplicate here of this one https://github.com/apache/incubator-mxnet/issues/11202

ThomasDelteil commented 6 years ago

This one is happening way too often, had it 3 times in 6 builds. Should we upgrade to bug?

ThomasDelteil commented 6 years ago

@lihaofd can you take a look please? thanks!

ThomasDelteil commented 6 years ago

http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/incubator-mxnet/detail/PR-11236/1/pipeline

ThomasDelteil commented 6 years ago

http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/incubator-mxnet/detail/PR-11225/4/pipeline

aaronmarkham commented 6 years ago

Still a problem... http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/incubator-mxnet/detail/PR-11261/4/pipeline edit ...For a bunch of PRs... almost like nothing is getting through because of this!

ThomasDelteil commented 6 years ago

@lihaofd could you disable this test while you investigate why it is failing on windows?

aaronmarkham commented 6 years ago

Doesn't seem disabled to me: http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/incubator-mxnet/detail/PR-11287/1/pipeline

ThomasDelteil commented 6 years ago

might have been just merged and you got unlucky, got merged 1h ago as well

aaronmarkham commented 6 years ago

Ya, you're right. I saw the 16 hours ago and "merged" nearby so I thought that's when it happened. I definitely missed the window.

pengzhao-intel commented 6 years ago

the fix is merged. Feel free to ping me if you see the errors again.