search

apache / mxnet

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more
https://mxnet.apache.org
Apache License 2.0
20.75k stars 6.8k forks source link

flaky test: test_ndarray_elementwisesum #14852

Open ChaiBapchya opened 5 years ago

ChaiBapchya commented 5 years ago

Flaky test in an unrelated (doc PR #14243 )

Python3: MKLDNN-GPU-NOCUDNN

test_operator_gpu.test_ndarray_elementwisesum ... [21:23:17] src/operator/tensor/./.././../common/../operator/mxnet_op.h:794: Check failed: (err) == (cudaSuccess) Name: mxnet_generic_kernel ErrStr:an illegal memory access was encountered

/work/runtime_functions.sh: line 866:     6 Aborted                 (core dumped) nosetests-3.4 $NOSE_COVERAGE_ARGUMENTS $NOSE_TIMER_ARGUMENTS --with-xunit --xunit-file nosetests_gpu.xml --verbose tests/python/gpu
mxnet-label-bot commented 5 years ago

Hey, this is the MXNet Label Bot. Thank you for submitting the issue! I will try and suggest some labels so that the appropriate MXNet community members can help resolve it. Here are my recommended labels: Test, Flaky

ChaiBapchya commented 5 years ago

@mxnet-label-bot add [Test, Flaky]

arcadiaphy commented 5 years ago

Same here: http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Funix-gpu/detail/PR-14886/6/pipeline

nickguletskii commented 5 years ago

Same here: http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Funix-gpu/detail/PR-14638/12/pipeline

aaronmarkham commented 5 years ago

Same: http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Funix-gpu/detail/PR-14987/8/pipeline/

aaronmarkham commented 5 years ago

And again on another PR: http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Funix-gpu/detail/PR-15117/1/pipeline

ChaiBapchya commented 5 years ago

Another one PR #15736 http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Funix-gpu/detail/PR-15736/2/pipeline