apache / mxnet

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more
https://mxnet.apache.org
Apache License 2.0
20.74k stars 6.81k forks source link

[Test failure]: test_custom_operator_profiling_naive_engine #15406

Open aaronmarkham opened 5 years ago

aaronmarkham commented 5 years ago

Description

Docs update PR failed on a test.

http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Funix-cpu/detail/PR-15117/4/pipeline

======================================================================

FAIL: test_profiler.test_custom_operator_profiling_naive_engine

----------------------------------------------------------------------

Traceback (most recent call last):

  File "/usr/local/lib/python3.5/dist-packages/nose/case.py", line 198, in runTest

    self.test(*self.arg)

  File "/work/mxnet/tests/python/unittest/test_profiler.py", line 445, in test_custom_operator_profiling_naive_engine

    'test_custom_operator_profiling_multiple_custom_ops_imperative_naive.json')

  File "/work/mxnet/tests/python/unittest/common.py", line 313, in run_in_spawned_process

    assert p.exitcode == 0, "Non-zero exit code %d from %s()." % (p.exitcode, func.__name__)

AssertionError: Non-zero exit code 255 from test_custom_operator_profiling_multiple_custom_ops_imperative().
mxnet-label-bot commented 5 years ago

Hey, this is the MXNet Label Bot. Thank you for submitting the issue! I will try and suggest some labels so that the appropriate MXNet community members can help resolve it. Here are my recommended labels: Test

aaronmarkham commented 5 years ago

Happened again: http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Funix-cpu/detail/PR-15117/6/pipeline

anirudh2290 commented 5 years ago

@Zha0q1

aaronmarkham commented 5 years ago

And again: http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Funix-cpu/detail/PR-15427/2/pipeline

Zha0q1 commented 5 years ago

We are commenting this out for now. Will then take a closer look at this before tomorrow

aaronmarkham commented 5 years ago

We are commenting this out for now. Will then take a closer look at this before tomorrow

This is happening a lot. Did it get removed yet?

anirudh2290 commented 5 years ago

ya removed in this PR: https://github.com/apache/incubator-mxnet/pull/15436

leezu commented 4 years ago

test_profile_create_domain_dept is also problematic http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Funix-gpu/detail/PR-18701/1/pipeline/378