Open perdasilva opened 5 years ago
mxnet-label-bot
commented
5 years ago Hey, this is the MXNet Label Bot. Thank you for submitting the issue! I will try and suggest some labels so that the appropriate MXNet community members can help resolve it. Here are my recommended label(s): Test
samskalicky
commented
5 years ago @zachgk close this issue as the problem is resolved
zachgk
commented
5 years ago This issue also reoccurred on http://jenkins.mxnet-ci-dev.amazon-ml.com/blue/organizations/jenkins/restricted-mxnet-cd%2Fmxnet-cd-release-job/detail/mxnet-cd-release-job/227/pipeline/. I am not sure that it is resolved
szha
commented
4 years ago =================================== FAILURES ===================================
_________ test_custom_operator_profiling_multiple_custom_ops_symbolic __________
[gw1] linux -- Python 3.6.9 /opt/rh/rh-python36/root/usr/bin/python
def test_custom_operator_profiling_multiple_custom_ops_symbolic():
custom_operator_profiling_multiple_custom_ops(None, 'symbolic', \
> 'test_custom_operator_profiling_multiple_custom_ops_symbolic.json')
tests/python/unittest/test_profiler.py:442:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
tests/python/unittest/test_profiler.py:418: in custom_operator_profiling_multiple_custom_ops
aggregate_stats=True)
tests/python/unittest/test_profiler.py:40: in enable_profiler
aggregate_stats=aggregate_stats)
python/mxnet/profiler.py:69: in set_config
profiler_kvstore_handle))
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
ret = -1
def check_call(ret):
"""Check the return value of C API call.
This function will raise an exception when an error occurs.
Wrap every API call with this function.
Parameters
----------
ret : int
return value from API calls.
"""
if ret != 0:
> raise get_last_ffi_error()
E mxnet.base.MXNetError: Traceback (most recent call last):
E File "/work/mxnet/include/dmlc/thread_group.h", line 226
E MXNetError: Check failed: auto_remove_ == false (1 vs. 0) :
python/mxnet/base.py:246: MXNetError
---------------------------- Captured stderr setup -----------------------------
DEBUG:root:np/mx/python random seeds are set to 1919136079, use MXNET_TEST_SEED=1919136079 to reproduce.
------------------------------ Captured log setup ------------------------------
DEBUG root:conftest.py:187 np/mx/python random seeds are set to 1919136079, use MXNET_TEST_SEED=1919136079 to reproduce.
--------------------------- Captured stderr teardown ---------------------------
INFO:root:np/mx/python random seeds are set to 1919136079, use MXNET_TEST_SEED=1919136079 to reproduce.
---------------------------- Captured log teardown -----------------------------
INFO root:conftest.py:204 np/mx/python random seeds are set to 1919136079, use MXNET_TEST_SEED=1919136079 to reproduce.
________ test_custom_operator_profiling_multiple_custom_ops_imperative _________
[gw1] linux -- Python 3.6.9 /opt/rh/rh-python36/root/usr/bin/python
def test_custom_operator_profiling_multiple_custom_ops_imperative():
custom_operator_profiling_multiple_custom_ops(None, 'imperative', \
> 'test_custom_operator_profiling_multiple_custom_ops_imperative.json')
tests/python/unittest/test_profiler.py:447:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
tests/python/unittest/test_profiler.py:418: in custom_operator_profiling_multiple_custom_ops
aggregate_stats=True)
tests/python/unittest/test_profiler.py:40: in enable_profiler
aggregate_stats=aggregate_stats)
python/mxnet/profiler.py:69: in set_config
profiler_kvstore_handle))
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
ret = -1
def check_call(ret):
"""Check the return value of C API call.
This function will raise an exception when an error occurs.
Wrap every API call with this function.
Parameters
----------
ret : int
return value from API calls.
"""
if ret != 0:
> raise get_last_ffi_error()
E mxnet.base.MXNetError: Traceback (most recent call last):
E File "/work/mxnet/include/dmlc/thread_group.h", line 226
E MXNetError: Check failed: auto_remove_ == false (1 vs. 0) :
python/mxnet/base.py:246: MXNetError
---------------------------- Captured stderr setup -----------------------------
DEBUG:root:np/mx/python random seeds are set to 1280101854, use MXNET_TEST_SEED=1280101854 to reproduce.
------------------------------ Captured log setup ------------------------------
DEBUG root:conftest.py:187 np/mx/python random seeds are set to 1280101854, use MXNET_TEST_SEED=1280101854 to reproduce.
----------------------------- Captured stderr call -----------------------------
[00:44:25] /work/mxnet/src/c_api/../operator/custom/custom-inl.h:57: New registration is overriding existing custom operator MyAdd1
[00:44:25] /work/mxnet/src/c_api/../operator/custom/custom-inl.h:57: New registration is overriding existing custom operator MyAdd2
--------------------------- Captured stderr teardown ---------------------------
INFO:root:np/mx/python random seeds are set to 1280101854, use MXNET_TEST_SEED=1280101854 to reproduce.
---------------------------- Captured log teardown -----------------------------
INFO root:conftest.py:204 np/mx/python random seeds are set to 1280101854, use MXNET_TEST_SEED=1280101854 to reproduce.
Description
The python 2 tests are failing against the statically linked cpu variant of libmxnet:
Jenkins log
Environment info (Required)
ubuntu_cpu docker environment.