search

apache / mxnet

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more
https://mxnet.apache.org
Apache License 2.0
20.77k stars 6.79k forks source link

Windows fatal exception: access violation #18216

Open leezu opened 4 years ago

leezu commented 4 years ago 
[2020-05-01T14:31:35.885Z] tests/python/unittest/test_gluon.py::test_parameter PASSED               [ 12%]

[2020-05-01T14:31:36.149Z] tests/python/unittest/test_gluon.py::test_invalid_parameter_stype XFAIL  [ 12%]

[2020-05-01T14:31:36.464Z] tests/python/unittest/test_gluon.py::test_invalid_parameter_grad_stype XFAIL [ 12%]

[2020-05-01T14:31:36.464Z] tests/python/unittest/test_gluon.py::test_sparse_parameter PASSED        [ 12%]

[2020-05-01T14:31:36.464Z] tests/python/unittest/test_gluon.py::test_parameter_invalid_access PASSED [ 12%]

[2020-05-01T14:31:36.464Z] Windows fatal exception: 

[2020-05-01T14:31:36.464Z] access violation

[2020-05-01T14:31:36.464Z] 

[2020-05-01T14:31:36.464Z] Thread 0x000010ec (most recent call first):

[2020-05-01T14:31:36.464Z]   File "C:\

[2020-05-01T14:31:36.464Z] Python37\lib

[2020-05-01T14:31:36.464Z] \threading.py"

[2020-05-01T14:31:36.464Z] , line 300

[2020-05-01T14:31:36.464Z]  in wai

[2020-05-01T14:31:36.464Z] t

[2020-05-01T14:31:36.464Z] 

[2020-05-01T14:31:36.464Z]   File "C

[2020-05-01T14:31:36.464Z] :\Python37\

[2020-05-01T14:31:36.725Z] lib\

[2020-05-01T14:31:36.725Z] threading.p

[2020-05-01T14:31:36.725Z] y", line 552 in wa

[2020-05-01T14:31:36.725Z] it

[2020-05-01T14:31:36.725Z]   File 

[2020-05-01T14:31:36.725Z] "C:\

[2020-05-01T14:31:36.725Z] P

[2020-05-01T14:31:36.725Z] ytho

[2020-05-01T14:31:36.725Z] n37\lib

[2020-05-01T14:31:36.725Z] \th

[2020-05-01T14:31:36.725Z] reading.py", line 1164 in run

[2020-05-01T14:31:36.725Z]   File "C:\Python37\lib\threading.py", line 917 in _bootstrap_inner

[2020-05-01T14:31:36.725Z]   File "C:\Python37\lib\threading.py", line 885 in _bootstrap

[2020-05-01T14:31:36.725Z] 

[2020-05-01T14:31:36.725Z] Thread 0x0000136c (most recent call first):

[2020-05-01T14:31:36.725Z]   File "C:\jenkins_slave\workspace\ut-python-gpu\windows_package\python\mxnet\ndarray\utils.py", line 280 in save

[2020-05-01T14:31:36.725Z]   File "C:\jenkins_slave\workspace\ut-python-gpu\windows_package\python\mxnet\gluon\parameter.py", line 986 in save

[2020-05-01T14:31:36.725Z]   File "C:\jenkins_slave\workspace\ut-python-gpu\tests\python\unittest\test_gluon.py", line 115 in test_parameter_dict

[2020-05-01T14:31:36.725Z]   File "C:\jenkins_slave\workspace\ut-python-gpu\tests\python\unittest\common.py", line 215 in test_new

[2020-05-01T14:31:36.725Z]   File "C:\Python37\lib\site-packages\_pytest\python.py", line 167 in pytest_pyfunc_call

[2020-05-01T14:31:36.725Z]   File "C:

[2020-05-01T14:31:36.725Z] \Python37\lib\site-p

[2020-05-01T14:31:36.725Z] ac

[2020-05-01T14:31:36.725Z] kage

[2020-05-01T14:31:36.725Z] s\pluggy\ca

[2020-05-01T14:31:36.725Z] llers.

[2020-05-01T14:31:36.725Z] py

[2020-05-01T14:31:36.725Z] ", line 187 in _multicall

[2020-05-01T14:31:36.725Z]   File "C:

[2020-05-01T14:31:36.725Z] \Python

[2020-05-01T14:31:36.725Z] 37\l

[2020-05-01T14:31:36.725Z] ib\site-packages\pluggy\manager.py", line 87 in <lambda>

[2020-05-01T14:31:36.725Z]   File "C:\Python37\lib\site-packages\p

[2020-05-01T14:31:36.725Z] lu

[2020-05-01T14:31:36.725Z] ggy\

[2020-05-01T14:31:36.725Z] manager.py", line 93 in _hookexec

[2020-05-01T14:31:36.725Z]   File "C:\

[2020-05-01T14:31:36.725Z] Pyt

[2020-05-01T14:31:36.725Z] hon3

[2020-05-01T14:31:36.725Z] 7\li

[2020-05-01T14:31:36.725Z] b\si

[2020-05-01T14:31:36.725Z] te-pack

[2020-05-01T14:31:36.725Z] ages

[2020-05-01T14:31:36.725Z] \pluggy\hooks.py", line 286 in __call__

[2020-05-01T14:31:36.725Z]   File "C:\Python

[2020-05-01T14:31:36.725Z] 37\lib\site-

[2020-05-01T14:31:36.725Z] p

[2020-05-01T14:31:36.725Z] ackag

[2020-05-01T14:31:36.725Z] es\_

[2020-05-01T14:31:36.725Z] pyte

[2020-05-01T14:31:36.725Z] st\p

[2020-05-01T14:31:36.725Z] ython.p

[2020-05-01T14:31:36.725Z] y", line 1445 in r

[2020-05-01T14:31:36.725Z] untest

[2020-05-01T14:31:36.725Z] 

[2020-05-01T14:31:36.725Z]   File "C:\P

[2020-05-01T14:31:36.725Z] ytho

[2020-05-01T14:31:36.725Z] n37\li

[2020-05-01T14:31:36.725Z] b\site-

[2020-05-01T14:31:36.989Z] p

[2020-05-01T14:31:36.989Z] acka

[2020-05-01T14:31:36.989Z] ges\_pytest\runner.py", line 134 in 

[2020-05-01T14:31:36.989Z] pyte

[2020-05-01T14:31:36.989Z] st_r

[2020-05-01T14:31:36.989Z] untest_call

[2020-05-01T14:31:36.989Z] 

[2020-05-01T14:31:36.989Z]   File "C:

[2020-05-01T14:31:36.989Z] \Pyt

[2020-05-01T14:31:36.989Z] hon3

[2020-05-01T14:31:36.989Z] 7\lib

[2020-05-01T14:31:36.989Z] \site-p

[2020-05-01T14:31:36.989Z] acka

[2020-05-01T14:31:36.989Z] ges\pl

[2020-05-01T14:31:36.989Z] uggy\c

[2020-05-01T14:31:36.989Z] alle

[2020-05-01T14:31:36.989Z] rs.py", line 

[2020-05-01T14:31:36.989Z] 187 in _m

[2020-05-01T14:31:36.989Z] ulti

[2020-05-01T14:31:36.989Z] call

[2020-05-01T14:31:36.989Z] 

[2020-05-01T14:31:36.989Z]   File "C:

[2020-05-01T14:31:36.989Z] \Pyt

[2020-05-01T14:31:36.989Z] hon37\lib\si

[2020-05-01T14:31:36.989Z] te-p

[2020-05-01T14:31:36.989Z] ackages\pluggy\manag

[2020-05-01T14:31:36.989Z] e

[2020-05-01T14:31:36.989Z] r.py

[2020-05-01T14:31:36.989Z] ", line 87 in 

[2020-05-01T14:31:36.989Z] <lambda

[2020-05-01T14:31:36.989Z] >

[2020-05-01T14:31:36.989Z]   File 

[2020-05-01T14:31:36.989Z] "C:\

[2020-05-01T14:31:36.989Z] Python37\lib

[2020-05-01T14:31:36.990Z] \sit

[2020-05-01T14:31:36.990Z] e-pa

[2020-05-01T14:31:36.990Z] ckag

[2020-05-01T14:31:36.990Z] es\p

[2020-05-01T14:31:36.990Z] luggy\manag

[2020-05-01T14:31:37.251Z] er.p

[2020-05-01T14:31:37.251Z] y", line 93

[2020-05-01T14:31:37.251Z]  in _hookexec

[2020-05-01T14:31:37.251Z]   File "C:\Python37\lib\site-packages\pluggy\hooks.py", line 286 in __call__

[2020-05-01T14:31:37.251Z]   File "C:\Python37\lib\site-packages\_pytest\runner.py", line 210 in <lambda>

[2020-05-01T14:31:37.251Z]   File "C:\Python37\lib\site-packages\_pytest\runner.py", line 237 in from_call

[2020-05-01T14:31:37.251Z]   File "C:\Python37\lib\site-packages\_pytest\runner.py", line 210 in call_runtest_hook

[2020-05-01T14:31:37.251Z]   File "C:\Python37\lib\site-packages\_pytest\runner.py", line 185 in call_and_report

[2020-05-01T14:31:37.251Z]   File "C:\Python37\lib\site-packages\_pytest\runne

[2020-05-01T14:31:37.251Z] r.p

[2020-05-01T14:31:37.251Z] y", line 99

[2020-05-01T14:31:37.251Z]  in run

[2020-05-01T14:31:37.251Z] test

[2020-05-01T14:31:37.251Z] protocol

[2020-05-01T14:31:37.251Z]   File "C:\Pytho

[2020-05-01T14:31:37.251Z] n37\

[2020-05-01T14:31:37.251Z] lib\

[2020-05-01T14:31:37.251Z] site-packages\_pytes

[2020-05-01T14:31:37.251Z] t\runne

[2020-05-01T14:31:37.251Z] r

[2020-05-01T14:31:37.251Z] .py"

[2020-05-01T14:31:37.251Z] , line 

[2020-05-01T14:31:37.251Z] 84

[2020-05-01T14:31:37.251Z]  in pytes

[2020-05-01T14:31:37.251Z] t_runte

[2020-05-01T14:31:37.251Z] st_p

[2020-05-01T14:31:37.251Z] roto

[2020-05-01T14:31:37.251Z] col

[2020-05-01T14:31:37.251Z] 

[2020-05-01T14:31:37.251Z]   File "C:\Python37\lib\site-packages\pluggy\callers.py", line 187 in _multicall

[2020-05-01T14:31:37.251Z]   File "C

[2020-05-01T14:31:37.251Z] :\Py

[2020-05-01T14:31:37.251Z] thon37\lib\s

[2020-05-01T14:31:37.251Z] ite-packages\pluggy\manager.py", line 87 in <lambda>

[2020-05-01T14:31:37.251Z] 

[2020-05-01T14:31:37.251Z]   File "C:\

[2020-05-01T14:31:37.251Z] Python37\lib\site-packages\pluggy\manager.py", line 93 in _hookexec

[2020-05-01T14:31:37.251Z]   File "C:\Python37\lib\site-packag

[2020-05-01T14:31:37.251Z] es\p

[2020-05-01T14:31:37.251Z] luggy\

[2020-05-01T14:31:37.251Z] ho

[2020-05-01T14:31:37.251Z] oks.py", line 286 in __call__

[2020-05-01T14:31:37.251Z]   File "C:\Python37\lib\site-packages\_pytest\main.py", line 271 in pytest_runtestloop

[2020-05-01T14:31:37.251Z]   File "C:\Python37\lib\site-packages\pluggy\callers.py", line 187 in _multicall

[2020-05-01T14:31:37.251Z]   File "C:\Python37\lib\site-packages\pluggy\manager.py", line 87 in <lambda>

[2020-05-01T14:31:37.251Z]   File "C:\Python37\lib\site-packages\pluggy\manager.py", line 93 in _hookexec

[2020-05-01T14:31:37.251Z]   File "C:\Python37\lib\site-packages\pluggy\hooks.py", line 286 in __call__

[2020-05-01T14:31:37.251Z]   File "C:\Python37\lib\site-packages\_pytest\main.py", line 247 in _main

[2020-05-01T14:31:37.251Z]   File "C:\Python37\lib\site-packages\_pytest\main.py", line 197 in wrap_session

[2020-05-01T14:31:37.251Z]   File "C:\Python37\lib\site-packages\_pytest\main.py", line 240 in pytest_cmdline_main

[2020-05-01T14:31:37.251Z]   File "C:\Python37\lib\site-packages\pluggy\callers.py", line 187 in _multicall

[2020-05-01T14:31:37.251Z]   File "C:

[2020-05-01T14:31:37.251Z] \Pytho

[2020-05-01T14:31:37.251Z] n3

[2020-05-01T14:31:37.251Z] 7\li

[2020-05-01T14:31:37.251Z] b\si

[2020-05-01T14:31:37.251Z] te-

[2020-05-01T14:31:37.251Z] pack

[2020-05-01T14:31:37.251Z] ages\pluggy\manager.py", line 87 in <lambda>

[2020-05-01T14:31:37.251Z]   File "

[2020-05-01T14:31:37.514Z] C:\P

[2020-05-01T14:31:37.514Z] ytho

[2020-05-01T14:31:37.514Z] n37\

[2020-05-01T14:31:37.514Z] lib\site-pac

[2020-05-01T14:31:37.514Z] kages\pluggy\manager.py", line 93 in _hookexec

[2020-05-01T14:31:37.514Z]   File "C:\Python37\lib\site-packages\pluggy\hooks.py", line 286 in __call__

[2020-05-01T14:31:37.514Z]   File "C:\Python37\lib\site-packages\_pytest\config\__init__.py", line 93 in main

[2020-05-01T14:31:37.514Z]   File "C:\Python37\lib\site-packages\pytest\__main__.py", line 7 in <module>

[2020-05-01T14:31:37.514Z]   File "C:\Python37\lib\runpy.py", line 85 in _run_code

[2020-05-01T14:31:37.514Z]   File "C:\Python37\lib\runpy.py", line 193 in _run_module_as_main

[2020-05-01T14:31:37.514Z] 

[2020-05-01T14:31:39.400Z] Error running unittest, python exited with status code C0000005

http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Fwindows-gpu/detail/PR-18202/7/pipeline

szha commented 4 years ago

this doesn't seem to occur anymore?