Jittor / jittor

Jittor is a high-performance deep learning framework based on JIT compiling and meta-operators.
https://cg.cs.tsinghua.edu.cn/jittor/
Apache License 2.0
3.08k stars 311 forks source link

RuntimeError Execute fused operator(0/1) failed. #402

Closed wzever closed 1 year ago

wzever commented 2 years ago

Describe the bug

RuntimeError occurs at

  m = log_s.max(1, keepdims=True)

Same error come up during some mathematical computing steps, too. What was wrong? Thanks for answering.

Full Log

After setting: JT_SYNC=1 trace_py_var=3

RuntimeError: [f 1015 20:27:10.810000 04 executor.cc:666]
Execute fused operator(0/1) failed.
[JIT Source]: C:\Users\HUAWEI\.cache\jittor\jt1.3.5\cl\py3.9.7\Windows-10-10.xd0\IntelRCoreTMi7x5f\default\cu10.2.89\jit\__opkey0_reduce__Tx_float32__Ty_float32__Tz_float32__OP_maximum__DIM_2__REDUCE_2__JIT_1__J___hash_5d06b7f52f4664a7_op.cc    
[OP TYPE]: fused_op:( reduce.maximum,)
[Input]: float32[5,5,],
[Output]: float32[5,1,],
[Async Backtrace]: ---
     C:\***\AppData\Local\Programs\Python\Python39\lib\runpy.py:197 <_run_module_as_main>
     C:\***\AppData\Local\Programs\Python\Python39\lib\runpy.py:87 <_run_code>
     c:\***\.vscode\extensions\ms-python.python-2022.16.1\pythonFiles\lib\python\debugpy\__main__.py:39 <<module>>
     c:\***\.vscode\extensions\ms-python.python-2022.16.1\pythonFiles\lib\python\debugpy/..\debugpy\server\cli.py:430 <main>
     c:\***\.vscode\extensions\ms-python.python-2022.16.1\pythonFiles\lib\python\debugpy/..\debugpy\server\cli.py:284 <run_file>
     c:\***\.vscode\extensions\ms-python.python-2022.16.1\pythonFiles\lib\python\debugpy\_vendored\pydevd\_pydevd_bundle\pydevd_runpy.py:321 <run_path>
     c:\***\.vscode\extensions\ms-python.python-2022.16.1\pythonFiles\lib\python\debugpy\_vendored\pydevd\_pydevd_bundle\pydevd_runpy.py:135 <_run_module_code>
     c:\***\.vscode\extensions\ms-python.python-2022.16.1\pythonFiles\lib\python\debugpy\_vendored\pydevd\_pydevd_bundle\pydevd_runpy.py:124 <_run_code>
     d:\***\pygmtools-main-local\tests\test_multi_graph_solvers.py:186 <<module>>
     ...(my files)
[Reason]: [f 1015 20:27:08.321000 04 sfrl_allocator.cc:70] Check failed: tot_block_id < ID_LIMIT - 1  Something wrong... Could you please report this issue?
 block id limit extended.

Version

Python 3.9.7 jittor 1.3.5.18

Frankie-Dejong commented 4 months ago

Could u tell me how u handle this problem? I have met this error too. Thanks