Describe the bug/ 问题描述 (Mandatory / 必填)
A clear and concise description of what the bug is.
Ascend Error Message:
E40021: Failed to compile Op [Select121]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.1/opp/built-in/op_impl/ai_core/tbe/impl/select.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/instrinsic/cce_intrin_md.py", line 5772, in vec_multiple_sel
raise RuntimeError("vec_multiple_sel at least has one src")
RuntimeError: [EB9999] vec_multiple_sel at least has one src', 'errPcause': ' ', 'errSolution': ' '}
], optype: [Select])
Solution: See the host log for details, and then check the Python stack where the error log is reported.
TraceBack (most recent call last):
Compile op[Select121] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.1/opp/built-in/op_impl/ai_core/tbe/impl/select.py], optype[Select], taskID[243]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:771]
[SubGraphOpt][Compile][ProcFailedCompTask] Thread[281460682519008] recompile single op[Select121] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
[SubGraphOpt][Compile][ParalCompOp] Thread[281460682519008] process fail task failed[FUNC:ParallelCompileOp][FILE:tbe_op_store_adapter.cc][LINE:1001]
[SubGraphOpt][Compile][CompOpOnly] CompileOp failed.[FUNC:CompileOpOnly][FILE:op_compiler.cc][LINE:1127]
[GraphOpt][FusedGraph][RunCompile] Failed to compile graph with compiler Normal mode Op Compiler[FUNC:SubGraphCompile][FILE:fe_graph_optimizer.cc][LINE:1292]
Call OptimizeFusedGraph failed, ret:-1, engine_name:AIcoreEngine, graph_name:partition0_rank1_new_sub_graph3[FUNC:OptimizeSubGraph][FILE:graph_optimize.cc][LINE:131]
subgraph 0 optimize failed[FUNC:OptimizeSubGraphWithMultiThreads][FILE:graph_manager.cc][LINE:996]
build graph failed, graph id:120, ret:-1[FUNC:BuildModelWithGraphId][FILE:ge_generator.cc][LINE:1615]
[Build][SingleOpModel]call ge interface generator.BuildSingleOpModel failed. ge result = 4294967295[FUNC:ReportCallError][FILE:log_inner.cpp][LINE:161]
[Build][Op]Fail to build op model[FUNC:ReportInnerError][FILE:log_inner.cpp][LINE:145]
build op model failed, result = 500002[FUNC:ReportInnerError][FILE:log_inner.cpp][LINE:145]
W11001: Op [Cast2] does not hit the high-priority operator information library, which might result in compromised performance.
W49999: If want to reuse binary file, please donwload binary file and install first![FUNC:BuildFusionOp][FILE:fusion_manager.cc][LINE:3763]
W11001: Op [ReduceSum17] does not hit the high-priority operator information library, which might result in compromised performance.
W11001: Op [Cast22] does not hit the high-priority operator information library, which might result in compromised performance.
W11001: Op [Cast31] does not hit the high-priority operator information library, which might result in compromised performance.
W11001: Op [ReduceProd117] does not hit the high-priority operator information library, which might result in compromised performance.
W11001: Op [ReduceMax119] does not hit the high-priority operator information library, which might result in compromised performance.
W49999: Compile error message is:[File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/instrinsic/cce_intrin_md.py", line 5772, in vec_multiple_sel
raise RuntimeError("vec_multiple_sel at least has one src")
RuntimeError: [EB9999] vec_multiple_sel at least has one src', 'errPcause': ' ', 'errSolution': ' '}
].
[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763]
W49999: Open failed, file is already open[FUNC:GetJsonValueFromJsonFile][FILE:fusion_util.cc][LINE:1516]
Hardware Environment(Ascend/GPU/CPU) / 硬件环境:
Please delete the backend not involved / 请删除不涉及的后端:
/device ascend/GPU/CPU/kirin/等其他芯片
华为910b
Software Environment / 软件环境 (Mandatory / 必填):
-- MindSpore version 2.2.14
-- Python version 3.9.2
-- OS platform and distribution ubuntu 20.04
Describe the bug/ 问题描述 (Mandatory / 必填) A clear and concise description of what the bug is.
Ascend Error Message:
E40021: Failed to compile Op [Select121]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.1/opp/built-in/op_impl/ai_core/tbe/impl/select.py failed with errormsg/stack: File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/instrinsic/cce_intrin_md.py", line 5772, in vec_multiple_sel raise RuntimeError("vec_multiple_sel at least has one src")
RuntimeError: [EB9999] vec_multiple_sel at least has one src', 'errPcause': ' ', 'errSolution': ' '} ], optype: [Select]) Solution: See the host log for details, and then check the Python stack where the error log is reported. TraceBack (most recent call last): Compile op[Select121] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.1/opp/built-in/op_impl/ai_core/tbe/impl/select.py], optype[Select], taskID[243]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:771] [SubGraphOpt][Compile][ProcFailedCompTask] Thread[281460682519008] recompile single op[Select121] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954] [SubGraphOpt][Compile][ParalCompOp] Thread[281460682519008] process fail task failed[FUNC:ParallelCompileOp][FILE:tbe_op_store_adapter.cc][LINE:1001] [SubGraphOpt][Compile][CompOpOnly] CompileOp failed.[FUNC:CompileOpOnly][FILE:op_compiler.cc][LINE:1127] [GraphOpt][FusedGraph][RunCompile] Failed to compile graph with compiler Normal mode Op Compiler[FUNC:SubGraphCompile][FILE:fe_graph_optimizer.cc][LINE:1292] Call OptimizeFusedGraph failed, ret:-1, engine_name:AIcoreEngine, graph_name:partition0_rank1_new_sub_graph3[FUNC:OptimizeSubGraph][FILE:graph_optimize.cc][LINE:131] subgraph 0 optimize failed[FUNC:OptimizeSubGraphWithMultiThreads][FILE:graph_manager.cc][LINE:996] build graph failed, graph id:120, ret:-1[FUNC:BuildModelWithGraphId][FILE:ge_generator.cc][LINE:1615] [Build][SingleOpModel]call ge interface generator.BuildSingleOpModel failed. ge result = 4294967295[FUNC:ReportCallError][FILE:log_inner.cpp][LINE:161] [Build][Op]Fail to build op model[FUNC:ReportInnerError][FILE:log_inner.cpp][LINE:145] build op model failed, result = 500002[FUNC:ReportInnerError][FILE:log_inner.cpp][LINE:145]
(Please search "Ascend Error Message" at https://www.mindspore.cn for error code description)
Ascend Warning Message:
W11001: Op [Cast2] does not hit the high-priority operator information library, which might result in compromised performance. W49999: If want to reuse binary file, please donwload binary file and install first![FUNC:BuildFusionOp][FILE:fusion_manager.cc][LINE:3763] W11001: Op [ReduceSum17] does not hit the high-priority operator information library, which might result in compromised performance. W11001: Op [Cast22] does not hit the high-priority operator information library, which might result in compromised performance. W11001: Op [Cast31] does not hit the high-priority operator information library, which might result in compromised performance. W11001: Op [ReduceProd117] does not hit the high-priority operator information library, which might result in compromised performance. W11001: Op [ReduceMax119] does not hit the high-priority operator information library, which might result in compromised performance. W49999: Compile error message is:[File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/instrinsic/cce_intrin_md.py", line 5772, in vec_multiple_sel raise RuntimeError("vec_multiple_sel at least has one src")
RuntimeError: [EB9999] vec_multiple_sel at least has one src', 'errPcause': ' ', 'errSolution': ' '} ]. [FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:763] W49999: Open failed, file is already open[FUNC:GetJsonValueFromJsonFile][FILE:fusion_util.cc][LINE:1516]
Hardware Environment(
Ascend
/GPU
/CPU
) / 硬件环境:Software Environment / 软件环境 (Mandatory / 必填): -- MindSpore version 2.2.14 -- Python version 3.9.2 -- OS platform and distribution ubuntu 20.04
Excute Mode / 执行模式 (Mandatory / 必填)(
PyNative
/Graph
):To Reproduce / 重现步骤 (Mandatory / 必填) Steps to reproduce the behavior:
Expected behavior / 预期结果 (Mandatory / 必填) A clear and concise description of what you expected to happen. 模型正常推理
Screenshots/ 日志 / 截图 (Mandatory / 必填) If applicable, add screenshots to help explain your problem.
Additional context / 备注 (Optional / 选填) Add any other context about the problem here.