microsoft / onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
https://onnxruntime.ai
MIT License
13.53k stars 2.76k forks source link

inference is different on linux and windows #11993

Open cqray1990 opened 2 years ago

cqray1990 commented 2 years ago

Describe the bug A clear and concise description of what the bug is. To avoid repetition please make sure this is not one of the known issues mentioned on the respective release page.

Urgency If there are particular important use cases blocked by this or strict project-related timelines, please share more information and dates. If there are no hard deadlines, please specify none.

System information

wth th same onnx model, i run on linux there is no warings,but on windows it occurs as follows with c# code: i have no solutions about it , that's wired,i am sure i use the same onnx model

2022-06-26 07:39:46.5797282 [I:onnxruntime:, inference_session.cc:230 onnxruntime::InferenceSession::ConstructorCommon] Creating and using per session threadpools since use_per_sessionthreads is true 2022-06-26 07:39:46.5952765 [I:onnxruntime:, inference_session.cc:1081 onnxruntime::InferenceSession::Initialize] Initializing session. 2022-06-26 07:39:46.5975383 [I:onnxruntime:, inference_session.cc:1106 onnxruntime::InferenceSession::Initialize] Adding default CPU execution provider. 2022-06-26 07:39:46.6024628 [I:onnxruntime:, reshape_fusion.cc:37 onnxruntime::ReshapeFusion::ApplyImpl] Total fused reshape node count: 0 2022-06-26 07:39:46.6070077 [I:onnxruntime:, graph.cc:3096 onnxruntime::Graph::CleanUnusedInitializers] Removing initializer 'backbone.stages.3.0.se.conv2.weight'. It is no longer used by any node. 2022-06-26 07:39:46.6103350 [I:onnxruntime:, graph.cc:3096 onnxruntime::Graph::CleanUnusedInitializers] Removing initializer 'backbone.stages.1.0.se.conv2.bias'. It is no longer used by any node. 2022-06-26 07:39:46.6131179 [I:onnxruntime:, graph.cc:3096 onnxruntime::Graph::CleanUnusedInitializers] Removing initializer 'backbone.stages.1.0.se.conv2.weight'. It is no longer used by any node. 2022-06-26 07:39:46.6157532 [I:onnxruntime:, graph.cc:3096 onnxruntime::Graph::CleanUnusedInitializers] Removing initializer 'backbone.stages.1.1.se.conv2.bias'. It is no longer used by any node. 2022-06-26 07:39:46.6183754 [I:onnxruntime:, graph.cc:3096 onnxruntime::Graph::CleanUnusedInitializers] Removing initializer 'backbone.stages.1.1.se.conv2.weight'. It is no longer used by any node. 2022-06-26 07:39:46.6223225 [I:onnxruntime:, graph.cc:3096 onnxruntime::Graph::CleanUnusedInitializers] Removing initializer 'backbone.stages.1.2.se.conv2.bias'. It is no longer used by any node. 2022-06-26 07:39:46.6252255 [I:onnxruntime:, graph.cc:3096 onnxruntime::Graph::CleanUnusedInitializers] Removing initializer 'backbone.stages.1.2.se.conv2.weight'. It is no longer used by any node. 2022-06-26 07:39:46.6279200 [I:onnxruntime:, graph.cc:3096 onnxruntime::Graph::CleanUnusedInitializers] Removing initializer 'backbone.stages.3.2.se.conv2.weight'. It is no longer used by any node. 2022-06-26 07:39:46.6304345 [I:onnxruntime:, graph.cc:3096 onnxruntime::Graph::CleanUnusedInitializers] Removing initializer 'backbone.stages.2.4.se.conv2.bias'. It is no longer used by any node. 2022-06-26 07:39:46.6330252 [I:onnxruntime:, graph.cc:3096 onnxruntime::Graph::CleanUnusedInitializers] Removing initializer 'backbone.stages.2.4.se.conv2.weight'. It is no longer used by any node. 2022-06-26 07:39:46.6358892 [I:onnxruntime:, graph.cc:3096 onnxruntime::Graph::CleanUnusedInitializers] Removing initializer 'backbone.stages.2.5.se.conv2.bias'. It is no longer used by any node. 2022-06-26 07:39:46.6388152 [I:onnxruntime:, graph.cc:3096 onnxruntime::Graph::CleanUnusedInitializers] Removing initializer 'backbone.stages.2.5.se.conv2.weight'. It is no longer used by any node. 2022-06-26 07:39:46.6431981 [I:onnxruntime:, graph.cc:3096 onnxruntime::Graph::CleanUnusedInitializers] Removing initializer 'backbone.stages.3.0.se.conv2.bias'. It is no longer used by any node. 2022-06-26 07:39:46.6461263 [I:onnxruntime:, graph.cc:3096 onnxruntime::Graph::CleanUnusedInitializers] Removing initializer 'backbone.stages.3.1.se.conv2.bias'. It is no longer used by any node. 2022-06-26 07:39:46.6491511 [I:onnxruntime:, graph.cc:3096 onnxruntime::Graph::CleanUnusedInitializers] Removing initializer 'backbone.stages.3.2.se.conv2.bias'. It is no longer used by any node. 2022-06-26 07:39:46.6523510 [I:onnxruntime:, graph.cc:3096 onnxruntime::Graph::CleanUnusedInitializers] Removing initializer 'backbone.stages.3.1.se.conv2.weight'. It is no longer used by any node. 2022-06-26 07:39:46.6568253 [I:onnxruntime:, graph.cc:3096 onnxruntime::Graph::CleanUnusedInitializers] Removing initializer '446'. It is no longer used by any node. 2022-06-26 07:39:46.6601788 [I:onnxruntime:, reshape_fusion.cc:37 onnxruntime::ReshapeFusion::ApplyImpl] Total fused reshape node count: 0 2022-06-26 07:39:46.6654744 [I:onnxruntime:, reshape_fusion.cc:37 onnxruntime::ReshapeFusion::ApplyImpl] Total fused reshape node count: 0 2022-06-26 07:39:46.6955955 [I:onnxruntime:, session_state_utils.cc:100 onnxruntime::session_state_utils::SaveInitializedTensors] Saving initialized tensors. 2022-06-26 07:39:46.6988725 [I:onnxruntime:, session_state_utils.cc:170 onnxruntime::session_state_utils::SaveInitializedTensors] [Memory] SessionStateInitializer statically allocates 768 bytes for Cpu

2022-06-26 07:39:46.7011915 [I:onnxruntime:, session_state_utils.cc:170 onnxruntime::session_state_utils::SaveInitializedTensors] [Memory] SessionStateInitializer statically allocates 6707968 bytes for Cuda

2022-06-26 07:39:46.7110036 [I:onnxruntime:, session_state_utils.cc:212 onnxruntime::session_state_utils::SaveInitializedTensors] Done saving initialized tensors 2022-06-26 07:39:46.7142777 [I:onnxruntime:, inference_session.cc:1256 onnxruntime::InferenceSession::Initialize] Session successfully initialized. 2022-06-26 07:39:46.7988220 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer 375 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.8081576 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer 376 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.8143254 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer 417 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.8194568 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer 418 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.8240057 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer 419 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.8297787 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer 420 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.8342443 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer 421 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.8390132 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer 422 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.8441175 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer 463 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.8487403 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer 464 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.8535423 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer 465 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.8588892 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer 466 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.8646969 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer cnn.ConvNet.0.bias appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.8718163 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer cnn.ConvNet.0.weight appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.8771748 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer cnn.ConvNet.11.weight appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.8819013 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer cnn.ConvNet.12.bias appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.8868071 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer cnn.ConvNet.12.running_mean appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.8921859 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer cnn.ConvNet.12.running_var appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.8969171 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer cnn.ConvNet.12.weight appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.9015792 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer cnn.ConvNet.14.weight appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.9072555 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer cnn.ConvNet.15.bias appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.9119771 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer cnn.ConvNet.15.running_mean appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.9166707 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer cnn.ConvNet.15.running_var appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.9218073 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer cnn.ConvNet.15.weight appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.9289717 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer cnn.ConvNet.18.bias appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.9366731 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer cnn.ConvNet.18.weight appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.9445339 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer cnn.ConvNet.3.bias appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.9492543 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer cnn.ConvNet.3.weight appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.9562599 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer cnn.ConvNet.6.bias appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.9633014 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer cnn.ConvNet.6.weight appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.9707937 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer cnn.ConvNet.8.bias appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.9755314 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer cnn.ConvNet.8.weight appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.9801341 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer rnn.0.embedding.bias appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.9856676 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer rnn.0.embedding.weight appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.9904876 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer rnn.1.embedding.bias appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:46.9958298 [W:onnxruntime:, graph.cc:1069 onnxruntime::Graph::Graph] Initializer rnn.1.embedding.weight appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py. 2022-06-26 07:39:47.0060425 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0086717 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0104373 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0121946 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0139488 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0163449 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0183537 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0203830 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0221312 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0238841 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0256255 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0273589 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0291331 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0308753 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0336761 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0356924 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0374322 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0393556 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0412086 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0431101 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0448481 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0466624 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0493076 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0510403 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0530491 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node: 2022-06-26 07:39:47.0549263 [W:onnxruntime:CSharpOnnxRuntime, fallback_cpu_capability.h:140 onnxruntime::GetCpuPreferedNodes] Force fallback to CPU execution for node:

hariharans29 commented 2 years ago

With the same ONNX model and same ORT version, things can't chnge this drastically from Windows and Linux. Can you share how you are invoking the model on Linux and Windows ?

Also, is there a reason you are bound to a reasonably old ORT version (1.6) ?

cqray1990 commented 2 years ago

@hariharans29 i use the same onnx model, and using python code to do inference ,and on widons i use C#, the i am sure the model is same,and onnxruntime-gpu is 1.6.0