Open youxin1996 opened 1 year ago
@yuslepukhin do you have any insight?
I do not have insights at this point. I will take a look at it as soon as I can.
Would it be possible to get the real data that you use internally?
Would you rather get direct access to the buffer via Memory
Describe the issue
I'm using nuget package Microsoft.ML.OnnxRuntime to inference yolov7 model, use c# .net framework 4.8
After session.run, I have a Tnesor< float > as result, then I need to do some postprocessing, iterate over the Tnesor,but getting elements through [] is too slow,I have 1,867,320 floats need to traverse, it takes almost 300ms(i7 10700 cpu).I think it's because of its get/set methods.Can I just get the float* of Tensor's Buffer then use unsafe code blocks to speed up?
To reproduce
C# code:
c++ code
Urgency
No response
Platform
Windows
OS Version
10
ONNX Runtime Installation
Released Package
ONNX Runtime Version or Commit ID
1.14.1
ONNX Runtime API
C#
Architecture
X64
Execution Provider
Default CPU
Execution Provider Library Version
No response
Model File
No response
Is this a quantized model?
No