Closed jameslahm closed 1 year ago
Hi @jameslahm ,
Thanks for your interest in our work!
The part of onnx throughput benchmarking is included in some private projects, so we may not be able to release it directly at present. However, you may implement an onnx throughput inference script by referencing official onnxruntime doc and speed_test jointly. Please feel free to contact me if there are any other questions. Thanks!
Best, Xinyu
Thanks!
Thanks for your great work! Would you mind sharing the benchmark code for onnx? Thanks!