Is your feature request related to a problem? Please describe.
Experimentation shows that results on NVIDIA GPUs is a bit further from CPU results, for some reason, than it is on e.g. Apple M1. An example on an 1080 Ti:
cargo run --features=cpu --release -- infer ./data/models/opt-squeeze.onnx -i data=./data/images/pelican.jpeg --labels ./data/models/squeeze-labels.txt --top 3 --compare --benchmark
Error: Comparison("output element 285 differs too much: GPU says 8.999586 vs CPU says 8.999575 (difference is 0.000011444092)")
Describe the solution you'd like
Allow slightly more difference to exist between CPU and GPU before showing a warning (or make this configurable).
Is your feature request related to a problem? Please describe. Experimentation shows that results on NVIDIA GPUs is a bit further from CPU results, for some reason, than it is on e.g. Apple M1. An example on an 1080 Ti:
Describe the solution you'd like
Allow slightly more difference to exist between CPU and GPU before showing a warning (or make this configurable).