[Task]: Throughput in benchmarking

openvinotoolkit / anomalib

An anomaly detection library comprising state-of-the-art algorithms and features such as experiment management, hyper-parameter optimization, and edge inference.

https://anomalib.readthedocs.io/en/latest/

Apache License 2.0

3.69k stars 655 forks source link

[Task]: Throughput in benchmarking #2054

Open ashwinvaidya17 opened 4 months ago

ashwinvaidya17 commented 4 months ago

What is the motivation for this task?

Match previous design

Describe the solution you'd like

Restore torch, lightning, OpenVINO throughput in the new benchmarking design.

Additional context

No response

ashwinvaidya17 commented 2 months ago

Saving for later: https://pytorch.org/tnt/stable/utils/generated/torchtnt.utils.flops.FlopTensorDispatchMode.html#torchtnt.utils.flops.FlopTensorDispatchMode