Closed eolecvk closed 1 year ago
Add benchmarking script, tracking runtime and GPU% / memory usage at inference.
Link to blog
Add benchmarking script, tracking runtime and GPU% / memory usage at inference.