search

NVIDIA-Merlin / HugeCTR

HugeCTR is a high efficiency GPU framework designed for Click-Through-Rate (CTR) estimating training
Apache License 2.0
937 stars 200 forks source link

[Question] How to get the performance of inference #379

Closed liangxuegang closed 1 year ago

liangxuegang commented 1 year ago

Hi, how can I get the performance of inference in HugeCTR? I want to get the time of host2device, device2host and model run

jershi425 commented 1 year ago

@liangxuegang Thanks for the question. For inference performance, please refer to the HPS profiler.

liangxuegang commented 1 year ago

Thanks for responding, I will have a try