argonne-lcf / dlio_benchmark

An I/O benchmark for deep Learning applications
https://dlio-benchmark.readthedocs.io
Apache License 2.0
65 stars 30 forks source link

Is computation_time only related to the GPU model? #219

Open LLJING-ER opened 2 months ago

LLJING-ER commented 2 months ago

I'm trying to create a config file *.yaml, but confused about the meaning of computation_time , is it related to batchsize? If I change the batchsize, do I need to run the actual workload to find out the corresponding computation_time**?

zhenghh04 commented 2 months ago

Yes it is related to the batch size. It is the computation time for processing one batch of data. So you'll have to measure the computation time in the actual hardware for that.

LLJING-ER commented 2 months ago

It is necessary to maintain consistent data format. How do you measure the computation_time of NPZ format data in UNET3D? Can you provide me with a reference code?

LLJING-ER commented 2 months ago

If possible, please also provide a copy of the test code in tfrecord format for the cosmoflow workload