baidu-research / DeepBench

Benchmarking Deep Learning operations on different hardware
Apache License 2.0
1.07k stars 239 forks source link

Error in running DeepBench #52

Closed BenjaminWangW closed 7 years ago

BenjaminWangW commented 7 years ago

Hi, I used Cuda 8.0, cuDNN 5.0 for Cuda 8.0, Openmpi 1.10.2, while running gemm_bench, but I met the error below. I used the following command to compile the code. make CUDA_PATH=/usr/local/cuda-8.0 CUDNN_PATH=/home/wangweiw/cuda MPI_PATH=/home/wangweiw/openmpi-1.10.2/build NCCL_PATH=/home/wangweiw/nccl/build ARCH=sm_61 The error is Running training benchmark Times

m       n      k      a_t     b_t      precision        time (usec) 

terminate called after throwing an instance of 'thrust::system::system_error' what(): function_attributes(): after cudaFuncGetAttributes: invalid device function 1760 16 1760 0 0Aborted I don't know what goes wrong.

sharannarang commented 7 years ago

@BenjaminWangW , which GPU are you using for the benchmark?

BenjaminWangW commented 7 years ago

@sharannarang thanks for reply,the GPUS are P100

sharannarang commented 7 years ago

The ARCH for P100 should be sm_60. Please recompile the code with the correct architecture and try again.

sharannarang commented 7 years ago

Closing this issue. Please reopen if the problem persists.