search

PaddlePaddle / Anakin

High performance Cross-platform Inference-engine, you could run Anakin on x86-cpu,arm, nv-gpu, amd-gpu,bitmain and cambricon devices.
https://anakin.baidu.com/
Apache License 2.0
530 stars 135 forks source link

Does Anakin run multi-thread in its own code? #514

Open avinashcpandey opened 5 years ago

avinashcpandey commented 5 years ago

I see if i set OMP_NUM_THREADS or MKL_NUM_THREADS Anakin runs multi thread. This multithread control threading in MKLML library not in Anakin code. Correct me if i am wrong. Does Anakin support multi-threding in its own code?

qq332982511 commented 5 years ago

YES, we support multi-thread in our JIT code，Convolution，LSTM, and so on, so you have to set OMP_NUM_THREADS. We also use MKL_GEMM , Tanh to build our FC and RNN op. It is also necessary to set MKL_NUM_THREADS