mymagicpower / AIAS

AIAS (AI Acceleration Suite) - 人工智能加速器套件。提供: 包括SDK,平台引擎,场景套件在内,合计超过100个项目组成的项目集。
Apache License 2.0
651 stars 233 forks source link

how to enable mkldnn on paddle engine #6

Open ruhengChen opened 2 years ago

ruhengChen commented 2 years ago

Description

I tried .optOptions(Collections.singletonMap("enableMKLDNN", "true")) to create Criteria and find the options of PpModel added indeead, but it did not work. how to fix this?

Expected Behavior

enable mkldnn on paddle engine

Environment Info

os.name: Windows 10 amd64

------------------ CUDA -----------------
[DEBUG] - No cudart library found in path.
GPU Count: 0

----------------- Engines ---------------
DJL version: 0.18.0
Default Engine: MXNet
[DEBUG] - Using cache dir: C:\Users\CRH\.djl.ai\mxnet\1.9.0-mkl-win-x86_64
[INFO ] - Downloading libgcc_s_seh-1.dll ...
[INFO ] - Downloading libgfortran-3.dll ...
[INFO ] - Downloading libopenblas.dll ...
[INFO ] - Downloading libquadmath-0.dll ...
[INFO ] - Downloading mxnet.dll ...
[DEBUG] - Loading mxnet library from: C:\Users\CRH\.djl.ai\mxnet\1.9.0-mkl-win-x86_64\mxnet.dll
Default Device: cpu()
PyTorch: 2
MXNet: 0
XGBoost: 10
TensorFlow: 3
mymagicpower commented 2 years ago

For paddlepaddle this feature is not enabled (i think). Contact DJL team to get further/deep engine support. For other engines, refer to below link: http://docs.djl.ai/docs/development/inference_performance_optimization.html