openvinotoolkit / openvino

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
https://docs.openvino.ai
Apache License 2.0
7.37k stars 2.31k forks source link

Does OpenVino use oneDNN? #466

Closed saiyajin-sp closed 2 years ago

saiyajin-sp commented 4 years ago

I'm using OpenVion version 2020.1.033 in one project. Also, another project uses MKL-DNN (Intel MKL ver 2018.3.210), but I would like to replace it with oneDNN. In this case, I don't know the difference whether it is better to use oneDNN or replace with openVino. Does OpenVino use oneDNN internally?

dmitry-gorokhov commented 4 years ago

@saiyajin-sp OpenVINO uses oneDNN fork internally. To be more specific fork is based on v0.21.3 version of original repo and contains several features applied above.

saiyajin-sp commented 4 years ago

@dmitry-gorokhov Thank you for the information. Where can I find the relationship between versions? If not, please consider adding it in the future.

Thanks.

BillyONeal commented 1 year ago

Considering oneDNN is at version 3.2, but the fork in use here is from 0.21, it seems like this makes it hard to include both oneDNN and openvino in a software repository...

2catycm commented 1 year ago

So, which one has a better performance? It seems that OpenVINO and oneDNN are of the exaclty same function.

wenjiew commented 1 year ago

New oneDNN versions were integrated into OpenVINO as oneDNN releases are out. This question was from three years ago, and OpenVINO has upgraded the oneDNN version almost in every release. Latest release of OpenVINO 2023.1 will have oneDNN 3.2 release.

OpenVINO provides deep learning network level acceleration, which is different with oneDNN. That is the reason that oneDNN was included in OpenVINO for underlying kernel implementation as buliding blocks. https://www.intel.com/content/www/us/en/developer/tools/oneapi/onednn.html