oneapi-src / oneDNN

oneAPI Deep Neural Network Library (oneDNN)
https://uxlfoundation.org
Apache License 2.0
3.61k stars 1k forks source link

Add support for inference on Greco #1369

Closed WilliamTambellini closed 2 years ago

WilliamTambellini commented 2 years ago

Summary

Add support for at least inference on greco: https://habana.ai/inference/greco/

Problem statement

As today, there does nt seem to be any connection/wrappers between the synapseAI sdk and oneAPI/oneDNN: https://docs.habana.ai/en/latest/Gaudi_Overview/SynapseAI_Software_Suite.html

Preferred solution

Add support in oneDNN to run at lest the forward ops on Greco.

densamoilov commented 2 years ago

Hi @WilliamTambellini, as far as I understand SynapseAI is already integrated in TensorFlow and PyTorch, which enables Habana kernels for Habana hardware. What benefits do you see in adding such kernels in oneDNN?

vpirogov commented 2 years ago

No immediate plans to implement support for Habana accelerators.