Tutorials for running models on First-gen Gaudi and Gaudi2 for Training and Inference. The source files for the tutorials on https://developer.habana.ai/
From my experience it sounds possible. I was thinking to use adapt_transformers class to adapt the HF classes for Gaudi using optimum habana. Unfortunately the habana_framework library is giving me errors and the tutorial is buggy.
Now, I am quite lost how can I run this model on Intel Gaudi. Can you provide some help? I looked into iPex library and it wasn't much helpful as well.
I'm trying to run this embedding model on Intel Gaudi node. https://huggingface.co/BAAI/bge-m3
From my experience it sounds possible. I was thinking to use adapt_transformers class to adapt the HF classes for Gaudi using optimum habana. Unfortunately the habana_framework library is giving me errors and the tutorial is buggy.
https://github.com/HabanaAI/Gaudi-tutorials/blob/main/PyTorch/Hugging_Face_pipelines/image-classification.ipynb
Now, I am quite lost how can I run this model on Intel Gaudi. Can you provide some help? I looked into iPex library and it wasn't much helpful as well.