-
### System Info
tgi-gaudi 2.0.4
Used below docker compose yaml to launch tgi-gaudi
Serve **llama3.1-70B-instruct model**
--top_k 10
--max_new_tokens 8192
--temperature 0.01
--top_p 0.95
…
-
### 🐛 Describe the bug
AOT autograd's manual regeneration of outputs assumes strided output tensor support. But backends like Habana (https://docs.habana.ai/en/latest/index.html) produces contiguous…
-
I have OCP 4.12.55 Cluster for HPU.
While Deploying app connect, I face the following issues.
Dashboard operand 12.0.6.0-r1 has been installed, but OCP 4.11 or later does not match the supported…
-
I wanted to load Whisper Jax on Intel datacentre GPU Max series. I was wondering should I use Intel OpenXLA extension or Intel extension for transformers? not sure if openxla supports quantisation by …
-
Hello there, I am new to Gaudi devices, I have been trying the toy sample in the repo on AWS DL1. I attempted to map the follow script
```https://github.com/HabanaAI/Model-References/tree/master/PyTo…
-
Models: SASRec / [Version](https://github.com/Sein-Kim/Gaudi-Git/commit/754d31fe7f85adbbd9731782b1ddb7b8523ddbc8)
Datasets: Amazon 2023, All Beauty
![time_loss](https://github.com/user-attachments…
-
-
Hi there,
Your work is awesome. I'm trying to install it on my system for my learning purpose. However, my system cannot support GPU. Can I install it without CUDA?
Your help will be greatly app…
-
https://hpu-yz.github.io/2019/08/05/%E6%9C%B4%E7%B4%A0%E8%B4%9D%E5%8F%B6%E6%96%AF%E7%AE%97%E6%B3%95/
走最远的路,爬最高的山,看最美的风景。, 朴素贝叶斯算法是流行的十大算法之一,该算法是有监督的学习…
-
### Bug description
Pytorch-Lightning Trainer does not find TPU
### What version are you seeing the problem on?
v2.1
### How to reproduce the bug
1. Install torch_xla as guidance and t…