-
### System Info
```shell
The examples provided do not work correctly, I think there has been updates in the intel neural compressor toolkit, which is now 3.0. and the habana quantization toolkit, and…
-
### System Info
```shell
optimum-habana 1.13.2
+-----------------------------------------------------------------------------+
| HL-SMI Version: hl-1.…
-
### System Info
```shell
(habanalabs-venv) (habanalabs-venv) root@vmInstancetmhmacpr:~/lier_workload/test# python inference_test.py
/usr/lib/python3.10/inspect.py:288: FutureWarning: `torch.distrib…
-
### Your current environment
I am testing the offline performance using `benchmark_latency.py`. And I found there's no any increasing/decreasing when I change the prompt bucket shape, even I use (1,1…
-
follow the instructions on
https://github.com/HabanaAI/Model-References/tree/master/MLPERF3.1/Training/benchmarks
to execute comamnd:
`python3 pack_pretraining_data_pytorch.py --input_dir=$PYT…
-
### System Info
```shell
+-----------------------------------------------------------------------------+
| HL-SMI Version: hl-1.17.0-fw-51.1.0 |
| Driver Ver…
-
**Feature Overview (aka. Goal Summary)**
Implement Intel Gaudi support in InstructLab project, so Gaudi 2 and Gaudi 3 can be used for SDG, evaluation, and training.
**Goals (aka. expected user outcom…
ktam3 updated
2 weeks ago
-
### System Info
```shell
System Configuration: Single node Habana Gaudi setup
Firmware Version: hl-1.15.0-fw-48.2.1.1
Software Stack: Synapse AI 1.15
```
### Information
- [ ] The official examp…
-
### System Info
root@laion-gaudi2-00:/home/sdp# docker run -p 8081:80 -v $volume:/data --runtime=habana -e HUGGING_FACE_HUB_TOKEN=$hf_token -e PT_HPU_ENABLE_LAZY_COLLECTIVES=true -e HABANA_VISIBLE_DE…
-
Getting the below error when trying to run the Llam2 70B benchmark as given in the link - [Here](https://github.com/HabanaAI/Model-References/tree/master/MLPERF4.0/Training/benchmarks/llm_finetune) wi…