-
I can not deploy TGI and TEI service in my Gaudi Kubernetes cluster via GMC, even just use `kubectl apply` as well, such as:
`kubectl apply -f qna_configmap_gaudi.yaml`
`kubectl apply -f tei_embeddi…
-
### System Info
Target: x86_64-unknown-linux-gnu
Cargo version: 1.75.0
Commit sha: N/A
Docker label: N/A
nvidia-smi:
N/A
### Information
- [X] Docker
- [ ] The CLI directly
### Tasks
- [X] A…
-
### Feature request
optimium currently limits transformers to `>= 4.38.0, < 4.39.0`. @regisss bumped the upper version limit in PR #1851 a month ago. Is there any technical reason to limit the upper …
tiran updated
2 months ago
-
### System Info
```shell
optimum-habana-1.11.1
optimum==1.19.1
SynapseAI version: 1.15.1
Docker image: vault.habana.ai/gaudi-docker/1.15.1/ubuntu22.04/habanalabs/pytorch-installer-2.2.0:latest
…
-
For example, if the deployment infrastructure is a Kubernetes cluster and the user has requested the use of GPUs or special purpose accelerators that do not exist, promptly return failure message.
Oc…
-
### 🚀 The feature, motivation and pitch
co-authors:
Intel: @jgong5 @bsochack @sujoysaraswati @gujinghui @xiaodonglin1
Huawei: @yikun @hipudding
PyTorch has been continuously expanding its supp…
-
### Feature request
1. [Model] chinese-alpaca-2-7b
2. [Hardware] Gaudi2C
3. [Method] LoRA and FineTuning
4. [Related codes] examples/language_modeling
5. [Test Cmdlines]:
- **LoRA**:
```bas…
-
-
### System Info
```shell
docker image:
vault.habana.ai/gaudi-docker/1.15.1/ubuntu22.04/habanalabs/pytorch-installer-2.2.0:latest
oh:
https://github.com/huggingface/optimum-habana/tree/bb6be54d11…
-
### Description
@peytondmurray, @akshay-anyscale @angelinalg and I had a discussion on how better to organize the Ray Serve examples page.
Instead of Beginner, Intermediate, Advanced in the curr…