-
Hi
Could you help me regarding this output:
python single_case_prediction.py --conf P2Y14_example/hparams.yaml --ckpt_path ckpts/with_ligand.ckpt --input_fn P2Y14_example/P2Y14_AF.pdb,P2Y14_ex…
-
### 🐛 Describe the bug
PR 115 - 969bd835 Do reshape_and_cache in bulk for prompt (#115) will result in HPUGraph forward replayV3 failure in TensorParallel mode.
=== Details ===
* Code Base
…
-
### System Info
```shell
optimum-habana: v1.13.2
habanalabs-dkms/jammy 1.17.1-40
DOCKER_IMAGE=vault.habana.ai/gaudi-docker/1.17.1/ubuntu22.04/habanalabs/pytorch-installer-2.3.1:latest
```
### Inf…
-
### What happened + What you expected to happen
![image](https://github.com/ray-project/ray/assets/26745457/125d66e7-a3d9-4c9d-9bdd-fa48b7a9a2a6)
The author of [this PR](https://github.com/ray-p…
-
### System Info
```shell
The examples provided do not work correctly, I think there has been updates in the intel neural compressor toolkit, which is now 3.0. and the habana quantization toolkit, and…
-
### 🚀 The feature, motivation and pitch
This RFC proposes an enhancement to torch.compile to improve its backend agnosticism. The goal is to enable a more seamless experience for users working with d…
-
### Your current environment
Command line:
```
cd vllm-fork/benchmarks
python benchmark_latency.py \
--model meta-llama/Meta-Llama-3-8B \
--dtype bfloat16 \
--output-len 128 \
…
-
I downloaded the checkpoints from hugging face and loaded them. I am up to the embedder step in this tutorial https://github.com/jkobject/scPRINT/blob/main/docs/notebooks/cancer_usecase.ipynb
I fir…
-
### 🚀 The feature, motivation and pitch
`torch.utils.checkpoint.checkpoint` has a strong limitation: there must be no graph break, and if it can't be satisfied, it will fall back to eager with this d…
-
### Description
Hello Ray maintainers and community,
we've been using Ray for our works and find it to be a valuable tool for scalable and distributed machine learning. I believe it would be ben…