-
I am encountering the following error while executing run_scripts/gt_sweep.sh:
`File "Edge-Pruning/src/modeling/modeling_fpt2.py", line 1293, in forward
hidden_states, embeds, z_nodes_sum = self…
-
### 🚀 The feature, motivation and pitch
Hi folks,
Thank you for your great effort in implementing KV cache compression methods in vLLM. I recently tried running experiments with tensor parallel …
-
Having been fiddling with the front-end loss function code and having been looking at mini-Vehicle for the paper, it's become apparent to me that we really should switch to tensors in the front-end. I…
-
Hello,
I am trying to remove the segmentation head and add some more layers before adding segmentation head to my model.
But whenever I pass my encoder output to the decoder I keep getting this Er…
-
If one run `main.py` he will get the following error:
```
hidden_states.shape=torch.Size([2, 2304, 3072])
encoder_hidden_states.shape=torch.Size([2, 512, 3072])
image_rotary_emb.shape=torch.Size([…
-
# 平台(如果交叉编译请再附上交叉编译目标平台):
# Platform(Include target platform as well if cross-compiling):
- x84_64 ubuntu20.04
- raspberry 3b+
# mnn版本:
# mnn Version:
2.9.5
I use pytorch->onnx->mnn to …
-
### Your current environment
This issue is easy to reproduce. In AWS:
1) Spin up EC2
2) Use the Deep Learning OSS Nvidia Driver AMI GPU PyTorch 2.3.1 (Ubuntu 20.04)
3) Select g5.12xlarge (which co…
-
Hello, I am attempting to fine tune the Aurora model, when I came across a dimensionality issue when using the predicted data for loss. Here is what the input tensor dimension looks for me:
`batch.sur…
-
### What happened?
When compiling the scheduler IR, we are seeing the following error:
```
/data/e2eshark/actions-runner-turbine/_work/SHARK-ModelDev/SHARK-ModelDev/vmfbs/stable_diffusion_xl_base_1_…
-
### Reason/inspiration (optional)
We would like a new entry on the `.index_copy()` term under PyTorch. The entry should go in a new file under `docs/content/pytorch/concepts/tensor-operations/terms/i…