-
Hello,
I generated mapping for facebook/opt-6.7b model, which has vocab size of 50265.
But when I continue to generate the watermark output, it shows this error.
```
File "/network/rit/lab/L…
-
-
Ryzen 7 2700x GTX 1080 16GB DDR4 CUDA 12.5
I always get this error whenever I click generate.
Possible latent mismatch: click the "(Re)Compute Voice Latents" button and then try again. Error: Size…
-
### Reason/inspiration (optional)
We would like a new entry on the `tensor` concept under PyTorch. The entry should go in a new file under `docs/content/pytorch/concepts/tensor/tensor.md`.
The entry…
-
```
~ via 🐍 v3.11.9 (insanely-fast-whisper)
❯ pipx list
venvs are in ~/.local/pipx/venvs
apps are exposed on your $PATH at ~/.local/bin
manual pages are exposed at ~/.local/share/man
package …
-
### 🚀 The feature, motivation and pitch
`MLPSpeculator`-based speculative decoding was recently added in https://github.com/vllm-project/vllm/pull/4947, but the initial integration only covers sing…
-
### Objective:
Implement sub byte integer quantization baselines from 1-7 to enable users to experiment with low bit quantization in pytorch. They can also use these as a baseline if they want to cr…
-
I feel very confused!
First of all, the latent size is different from the size of the mask and the size of the loaded image to generate the image, but some sizes will report errors. For example, I lo…
-
torch-npu 2.2.0
`import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
device = "npu"
# THUDM/glm49bchat
tokenizer = AutoTokenizer.from_pretrained("/home…
-
### 🐛 Describe the bug
torch.nested.as_nested_tensor fails with tensor on device, works with tensor on CPU:
```
>>> a = torch.ones( 10, 5, 16)
>>> b = torch.nested.as_nested_tensor( a, layout=to…