-
### Describe the bug
PyTorch `multi_head_attention` code enforces that data size and mask size matches.
https://github.com/pytorch/pytorch/blob/df4e3d9d08f3d5d5439c3626be4bf29659488cdf/torch/nn/fu…
-
Hello, Now I have an error when I run the evaluation.py in visualstorytelling section, it seems due to the definition of EncoderOut in visualstorytelling/generator.py which is a namedtuple. error is a…
-
### Your current environment
The output of `python collect_env.py`
```text
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A…
-
File "/workdir/user_repository/inference/local_deploy_demo.py", line 41, in load_model
self.model = AutoModelForCausalLM.from_pretrained(path, device_map="auto", trust_remote_code=True,
File…
-
IPEX has restriction on transformers version, but llm-on-ray doesn't have. To verify IPEX and other llm-on-ray functions in parallel in CI, we can add a new ipex extra in pyproject.toml with right tra…
-
**Describe the bug**
when run line:model.quantize(examples) got AttributeError: 'NoneType' object has no attribute 'parameters'
**GPU Info**
Show output of:
```
+-------------------…
-
When I try to install fast-transformers i get the following error
[LOG_FILE_PIP.txt](https://github.com/idiap/fast-transformers/files/5470615/LOG_FILE_PIP.txt)
this after running `pip install pytorc…
-
### 📚 Documentation
Hi lightning team,
I am trying to implement finetuning of a custom model I have pretrained weights of.
It's a transformer architecture with a classification head on it.
I f…
-
Hello everyone, I have a pose estimation model(SPNv2). I converted the model from Pytorch FP32 to OpenVINO FP16 IR representation (passing by onnx).
OpenVINO version: 2022.3.1
When I tried to ru…
-
Is it possible to export to ONNX and run inference without depending on PyTorch?