-
### Your current environment
Collecting environment information...
/home/sdp/miniforge3/envs/liangan1/lib/python3.10/site-packages/transformers/utils/hub.py:128: FutureWarning: Using `TRANSFORMERS_C…
-
### 🐛 Describe the bug
With a 2D spatial neighborhood pattern, flash attention is orders of magnitude slower than dense attention:
hlc=2
seq_length : 192
flex attention : 0.0015106382369995117 […
-
### Your current environment
```text
The output of `python collect_env.py`
```
PyTorch version: 2.1.2+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: …
-
### System Info
```
~/work/llama-stack/distributions/meta-reference-gpu (main)]$ python -m "torch.utils.collect_env"
/home/kaiwu/.conda/envs/llamastack-meta-reference-gpu/lib/python3.10/runpy.py:12…
-
Platforms: linux
This test was disabled because it is failing in CI. See [recent examples](https://hud.pytorch.org/flakytest?name=test_comprehensive_scatter_reduce_prod_cpu_float32&suite=TestInductor…
-
### 🚀 The feature, motivation and pitch
I am working on building a demo that using NV GPU as a comparison with intel XPU.
Additionally, I wonder if it's possible to distribute part of the computat…
-
A module that was compiled using NumPy 1.x cannot be run in
NumPy 2.0.1 as it may crash. To support both 1.x and 2.x
versions of NumPy, modules must be compiled with NumPy 2.0.
Some module may need…
-
Possible duplicate of #5, with [solution](https://github.com/user-attachments/files/16560669/install_dependencies.zip) provided there already, but I'm going to post an issue ticket here as a warning. …
-
### Your current environment
The output of `python collect_env.py`
(pytorch) [opc@instance-20240805-1058 ~]$ python collect_env.py
Collecting environment information...
PyTorch version: 2.4.0
…
-
### 🐛 Describe the bug
Using nested tensors generated with `torch.narrow` as inputs to `torch.nn.functional.scaled_dot_product_attention` works fine in the forward pass of the model. However, both …