-
-
I encounter xla_extension failed when I try to run exla while building a docker container. Here are some of the snippets from my Dockerfile:
```
ARG BUILDER_IMAGE="hexpm/elixir:1.14.0-erlang-24.0.1-…
-
Hello,
I'm very new to the XLA project, so pardon my ignorance here. I'm trying to learn more about the project, optimizations, and their interactions with the hardware. The code everywhere seems w…
-
## 🐛 Bug Report
When using [dynamo sharding](https://github.com/pytorch/xla/blob/88bcb45fda546e5c1fb4f12de75251bfa5fd332e/torch_xla/core/custom_kernel.py#L17) inside `torch.compile`, I encounter th…
-
## 🐛 Bug
The step function inside the `while_loop` operator can't create or reference extra tensors or constants. Doing so crashes Python while lowering.
## To Reproduce
```python
import tor…
-
-
### 🚀 The feature, motivation and pitch
`torch.compile` can takes order of seconds to compile a decent size model like Llama2 7B with a `aot-autogra` enabled backend. Note that I only include the `dy…
-
pip install torch_xla[tpu]~=2.3.0 -f https://storage.googleapis.com/libtpu-releases/index.html
ERROR: Could not find a version that satisfies the requirement torch_xla~=2.3.0 (from versions: none)
…
-
## 🐛 Bug
The following [GPT-2 code](https://github.com/miladm/build-nanogpt-ptxla/commit/4135bfc7fc577af93b88e31e0228f2d4fb9a775d) OOMs on TPU v4-8 with >4 attention layers (i.e. `n_layer > 4`). Th…
-
## 🚀 Description
Pipeline parallelism is a technique used in deep learning model training to improve efficiency and reduce the training time of large neural networks. Here we propose a pipeline paral…