-
## 🚀 Description
Pipeline parallelism is a technique used in deep learning model training to improve efficiency and reduce the training time of large neural networks. Here we propose a pipeline paral…
-
When I run `accelerate launch distil_logits.py`, I get the following error. ( I'm using a 40G A100 from Colab.
```
The following values were not passed to `accelerate launch` and had defaults use…
-
After training and during inference this error was found
```
1092, in xla_dynamic_slice_eager_fallback
_result = _execute.execute(b"XlaDynamicSlice", 1, inputs=_inputs_flat,
tensorflow.pytho…
-
## Fix the Op info test for `masked.softmax .. masked.var`
1. Find the lines 173 to 177 of [test_ops.py](test/test_ops.py) and remove
`masked.softmax` .. `masked.var` from `skip_list`
2. Run op_in…
-
### Your current environment
The output of `python collect_env.py`
```
Collecting environment information...
Traceback (most recent call last):
File "/home/kojoe/EasyAnimate/easyanimate/i…
-
detail:
NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4
for Kepler GPUs are removed from CUDA 12.x. how can i compile torch_xla for gpu in CUDA Version 12.X(GPU guide use CUDA1…
-
## Fix the Op info test for `nn.functional.feature_alpha_dropout .. nn.functional.grid_sample`
1. Find the lines 223 to 227 of [test_ops.py](test/test_ops.py) and remove
`nn.functional.feature_alp…
-
# Compiling xla locally | tyoc213 blog
tools and env vars needed to compile xla locally with GPU support
[https://tyoc213.github.io/blog/xla/fastai/2020/11/28/compiling-xla-locally.html](https://tyo…
-
I'm scratching my head at the following case, where we're [trying](https://github.com/conda-forge/tensorflow-feedstock/pull/385) to build the most recent tensorflow in conda-forge (tensorflow in itsel…
-
# Context
## Objective
In this RFC I will talk about the roadmap to enable eager mode as the default computation mode for PyTorch/XLA users and how to enable graph compilation in this mode.
…