-
## Environment info
- `transformers` version: 4.11.2
- Platform: Linux-4.15.0-154-generic-x86_64-with-debian-buster-sid
- Python version: 3.7.4
- PyTorch version (GPU?): 1.9.1+cu102 (True)
- …
-
## Environment info
- `transformers` version: 4.16.2
- Platform: Linux-5.13.0-39-generic-x86_64-with-glibc2.34
- Python version: 3.9.7
- PyTorch version (GPU?): 1.10.2+cu113 (True)
- Tensorfl…
-
## Environment info
- `transformers` version: 4.9.2
- Platform: Linux
- Python version: 3.8.10
- PyTorch version (GPU?): 1.9.0+cu111 (True)
- Tensorflow version (GPU?): not installed (NA)
- …
-
Same as #1165; the issue is closed now so I'm opening a new one.
It looks like the zero_to_fp32.py still cannot load the correct weights under multi-gpu and ZERO-2 setting.
Loading 'mp_rank_00_mo…
-
Hello! When I upgraded Transformers, I got a massive slowdown. Might be related to the new DataLoader used in Pipeline.
Happy to help!
Cheers,
## Environment info
Environment
- `trans…
-
Hi,
I am interested in your methods. Have you provided the code for the ensemble methods?
Kind regardes,
Qiming
-
## Environment info
- `transformers` version: 4.11.3
- Platform: Linux
- Python version: 3.6.13
- PyTorch version (GPU?): 1.9
- Tensorflow version (GPU?): N/A
- Using GPU in script?: Yes
- …
-
## Environment info
- `transformers` version: 4.15.0
- Platform: Linux-5.4.144+-x86_64-with-Ubuntu-18.04-bionic
- Python version: 3.7.12
- PyTorch version (GPU?): 1.10.0+cu111 (False)
- Tensorf…
-
## Environment info
- `transformers` version: 4.15.0
- Platform: Linux-5.4.144+-x86_64-with-Ubuntu-18.04-bionic
- Python version: 3.7.12
- PyTorch version (GPU?): 1.10.0+cu111 (True)
- Tensor…
-
## Environment info
- `transformers` version: 4.15.0
- Platform: Colaboratory
- Python version: 3.7.12
### Who can help
@LysandreJik
## Information
Hello, this code was working …