-
## Environment info
- `transformers` version: 4.16.2
- Platform: Ubuntu
- Python version: 3.8
- PyTorch version (GPU?): 1.8
- Tensorflow version (GPU?): none
- Using GPU in script?: yes
- U…
-
Thanks for this great package.
For some of the bigger models used by this library, like GPT-NEO-2.7, the GPU memory requirements are quite large.
I would expect therefore that many users of this…
-
Hi,
You guys are doing a great job with it.
I have tried your flax-community/gpt-neo-1.3B-apps-all model,
and the generated code is kinda hit or miss.
This is generated using
flax-community…
-
Hello,I found a performance issue in the definition of `lambada_input` ,
EleutherAI/gpt-neo/blob/master/tasks.py,
[dataset.map](https://github.com/EleutherAI/gpt-neo/blob/5f3055b026652b1a2e64bb8330c…
-
## Environment info
- `transformers` version: `master` (probably any version)
- Platform: ubuntu
- Python version: 3.9
- PyTorch version (GPU?): 1.10
- Tensorflow version (GPU?): X
- Using G…
-
Under the official tutorials with deepspeed 0.5.8
```python
# Filename: gpt-neo-2.7b-generation.py
import os
import deepspeed
import torch
from transformers import pipeline
local_rank = int…
-
-
Thanks for this excellent library.
We're trying to benchmark our GPT-NEO use case and are struggling to pass in arguments to `generate`.
This GPT-NEO example, here, shows the creation of a `Text…
-
Hi,
when I try to train a model from scratch I am facing following error.
The data_dir contains less data, so I think CPU should be sufficient in my case. So what exactly could cause this?
@ncoop5…
-
## Environment info
- `transformers` version: 4.12.3
- Platform: Linux-5.4.0-1059-aws-x86_64-with-debian-buster-sid
- Python version: 3.7.10
- PyTorch version (GPU?): 1.7.1 (True)
- Tensorflow ve…