-
## Environment info
- `transformers` version: 4.12.5
- Platform: Linux-5.4.104+-x86_64-with-Ubuntu-18.04-bionic
- Python version: 3.7.12
- PyTorch version (GPU?): 1.10.0+cu111 (True)
- Tensor…
-
I have a folder full of python files on which I want to fine-tune GPT-J. If I use this script given in the GPT-neo repository, will I be able to convert them into a tfrecords format compatible with GP…
-
## Environment info
- `transformers` version: 4.9.0.dev0
- Platform: Linux-4.14.238-182.422.amzn2.x86_64-x86_64-with-Ubuntu-18.04-bionic
- Python version: 3.6.9
- PyTorch version (GPU?): 1.9.0…
-
## Environment info
- `transformers` version: 4.9.1
- Platform: Linux-4.15.0-151-generic-x86_64-with-glibc2.10
- Python version: 3.8.5
- PyTorch version (GPU?): 1.8.1+cu102 (True)
- Tensorflow …
-
The evaluation harness can be run with GPT-2 and GPT-3 models. Would be useful to include support for the gpt-neo models to reproduce the result in https://huggingface.co/EleutherAI/gpt-neo-2.7B.
-
Thanks for this useful repository. I was able to follow it to train a gtp-neo 2.7B model.
Inference on the model works well for me, using less than 8GB of Vram, so fits on consumer-level gpus, how…
-
## Environment info
- `transformers` version: 4.14.0.dev0
- Platform: Linux-3.10.0_3-0-0-12-x86_64-with-centos-6.3-Final
- Python version: 3.7.11
- PyTorch version (GPU?): 1.7.1 (True)
- Tensorfl…
-
Hi Everyone,
I am trying to use a fine tuned GPT Neo Model for my inferencing, am getting the below warning -
### **_Some weights of GPT2LMHeadModel were not initialized from the model checkpoi…
-
## Environment info
- `transformers` version: master
- Platform: ubuntu
- Python version: 3.8
- PyTorch version (GPU?): 1.10
- Tensorflow version (GPU?):
- Using GPU in script?: yes
- Using…
-
## Environment info
- `transformers` version: 4.5.1 / HEAD
- Platform: Linux/Colab Pro
- Python version: 3.7
- PyTorch version (GPU?): 1.8.1 (CUDA 11.0)
- Tensorflow version (GPU?):
- Using …