search

openai / gpt-2

Code for the paper "Language Models are Unsupervised Multitask Learners"
https://openai.com/blog/better-language-models/
Other
22.57k stars 5.53k forks source link

Failed to interpret file %s as a pickle #163

Closed Ceebox closed 5 years ago

Ceebox commented 5 years ago

Every time I run train.py with my dataset, I get this error.

Loading dataset... 0%| | 0/1 [00:00<?, ?it/s] Traceback (most recent call last): File "C:\Program Files\Python36\lib\site-packages\numpy\lib\npyio.py", line 447, in load return pickle.load(fid, **pickle_kwargs) EOFError: Ran out of input

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "train.py", line 293, in main() File "train.py", line 173, in main chunks = load_dataset(enc, args.dataset, args.combine) File "C:\Users\pc\Documents.Random Programming\Ai Test\GPT-2\gpt-2-finetuning\src\load_dataset.py", line 27, in load_dataset with np.load(path) as npz: File "C:\Program Files\Python36\lib\site-packages\numpy\lib\npyio.py", line 450, in load "Failed to interpret file %s as a pickle" % repr(file)) OSError: Failed to interpret file 'lyric.npz' as a pickle

Any solutions? What am I doing wrong?

Ceebox commented 5 years ago

I had put my model in the base folder not the src