Closed ndronen closed 9 years ago
I've started getting similar, unexpected theano errors running simple pylearn2 scripts. I'm going to close this as likely either a theano bug or a hardware problem.
My mistake. The errors from the pylearn2 scripts were unrelated to this problem. I'll reopen this issue.
The 'n_in' and 'n_out' state attributes stand for the numbers of possible inputs/outputs. The values 50 and 10000 correspond to the penntreebank dataset. If you use another data, these numbers should be changed accordingly.
Thanks. It runs now. For some reason that possibility didn't register in my mind at all. I had been thinking those options were related to the dimensions of the hidden layers.
Since generate.py is supposed to create npz files that are compatible with the tutorial scripts, I was expecting the following comands to work (after putting input_chars.npz and input_chars_dict.npz in the appropriate place in DT_RNN_Tut.py, of course).
But no workie. See below for details about what I'm doing and what I'm seeing. I have fresh versions of Theano and GroundHog from github.
Is this a pilot error? Should I change something else in DT_RNN_Tut.py? The error
IndexError: index 69 is out of bounds for size 50
is related to the number of dimensions of the embedding layer. If I changestate['n_in']
from 50 to 51, the IndexError message changes accordingly:Similarly, if I switch from chars to words, the error becomes
IndexError: index 33223 is out of bounds for size 10000
, reflecting the dimensionality of the word embeddings.Thanks!
I have train, valid, and test files from enwiki8 from http://mattmahoney.net/dc/textdata.html.
Running
generate.py
results in no errors, and the files input_chars.npz and input_chars_dict.npz are created.