Open fdujuan opened 5 years ago
Can you estimate an upper bound on the size of the vocab and reserve this quantity at the beginning?
Can you estimate an upper bound on the size of the vocab and reserve this quantity at the beginning?
I have tried this method,but something wrong when i use test data. Maybe i mistake somewhere and i will try again.Thank you.
There are plenty of better solution, starting with pre-trained word embeddings (glove or polygrlot for example).
I can't use V = model.add_lookup_parameters((VOCAB_SIZE, EMB_DIM)),because my VOCAB_SIZE is not a constant , i have to deal with out-of-vocabulary(oov) words for every article-title pair. Is there any other method for not fixed VOCAB_SIZE? Thank you,English is not my native language