nusnlp / mlconvgec2018

Code and model files for the paper: "A Multilayer Convolutional Encoder-Decoder Neural Network for Grammatical Error Correction" (AAAI-18).
GNU General Public License v3.0
185 stars 73 forks source link

How to use language model (94Bcclm.trie)? #19

Closed spurscoder closed 5 years ago

spurscoder commented 5 years ago

Hi, When I running this command:

./run.sh data/test/conll14st-test/conll14st-test.tok.src \
             outputs_embed_eolm \
             5 \
             models/mlconv_embed \
             models/reranker_weights/mlconv_embed_4ens_eo_lm.weights.txt \
             eolm

I have encountered this problem image It looks like that: "The format of language model is something wrong". So, I google some suggests. They suggest that: change "*.trie" files to "*.arpa" files. But, here is new problems: image It seems that: I need the vocab of the language model. But there is no vocab files.

Finally, could you tell me, "How to use the language model file(94cclm.trie)"? THANKS YOU.

shamilcm commented 5 years ago

The Language model in .trie format will work fine. You need not convert to .arpa.

Make sure you have downloaded the 94bcclm.trie completely. Check if your file is 159523360 Kb.

spurscoder commented 5 years ago

Yes, that's the way. I didn't download the 94bcclm.trie completely, Thanks.