search

nlpyang / hiersumm

Code for paper Hierarchical Transformers for Multi-Document Summarization in ACL2019
Apache License 2.0
231 stars 42 forks source link

how to load spm9998_3.model file? #21

Open LGDEMO opened 4 years ago

LGDEMO commented 4 years ago

Dear Mr. Liu,

I'm studying your paper “Hierarchical Transformers for Multi-Document Summarization” and code, and I'm a new learner in this task. Recently, I wanna use your code to run my task which language is Chinese. Now, I have a question and need your help. In your code, there is a file named spm9998_3.model, but I do not konw how to load it and the contents in it. Could you tell me how to load this file?

emoryr commented 3 years ago

Hi, @LGDEMO

In the README file, there is a link to download the vocabulary. 

The sentencepiece vocab file is at: https://drive.google.com/open?id=1zbUILFWrgIeLEzSP93Mz5JkdVwVPY9Bf

This is the spm9998_3.model. So you can put the path in the command or set VOCAB_PATH then in command just change to $VOCAB_PATH