Open Elfilali-Taoufiq opened 1 year ago
hello, and thank you for this great work.
I'm trying to test the code, but i find a required argument that is :
"--vocab: List of vocab files to use for tokenization"
can you give us some examples or where we can get them ?
Thanks
You can use the local vocabulary like /usr/share/dict/words on Unix systems (as done in my fork).
/usr/share/dict/words
hello, and thank you for this great work.
I'm trying to test the code, but i find a required argument that is :
"--vocab: List of vocab files to use for tokenization"
can you give us some examples or where we can get them ?
Thanks