adalmia96 / Cluster-Analysis

54 stars 29 forks source link

Vocabs ??? #11

Open Elfilali-Taoufiq opened 1 year ago

Elfilali-Taoufiq commented 1 year ago

hello, and thank you for this great work.

I'm trying to test the code, but i find a required argument that is :

"--vocab: List of vocab files to use for tokenization"

can you give us some examples or where we can get them ?

Thanks

maciejskorski commented 1 year ago

You can use the local vocabulary like /usr/share/dict/words on Unix systems (as done in my fork).