how to load model file - Githubissues

Ueeek / Sentencepiece_py

sentencepiece implemented by Python

1 stars 0 forks source link

how to load model file #9

Open lijiekiff opened 2 years ago

lijiekiff commented 2 years ago

Hello. Is it possible to load a sentencepiece model. I have a spm file, but have no unigram vocab file.

Thanks. Wish your reply

Ueeek commented 2 years ago

I do not implement the function. But, I think you can create vocab-file from .spm model by spm-export-vocab (https://github.com/google/sentencepiece) (Exported Vocab format may need to be fixed). Thank you.