pommedeterresautee / fastrtext

R wrapper for fastText
https://pommedeterresautee.github.io/fastrtext/
Other
101 stars 15 forks source link

Load a fastText pre-trained model (Chinese), how to set encoding? #40

Open jovian-luo opened 4 years ago

jovian-luo commented 4 years ago

Hi there,

I am using load_model() function to load a Chinese fastText pre-trained model, and here is the command I used:

model <- load_model("D:/CMD/cc.zh.300.bin/cc.zh.300.bin") my <- get_word_vectors(model)

However, the loaded word vectors are not correctly encoded, and the problem remained after I set Save With Coding to UTF-8. I am wondering whether there is a way to set encoding when loading the pre-trained model? Thanks for your time in advance!

Jovian