Open hatefap opened 3 years ago
@hatefap should be fa,
but LASER is not trained on a Persian/Farsi corpus, so it will automatically fall back on en
.
LASER supports Persian/Farsi. You may see a message "falling back to English", but this is only comes from punctuation normalization sicne there are no specific rules for Farsi/Persian. You simply ignore it.
@hoschwenk thanks, it's strange though, couldn't find the fa
on the paper in the Table 1
Artetxe, M. and Schwenk, H., 2019. Massively multilingual sentence embeddings for zero-shot cross-lingual transfer and beyond. Transactions of the Association for Computational Linguistics, 7, pp.597-610.
@HovhannesTamoyan @hoschwenk thank you very much!
hey, did this support Persian/Farsi language? what is its code to pass into this function: