-
I am getting this error while running code->
Code-> train, validation, test = dm.data.process(
path='sample_data/itunes-amazon',
train='train.csv',
validation='validation.csv',
…
-
#### Problem description
I want to calculate the Word Mover's Distance. After the normalization (`model.init_sims(replace=True)`) of my self made fastText model, the `wmdistance()` function isn't wor…
-
**Is your feature request related to a problem? Please describe.**
Since the Oscar is limited by the fasttext language classifier which was trained on Wikipedia, the datasets contain also the sentenc…
-
## 一言でいうと
誤字脱字に強い分散表現の提案。fastTextをベースにして、ミススペルの単語と本物の単語の分散表現を近づけるLossの項を導入している。ミススペルについては、別途辞書を用意する(このため教師ありとの併用の側面がある)。
### 論文リンク
https://arxiv.org/abs/1905.09755
### 著者/所属機関
Bora Ediz…
-
Just a query, have you tried triplet loss or lossless triplet loss as I think that would produce better embeddings as we are providing fewer examples and the clusters formed will be visually better.
…
-
It is amazing to use fastText to classify documents for its speed and accuracy.
But I have no idea about how to avoid overfitting effectively.
When I use bigrams and train more epochs, the training …
-
I'm proposing a language identification helper module that can:
1. Be used to build language id models using any of the rule based or learning algorithm available for doing this.
2. Be used to id…
-
Hi,
Thanks for offering this great implementation.
I was wondering if the scripts support using fasttext embeddings. If not, what should we do to make fasttext embeddings work with the current imp…
-
I find the classifier gives the confidence of predicted labels to high. its looks like it is trying to match labels too aggressively. this means that even if the input query is nothing like any of the…
-
Facebook has recently released LASER - https://github.com/facebookresearch/LASER, a language-Agnostic sentence representations, that internally makes use of a relatively new C++ BPE implementation - h…