-
Hello all,
We just released a MXNet/Gluon port of BERT in [GluonNLP v0.5](https://github.com/dmlc/gluon-nlp/releases/tag/v0.5.0)!
We converted the pre-trained models in TF and it generates the s…
-
Hello,
I am curious to understand why only 1 epoch was used to train the original sentence-BERT?
Have you tested it with more than 1 epoch? What was the result then?
I tried to follow your c…
-
I am planning to use S-Bert for **asymmetric information retrieval** purposes with highly technical data. Is there a best practice regarding how to **manually annotate** the data for fine-tuning? By a…
-
May I ask how to finetune trocr on my own dataset? What's the format of dataset I need to prepare?
-
Hey, I am trying to retrain mobilebert. I was able to run the pretraing scrips with no problems. However, when fine-tuning on squad using the flag `--use_quantized_training=true`. I get the following …
-
Thanks for wonderful work which gives good expressive TTS for English speakers. I was planning for Indian Multi-lingual TTS. For this purpose, I have few questions.
1. Do we need to change only da…
-
您好,我正在尝试在其他领域利用OAG-BERT的策略进行预训练实现效果,请问你们现在是否开源了OAG-BERT的预训练代码呢?我好像没有在源码中找到。谢谢
-
Hi,
Thank s for sharing ur code
The bert embeddings u used are fine-tuned or not ?
Thank u
-
I have been using pre-trained cross-encoder/ms-marco-MiniLM-L-6-v2 on a dataset similar to MS-MARCO for re-ranking paragraphs based on a query/question. The top-3 accuracy results have been pretty goo…
-
Hi,
I want to use BERT to train a QA model on a custom SQuAD-like dataset. Ideally, I would like to leverage the learning from the SQuAD dataset, and add fine-tuning on my custom dataset, which has…
gqoew updated
3 years ago