search

dmlc / gluon-nlp

NLP made easy
https://nlp.gluon.ai/
Apache License 2.0
2.55k stars 538 forks source link

fine-tune bert_12_768_12 #1372

Open Shafi2016 opened 4 years ago

Shafi2016 commented 4 years ago

If we fine-tune bert_12_768_12 with mxnet/gluon. Can we then fine-tune BERT with Bert embedding of (https://github.com/imgarylai/bert-embedding)?. Can we integrate fine-BERT from huggingface wtih gulon.?

sxjscience commented 4 years ago

Would you give more information about fine-BERT?

Shafi2016 commented 4 years ago

I want to fine-tune on my own data.

I fine-tune with BERT with a hugging face and the results sufficiently improved. I want to do the same to use it with bert embedding. I am using bert emedding to find the similar words. I have not yet attempted but I think it should not be a problem as Bert embedding of (https://github.com/imgarylai/bert-embedding) is build on gluon.