search

vineetm / tf-similar-sentences

Find similar sentences using Tensorflow Hub for English Wikipedia
9 stars 7 forks source link

Fine tuning universal sentence encoder #1

Open PeterDykas opened 5 years ago

PeterDykas commented 5 years ago

Hey huge fan of this project. I'm very interested in using this for my own corpus. I just came to ask if you had tried this project on another corpus where you fine tune the embeddings first and how that went? I'm new to nlp and was wondering how the results changed and if you had any recommendations for how to fine tune the universal sentence encoder

vineetm commented 5 years ago

@PeterDykas Thank you for your kind words :)

Unfortunately, I have very little experience with fine-tuning. Some things to keep in mind about fine-tuning though --- Fine-Tuning would not change the underlying vocabulary. So if your corpus has some domain specific words/concepts, it would not help much. See related issue on official Tensorflow Hub page.

Please do let me know, how your experiments with fine-tuning go :)