Open INF800 opened 3 years ago
Hi, 1) There are some models in Huggingface transformers that allow longer input texts than 512 word pieces. Check the docs from transformers which models would be suitable
2) The loss function depends on what type of data you have. Have a look here: https://www.sbert.net/docs/package_reference/losses.html
I am working on pdf page classification. I want to use https://github.com/UKPLab/sentence-transformers/blob/master/examples/training/quora_duplicate_questions/training_OnlineContrastiveLoss.py to generate page level embeddings.
4096
so that we can accomodate all the page content?examples/training/quora_duplicate_questions/training_OnlineContrastiveLoss.py