biigle / maia

:m: BIIGLE module for the Machine Learning Assisted Image Annotation method
GNU General Public License v3.0
2 stars 3 forks source link

Improve Embedding results by finetuning #141

Open dlangenk opened 11 months ago

dlangenk commented 11 months ago

We could finetune the pretrained weights to be more adapted to the marine domain (at the loss of other domains in Biigle, I guess). This can also be done in a self-supervised fashion and might also be a valid fit for our new PhD candidate.

mzur commented 11 months ago

Anything can be tried once we have a finetuned model. Currently, I'm putting it more into the MAIA/detection category which for me is still something special for the marine domain. The general similarity sorting should work well in any domain (and it looks like it already works quite well for marine images) and I'm not sure if we should employ such a fine-tuned model there. But the numbers will tell :wink: