Fine-tuning

[hbellafkir]

Thanks for sharing your work. Did you try fine-tuning on relevant species after pre-training on XCL?

[lurauch]

Hi! 😊 If I remember correctly, we tried this approach earlier but abandoned it since it didn’t show much impact back then. However, that was during the early stages of our experiments, so it might be worth revisiting. Good suggestion! If we can get an SSL model trained on XCL, it would also provide an interesting opportunity for fine-tuning comparisons.

I'd love to discuss this further—I also remember your AL paper for bird sounds. Feel free to reach out via email if you're interested: lukas.rauch@uni-kassel.de

[paulpeyret-biophonia]

Thanks for opening this thread @hbellafkir. @lurauch I would also love to know what workflow you would recommend for fine-tinning? Would it required to build a birdset-like dataset? Or download model weights and work from another training pipeline? These foundation models trained on XCL seem very promising !