DBD-research-group / BirdSet

A benchmark dataset collection for bird sound classification
https://huggingface.co/datasets/DBD-research-group/BirdSet
BSD 3-Clause "New" or "Revised" License
24 stars 8 forks source link

Fine-tuning #266

Open hbellafkir opened 1 week ago

hbellafkir commented 1 week ago

Thanks for sharing your work. Did you try fine-tuning on relevant species after pre-training on XCL?

lurauch commented 5 days ago

Hi! 😊 If I remember correctly, we tried this approach earlier but abandoned it since it didn’t show much impact back then. However, that was during the early stages of our experiments, so it might be worth revisiting. Good suggestion! If we can get an SSL model trained on XCL, it would also provide an interesting opportunity for fine-tuning comparisons.

I'd love to discuss this further—I also remember your AL paper for bird sounds. Feel free to reach out via email if you're interested: lukas.rauch@uni-kassel.de

paulpeyret-biophonia commented 2 days ago

Thanks for opening this thread @hbellafkir. @lurauch I would also love to know what workflow you would recommend for fine-tinning? Would it required to build a birdset-like dataset? Or download model weights and work from another training pipeline? These foundation models trained on XCL seem very promising !