LAION-AI / CLAP

Contrastive Language-Audio Pretraining
https://arxiv.org/abs/2211.06687
Creative Commons Zero v1.0 Universal
1.43k stars 137 forks source link

Multilingual version of CLAP #154

Open aquorio15 opened 5 months ago

aquorio15 commented 5 months ago

Hi, Thanks for making the code and the models publicly available. I was wondering if there is any way we can create a multilingual version of CLAP also instead of using Swin-transformer as the audio encoder, can we swap it with other multilingual encoders like Whisper?