Hello, my approach is pretty straightforward; running the default code with just ckpts changed:
model = laion_clap.CLAP_Module(enable_fusion=False, amodel= 'HTSAT-base')
model.load_ckpt( 'music_audioset_epoch_15_esc_90.14.pt' )
But I get the error:
Error(s) in loading state_dict for CLAP:
Unexpected key(s) in state_dict: "text_branch.embeddings.position_ids".
This error is present in all the newly trained models;
For music: music_audioset_epoch_15_esc_90.14.pt
For music and speech: music_speech_epoch_15_esc_89.25.pt
For speech, music and general audio: music_speech_audioset_epoch_15_esc_89.98.pt
tbrouns
commented
3 weeks ago
Hello, my approach is pretty straightforward; running the default code with just ckpts changed:
But I get the error:
This error is present in all the newly trained models; For music: music_audioset_epoch_15_esc_90.14.pt For music and speech: music_speech_epoch_15_esc_89.25.pt For speech, music and general audio: music_speech_audioset_epoch_15_esc_89.98.pt
How can I correctly load these models? thanks..