Thank you for your excellent work! I’m currently trying to reproduce the results from scratch, but I ran into an issue when starting stage 1.
I couldn't find where you load the pretrained CAV-MAE model weights. I followed the script src/ltu/train_script/stage1_proj_cla.sh, which points to ../../../pretrained_mdls/vicuna_ltu/, but it seems this directory doesn’t contain the CAV-MAE weights.
Could you clarify where the weight loading for the audio encoder is done?
Hi Yuan,
Thank you for your excellent work! I’m currently trying to reproduce the results from scratch, but I ran into an issue when starting stage 1.
I couldn't find where you load the pretrained CAV-MAE model weights. I followed the script src/ltu/train_script/stage1_proj_cla.sh, which points to ../../../pretrained_mdls/vicuna_ltu/, but it seems this directory doesn’t contain the CAV-MAE weights.
Could you clarify where the weight loading for the audio encoder is done?
Thank you for your help!