wsntxxn / AudioCaption

Audio captioning recipe
MIT License
43 stars 4 forks source link

Paper #4

Closed redrabbit94 closed 4 months ago

redrabbit94 commented 1 year ago

Thanks for sharing, great work! Could you offer links to articles about this repo, and is it convenient to know if the repo contains the method you submitted in dcase 2022?

wsntxxn commented 1 year ago
  1. The articles are provided. However, since I have reorganized the codes several times, the detailed step-to-step instruction is not included. For example, run_condition_adverse.py is for diversity-controllable captioning but the configuration files and the discriminator training scripts are missing. If you have problems with specific work, please contact me.
  2. About DCASE 2022 submission, the contrastive pre-trained model is provided here. You can use this configuration and set the encoder argument pretrained as the path of the pre-trained model to train the base model. Reinforcement learning and ensemble codes will be uploaded later. However, I do not put the pre-training codes into this repo because it is independent. I will create another repo on audio-text retrieval involving contrastive pre-training.
wsntxxn commented 1 year ago

Sorry for the procrastination, the codes and sample configuration files for reinforcement learning and ensemble have been uploaded.

wsntxxn commented 1 year ago

The audio-text contrastive learning code has also been uploaded to https://github.com/wsntxxn/DCASE2022T6_CLAP. You can refer to it.

redrabbit94 commented 1 year ago

Thanks so much!Best wishes!

发自我的iPhone

在 2023年2月16日,11:14,Xuenan Xu @.***> 写道:



The audio-text contrastive learning code has also been uploaded to https://github.com/wsntxxn/DCASE2022T6_CLAP. You can refer to it.

— Reply to this email directly, view it on GitHubhttps://github.com/wsntxxn/AudioCaption/issues/4#issuecomment-1432430494, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AHAX5M64Z2I5X327OFLJ5B3WXWLP7ANCNFSM6AAAAAASXT66S4. You are receiving this because you authored the thread.Message ID: @.***>