search

QwenLM / Qwen-Audio

The official repo of Qwen-Audio (通义千问-Audio) chat & pretrained large audio language model proposed by Alibaba Cloud.
Other
1.49k stars 107 forks source link

训练超参数相关问题 #51

Open jwang1993 opened 7 months ago

jwang1993 commented 7 months ago

关于训练有几个问题想请教一下， 1、在预训练和微调阶段，SpecAugment Policy 是LibriSpeech Basic是什么含义呢 2、在预训练阶段，单独设置了Audio encoder learning rate decay为0.95，这是只针对audio encoder的还是预训练阶段所有可训练参数（audio encoder+adapter）呢 3、在预训练阶段采用多少台机器，总共训练了多长时间

SaraAlthubaiti commented 3 months ago

Could you please point me to their training code? I didn't find it and there was no description about it in the README, @jwang1993