search

YuanGongND / ltu

Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".
337 stars 27 forks source link

Requirements for more pretrained weights #8

Closed Ming-er closed 6 months ago

Ming-er commented 7 months ago

Hi, thanks for your brilliant work. I want to know if there are any plans to release more pretrained weights of LTU, such as checkpoints for stage 1, 2, 3 (so that we can skip over some trivial pretraining steps and explore more meaningful problems)?

YuanGongND commented 7 months ago

yes, can you make a list of them? I will try to accomendate these.

Ming-er commented 7 months ago

Thanks for your kindness. I think releasing the checkpoints of the training stage 1,2,3 in Tables 3 of LTU, and the checkpoints of the training stage 1,2 in Tables 3 of LTU-AS may be beneficial.

YuanGongND commented 7 months ago

will do, please allow some time.

-Yuan

YuanGongND commented 6 months ago

Done.

I have provided checkpoints of all stages, together with our loss log. Please see https://github.com/YuanGongND/ltu/tree/main/pretrained_mdls. Please let me know if there's any further questions.

-Yuan

Ming-er commented 6 months ago

Many thanks. I will check it soon.