xinke-wang / ModaVerse

[CVPR2024] ModaVerse: Efficiently Transforming Modalities with LLMs
14 stars 1 forks source link

model conversion code #3

Open Ohzyang opened 1 week ago

Ohzyang commented 1 week ago

1720428897820 this code is for vicuna-7b-delta-v1.1, then which code is for vicuna-7b-delta-v0? and which llama should I install,llama-7b or llama-2-7b? please answer my question,I will appreciate you very much!

xinke-wang commented 1 week ago

As demonstrated in your provided screenshot of Vicuna's instructions, the conversion code is designed for v0 weights, which aim to comply with the LLaMA model license. You need to download LLaMA-7B (the first version of LLaMA), then use the provided script by Vicuna to apply the delta weights of Vicuna to LLaMA-7B to obtain the Vicuna-7B model. You can download the 7B-v0 delta from the table. I believe the conversion code is compatible. image

Ohzyang commented 1 week ago

If the conversion code is designed for 7b_v0, then why call it 7b_v1.1? And I have tried to convert the code and found that it is not compatible. I'm sorry, can you provide a solution? I would be very grateful to you

每天都要开心鸭 @.***

 

------------------ 原始邮件 ------------------ 发件人: "xinke-wang/ModaVerse" @.>; 发送时间: 2024年7月8日(星期一) 晚上6:09 @.>; @.**@.>; 主题: Re: [xinke-wang/ModaVerse] model conversion code (Issue #3)

As demonstrated in your provided screenshot of Vicuna's instructions, the conversion code is designed for v0 weights, which aim to comply with the LLaMA model license. You need to download LLaMA-7B (the first version of LLaMA), then use the provided script by Vicuna to apply the delta weights of Vicuna to LLaMA-7B to obtain the Vicuna-7B model. You can download the 7B-v0 delta from the table. I believe the conversion code is compatible. image.png (view on web)

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

xinke-wang commented 1 week ago

I am not sure if they updated the weight conversion code after the development of Modaverse. If you still cannot find a way to obtain Vicuna-7B-v0, you may try this link to download the pre-converted model: link. This link will expire on July 15, 2024.