salesforce / LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence
BSD 3-Clause "New" or "Revised" License
9.92k stars 972 forks source link

About input,About function of concat_text_input_output? #459

Open hangzeli08 opened 1 year ago

hangzeli08 commented 1 year ago

I would like to ask why “concat_text_input_output” this function needs to do this, connecting the question and answer together and putting them into the big model. Shouldn't we just include the question, The inputs_embeds section should only have samples ['text_input '], not samples ['text_output'], right?

wangxiaoyuwangdayu commented 1 year ago

I have the same question