Open lighten001 opened 7 months ago
function log_images will call get_input (which is the second time be called) on train batch end
log_images
get_input
z, c = self.get_input(batch, self.first_stage_key, bs=N)
so batch['text'] will add [self.mapping_task[task_name]] twice
batch['text']
[self.mapping_task[task_name]]
batch['txt'] = batch['txt'] + [self.mapping_task[task_name]]
the c_task should be c_all[BS:BS+1,:1,:] to avoid the two same task prompt
c_task
c_all[BS:BS+1,:1,:]
Thanks for the contribution! Before we can merge this, we need @lighten001 to sign the Salesforce Inc. Contributor License Agreement.
function
log_images
will callget_input
(which is the second time be called) on train batch endso
batch['text']
will add[self.mapping_task[task_name]]
twicethe
c_task
should bec_all[BS:BS+1,:1,:]
to avoid the two same task prompt