Open BAOOOOOM opened 2 years ago
In process_batch module, why creat a past_key_values in batch_size=1 and then use expand to batchsize?
In process_batch module, why creat a past_key_values in batch_size=1 and then use expand to batchsize?