fix n_tasks logic from dataset index out of bounds
Next 2 changes related to #58
save intermediate generations with --save_every_k_samples
resume generation from intermediate generations with --load_generations_intermediate_paths
Tested with HumanEval with saving every 50 samples + loading from intermediate generations:
len(intermediate_generations) = 150
should be generating 14 new samples for new_generations
curr_sample_idx = 150
number of problems for this task is 14
len(dataloader)= 14
len(code_gens) = 14
len(new_generations) = 14
len(generations) after concatenating = 164
Verified:
loading form intermediate generations generates same output as with --limit_start 150 on HumanEval
task_name
for multiple tasksn_tasks
logic from dataset index out of boundsNext 2 changes related to #58
--save_every_k_samples
--load_generations_intermediate_paths
Tested with HumanEval with saving every 50 samples + loading from intermediate generations:
Verified:
--limit_start 150
on HumanEval