Closed Tokgoleo closed 6 months ago
It seems that instruction_per_seed_task is not reported in the Experiment Setup section of your paper? I find in your code that it's four by default.
For LLM2LLM, this value is 1. It is set here in the config: https://github.com/SqueezeAILab/LLM2LLM/blob/main/GSM8K/config.yaml#L8 You can use it to set the total number of augmentations per seed task.
It seems that instruction_per_seed_task is not reported in the Experiment Setup section of your paper? I find in your code that it's four by default.