yizhongw / Tk-Instruct

Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
https://arxiv.org/abs/2204.07705
MIT License
177 stars 27 forks source link

The `max_num_instances_per_task` Parameter in Experiments #16

Open ZhangzihanGit opened 1 year ago

ZhangzihanGit commented 1 year ago

Hi, thank you for your great work!

Apologize if I misread the paper. When training Tk-instruct, did you use max_num_instances_per_task=100 or max_num_instances_per_task=64 to report the main results in Table 3 and Figure 4? I cannot find anywhere in the paper how many training instances per task are used. Figure 5(b) mentions that 64 instances per task give the best results, but in the code, the default setting is 100, which confuses me.

Thank you!