I tried to find the hyperparameter values(e.g. batch size, gradient accumulation steps) used in fine-tuning CodeGPT and CodeGPT-adapt for code completion tasks.
Is it the same as in README examples? i.e., batch size=2, gradient accumulation steps=4, etc.
Hi,
I tried to find the hyperparameter values(e.g. batch size, gradient accumulation steps) used in fine-tuning CodeGPT and CodeGPT-adapt for code completion tasks.
Is it the same as in README examples? i.e., batch size=2, gradient accumulation steps=4, etc.