Schedule the next round of experiments with other epoch count values + 1e-5 LR - Githubissues

Adamliu1 / SNLP_GCW

3 stars 0 forks source link

Schedule the next round of experiments with other epoch count values + 1e-5 LR #139

Open TheRootOf3 opened 2 weeks ago

TheRootOf3 commented 2 weeks ago

[ ] Initially, start by scheduling the same set of experiments as last time by @Willmish but only with 1e-6 and epoch count 40 and 60.
[ ] Further, if results are promising, continue with other LR values (1e-5, 1e-7).

Willmish commented 1 week ago

@TheRootOf3 scheduled! with the following scripts: https://github.com/Adamliu1/SNLP_GCW/blob/ac106e950e3e3e270c9da3744787fe5ec7a37f04/llm_unlearn_ucl/schedule_unlearing_experiments_4_gpus_lr_1e6.sh and https://github.com/Adamliu1/SNLP_GCW/blob/ac106e950e3e3e270c9da3744787fe5ec7a37f04/llm_unlearn_ucl/schedule_unlearing_experiments_4_gpus_lr_1e5.sh

google sheets entry WIP