Why we need this PR?
This PR I tried to setup training optimizers by using hydra yaml (We will do this with dataset, model, and etc. in the next PR).
Changes
Change all of optimizer hyps to yaml file.
CustomOptimizer in src/model/openthaigpt_pretraining_model/lightning/utils.py is for make the current branch to trainable. We will delete it after using Trainer from src/model/openthaigpt_pretraining_model/trainer/lightning_trainer.py.
Why this PR
Why we need this PR? This PR I tried to setup training optimizers by using hydra yaml (We will do this with
dataset
,model
, and etc. in the next PR).Changes
CustomOptimizer
insrc/model/openthaigpt_pretraining_model/lightning/utils.py
is for make the current branch to trainable. We will delete it after using Trainer fromsrc/model/openthaigpt_pretraining_model/trainer/lightning_trainer.py
.Related Issues
Close #
Checklist