Implement custom optimizer and scheduler

boun-tabi-LMG / turkish-lm-tuner

Turkish LM Tuner

https://boun-tabi-lmg.github.io/turkish-lm-tuner/

MIT License

73 stars 6 forks source link

Implement custom optimizer and scheduler #34

Closed gokceuludogan closed 6 months ago

gokceuludogan commented 6 months ago

The current implementation only supports specific optimizers and schedulers with fixed parameters. To improve flexibility and user control, we should refactor the implementation to support various optimizers and schedulers and allow users to provide custom parameters for both.