Add PL Trainer

[boat1603]

Why this PR

Add PL Trainer for LLM

Changes

• Add PL Trainer scripts.

Related Issues

Close #

Checklist

• [ ] PR should be in the Naming convention
• [ ] Assign yourself in to Assigneees
• [ ] Tag related issues
• [ ] Constants name should be ALL_CAPITAL, function name should be snake_case, and class name should be CamelCase
• [ ] complex function/algorithm should have Docstring
• [ ] 1 PR should not have more than 200 lines changes (Exception for test files). If more than that please open multiple PRs
• [ ] At least PR reviewer must come from the task's team (model, eval, data)

[new5558]

Can you fix black Linting and Formatting error krub. For pytest error we can ignore that for now.

[codecov[bot]]

Codecov Report

Attention: 161 lines in your changes are missing coverage. Please review.

Comparison is base (beb21a7) 21.93% compared to head (390d03c) 19.39%. Report is 1 commits behind head on main.

:exclamation: Current head 390d03c differs from pull request most recent head 361a98f. Consider uploading reports for the commit 361a98f to get more accurate results

Additional details and impacted files

```diff @@ Coverage Diff @@ ## main #305 +/- ## ========================================== - Coverage 21.93% 19.39% -2.54% ========================================== Files 19 25 +6 Lines 1231 1392 +161 ========================================== Hits 270 270 - Misses 961 1122 +161 ``` | [Flag](https://app.codecov.io/gh/OpenThaiGPT/openthaigpt-pretraining/pull/305/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=OpenThaiGPT) | Coverage Δ | | |---|---|---| | [unittests](https://app.codecov.io/gh/OpenThaiGPT/openthaigpt-pretraining/pull/305/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=OpenThaiGPT) | `19.39% <0.00%> (-2.54%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=OpenThaiGPT#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files](https://app.codecov.io/gh/OpenThaiGPT/openthaigpt-pretraining/pull/305?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=OpenThaiGPT) | Coverage Δ | | |---|---|---| | [...enthaigpt\_pretraining\_model/pl\_trainer/\_\_init\_\_.py](https://app.codecov.io/gh/OpenThaiGPT/openthaigpt-pretraining/pull/305?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=OpenThaiGPT#diff-c3JjL21vZGVsL29wZW50aGFpZ3B0X3ByZXRyYWluaW5nX21vZGVsL3BsX3RyYWluZXIvX19pbml0X18ucHk=) | `0.00% <0.00%> (ø)` | | | [...nthaigpt\_pretraining\_model/pl\_trainer/constants.py](https://app.codecov.io/gh/OpenThaiGPT/openthaigpt-pretraining/pull/305?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=OpenThaiGPT#diff-c3JjL21vZGVsL29wZW50aGFpZ3B0X3ByZXRyYWluaW5nX21vZGVsL3BsX3RyYWluZXIvY29uc3RhbnRzLnB5) | `0.00% <0.00%> (ø)` | | | [...retraining\_model/pl\_trainer/optimizer/constants.py](https://app.codecov.io/gh/OpenThaiGPT/openthaigpt-pretraining/pull/305?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=OpenThaiGPT#diff-c3JjL21vZGVsL29wZW50aGFpZ3B0X3ByZXRyYWluaW5nX21vZGVsL3BsX3RyYWluZXIvb3B0aW1pemVyL2NvbnN0YW50cy5weQ==) | `0.00% <0.00%> (ø)` | | | [...pretraining\_model/pl\_trainer/optimizer/\_\_init\_\_.py](https://app.codecov.io/gh/OpenThaiGPT/openthaigpt-pretraining/pull/305?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=OpenThaiGPT#diff-c3JjL21vZGVsL29wZW50aGFpZ3B0X3ByZXRyYWluaW5nX21vZGVsL3BsX3RyYWluZXIvb3B0aW1pemVyL19faW5pdF9fLnB5) | `0.00% <0.00%> (ø)` | | | [...retraining\_model/pl\_trainer/optimizer/scheduler.py](https://app.codecov.io/gh/OpenThaiGPT/openthaigpt-pretraining/pull/305?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=OpenThaiGPT#diff-c3JjL21vZGVsL29wZW50aGFpZ3B0X3ByZXRyYWluaW5nX21vZGVsL3BsX3RyYWluZXIvb3B0aW1pemVyL3NjaGVkdWxlci5weQ==) | `0.00% <0.00%> (ø)` | | | [...thaigpt\_pretraining\_model/pl\_trainer/pl\_trainer.py](https://app.codecov.io/gh/OpenThaiGPT/openthaigpt-pretraining/pull/305?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=OpenThaiGPT#diff-c3JjL21vZGVsL29wZW50aGFpZ3B0X3ByZXRyYWluaW5nX21vZGVsL3BsX3RyYWluZXIvcGxfdHJhaW5lci5weQ==) | `0.00% <0.00%> (ø)` | |

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.