feat(data): Saving huggingface dataset

[kriangkraitan]

Why this PR

to concatenation all jsonl file to huggingface dataset format

to use this code python your_script.py --train_path /train/path/*.jsonl --eval_path /eval/path/*.jsonl --output_path /output/path

Changes

• add pipeline to save data to huggingface dataset

Related Issues

Close #

Checklist

• [ ] PR should be in the Naming convention
• [ ] Assign yourself in to Assigneees
• [ ] Tag related issues
• [ ] Constants name should be ALL_CAPITAL, function name should be snake_case, and class name should be CamelCase
• [ ] complex function/algorithm should have Docstring
• [ ] 1 PR should not have more than 200 lines changes (Exception for test files). If more than that please open multiple PRs
• [ ] At least PR reviewer must come from the task's team (model, eval, data)