search

varunsatish / llama-recipes-fertility

1 stars 0 forks source link

Adding save dataset features #5

Closed varunsatish closed 3 months ago

varunsatish commented 3 months ago

In order to do inference, it would be useful to save the datasets that are used to train and validate the model when torchrun functions are called.

varunsatish commented 3 months ago

training and validation data saved in --output_dir