search

pytorch / torchtitan

A native PyTorch Library for large model training
BSD 3-Clause "New" or "Revised" License
1.29k stars 115 forks source link

add doc for adding custom dataset #311

Open lessw2020 opened 2 months ago

lessw2020 commented 2 months ago

per user request, we don't currently have any info on how to do this. (basically extend the hf_dataset file).