Updates to enable ultrachat200k

neuralmagic / sparseml

Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

Apache License 2.0

2.08k stars 148 forks source link

Updates to enable ultrachat200k #2208

Open anmarques opened 8 months ago

anmarques commented 8 months ago

Ultrachat200k has 2 splits for training, one for sft and another for dpo. As a result it doesn't have a "train" split per se. This PR allows for a train_sft alternative.