NVIDIA / NeMo-Aligner

Scalable toolkit for efficient model alignment
Apache License 2.0
419 stars 44 forks source link

Some code related to `train_valid_test_num_samples` may be wrong / unused #176

Open odelalleau opened 1 month ago

odelalleau commented 1 month ago

Describe the bug

NB: this was first noticed by @eloialonso

Code related to train_valid_test_num_samples seems weird -- at least for RM training (I haven't checked other algos):

=> probably that some code clean-up is needed (?)