Crystalcareai
commented
3 weeks ago Definitely - will be looking at adding that method shortly. I appreciate your teams efforts in making this more accessible.
Open kashif opened 3 weeks ago
Crystalcareai
commented
3 weeks ago Definitely - will be looking at adding that method shortly. I appreciate your teams efforts in making this more accessible.
you might be interested in the GKD method we've added to the new TRL release: https://huggingface.co/docs/trl/v0.11.0/en/gkd_trainer