Currently we use a custom training loop along with HF accelerator for training. This story is to replace that with HF Trainer similar to what we implemented for fine-tuning.
Tasks
Implement HF Trainer in peft prompt tuning module
Make sure all unit tests pass and add any unit tests necessary
Evaluate newly implemented training loop with RTE and CNN datasets using:
Bloom-560m
t5-base
Acceptance Criteria
[ ] Unit tests cover new/changed code
[ ] Example modified to expose any new parameter we may need
Description
Currently we use a custom training loop along with HF accelerator for training. This story is to replace that with HF Trainer similar to what we implemented for fine-tuning.
Tasks
Acceptance Criteria