search

pytorch / text

Models, data loaders and abstractions for language processing, powered by PyTorch
https://pytorch.org/text
BSD 3-Clause "New" or "Revised" License
3.49k stars 815 forks source link

Add _shift_right helper function to T5 model #2127

Closed joecummings closed 1 year ago

joecummings commented 1 year ago

See https://github.com/huggingface/transformers/blob/68287689f2f0d8b7063c400230b3766987abf18d/src/transformers/models/t5/modeling_t5.py#L835

This is needed for training.