Modalities / modalities

Modalities, a PyTorch-native framework for distributed and reproducible foundation model training.
MIT License
63 stars 8 forks source link

T5 support #237

Closed davidkaczer closed 2 months ago

davidkaczer commented 2 months ago

What does this PR do?

This PR adds support for pretrained LongT5 encoder-decoder models from HuggingFace.

General Changes

Breaking Changes

Checklist before submitting final PR