UER支持直接加载mT5吗？

dbiir / UER-py

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

https://github.com/dbiir/UER-py/wiki

Apache License 2.0

2.98k stars 527 forks source link

Closed blueseasky closed 1 year ago

blueseasky commented 1 year ago

您好，我想用UER代码框架，用mt5做模型初始化，请问convert_t5_from_huggingface_to_uer.py这个脚本转化完，可以直接加载吗？

ydli-ai commented 1 year ago

可以，用mt5对应的词表（spm）和配置文件就行