Other model support. - Githubissues

xlang-ai / instructor-embedding

[ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings

Apache License 2.0

1.79k stars 132 forks source link

Other model support. #57

Closed staticpunch closed 11 months ago

staticpunch commented 1 year ago

Hi, I would like to train an Instructor model for my language (Vietnamese), which is not supported by T5/GTR. Could I just use the code in this repo to finetune a pretrained model of my language (BERT/RoBERTa like) with my custom data?

Harry-hash commented 1 year ago

Yes, it is possible to use the other models with transformer architectures!

hongjin-su commented 11 months ago

Please re-open the issue if you have any questions or comments!