xlang-ai / instructor-embedding

[ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings
Apache License 2.0
1.85k stars 134 forks source link

What if instruction+text merged? #63

Closed takiholadi closed 9 months ago

takiholadi commented 1 year ago

Is it possible to apply somehow for instruction prompts without instruction/text separation?

hongjin-su commented 1 year ago

Hi, Thanks a lot for your interest in the INSTRUCTOR!

It is possible to merge the instruction and text as one sentence, and put all the contents in the text body, leaving the instruction as an empty string, but this may be misaligned with the training format.

hongjin-su commented 9 months ago

Feel free to re-open the issue if you have any further questions or comments!