Allow multiple response patterns in the insert_mask_before_placeholder transform

OpenNMT / OpenNMT-py

Open Source Neural Machine Translation and (Large) Language Models in PyTorch

https://opennmt.net/

MIT License

6.67k stars 2.24k forks source link

Closed l-k-11235 closed 3 months ago

l-k-11235 commented 3 months ago

This PR enables multiple "response patterns" in LLM-like training examples (with prompt and response) for multi-task finetuning.