Llama 3.1 needs a special token to know that the prompt has finished. I've added the option to add an eot token to the prompt builder and integrated this into the pipeline options.
Related Issues or other material
[X] This PR relates to one or more issues, detailed below
Related Issue #31
Closes #31
✅ Added/updated tests?
[X] This PR contains relevant tests
[X] I've completed all actions and tasks detailed in the PR Template
Pull Request Contents
🦋 Bug Fix
Description
Llama 3.1 needs a special token to know that the prompt has finished. I've added the option to add an eot token to the prompt builder and integrated this into the pipeline options.
Related Issues or other material
[X] This PR relates to one or more issues, detailed below
Related Issue #31
Closes #31
✅ Added/updated tests?
[X] This PR contains relevant tests
[X] I've completed all actions and tasks detailed in the PR Template