axolotl-ai-cloud / axolotl

Go ahead and axolotl questions
https://axolotl-ai-cloud.github.io/axolotl/
Apache License 2.0
7.48k stars 808 forks source link

Default to Chat Template in tokenizer_config #1728

Closed hammoudhasan closed 2 months ago

hammoudhasan commented 2 months ago

⚠️ Please check that this feature request hasn't been suggested before.

🔖 Feature description

I think a useful feature would be people defining their own chat templates in their tokenizer config file ( usually written in Jinga and currently default practice to provide that). It would be nice to have an option that the user wants to read the config file chat template.

✔️ Solution

Provide a flag which could be triggered in the training yml file that reads the chat template from the tokenizer config file.

❓ Alternatives

No response

📝 Additional Context

No response

Acknowledgements