Add ability to use chat templates in Text Generation - Githubissues

CodeWithKyrian / transformers-php

Transformers PHP is a toolkit for PHP developers to add machine learning magic to their projects easily.

https://codewithkyrian.github.io/transformers-php/

Apache License 2.0

530 stars 28 forks source link

Add ability to use chat templates in Text Generation #1

Closed CodeWithKyrian closed 6 months ago

CodeWithKyrian commented 6 months ago

What:

[ ] Bug Fix
[x] New Feature

Description: Support Jinja Chat ML Templates

This pull request introduces support for parsing Jinja Chat ML templates within the Text Generation Pipeline.

Benefits:

Conversational Style: Enables the pipeline to generate responses in a more conversational and engaging manner.
Templated Text Generation: Allows users to define templates for converting message arrays into flat text, leveraging the model's capabilities.

Overall, this addition enhances the Text Generation Pipeline's flexibility for tasks requiring a conversational or formatted output.