keras-team / keras-nlp

Modular Natural Language Processing workflows with Keras
Apache License 2.0
754 stars 223 forks source link

Consider a `return_prompt=True` flag for `generate()` #966

Open mattdangerw opened 1 year ago

mattdangerw commented 1 year ago

Currently we always return our prompt when returning strings from the generate function. We might want to make this configurable, so that the prompt can either be excluded or included in the returned text.

chenmoneygithub commented 1 year ago

this is interesting, will be a bit weird for batched inputs, but I can see it's useful for single string input.