Option to exclude prompt from generated text

elixir-nx / bumblebee

Pre-trained Neural Network models in Axon (+ 🤗 Models integration)

Apache License 2.0

1.27k stars 90 forks source link

Closed jonatanklosko closed 7 months ago

jonatanklosko commented 10 months ago

The text generation serving should have an option to only return the newly generated part, without the prompt.