Open mattdangerw opened 1 year ago
Currently we always return our prompt when returning strings from the generate function. We might want to make this configurable, so that the prompt can either be excluded or included in the returned text.
this is interesting, will be a bit weird for batched inputs, but I can see it's useful for single string input.
Currently we always return our prompt when returning strings from the generate function. We might want to make this configurable, so that the prompt can either be excluded or included in the returned text.