[Q/A] Is the prompt symbol intentionally left in the prompt text?

[Herohtar]

🤓 Question

In looking into some of the response/prompt text issues, I've noticed that the submitted action is added to the prompt text with the > intact. Thus, if I say "dance across the room" the prompt text submitted to the generator will look like:

[previous text]\n> You dance across the room.\n

Is this intentional and/or something needed because of how the model works? I've encountered a few scenarios where the model started outputting responses that were formatted like action inputs and was wondering if maybe including that symbol was causing some issues. Here's an example of what it was giving me:

> You stand up.
> You wave at the people.
> You walk across the stage.
[5 or so more lines of the same style]

[Teravus]

I have tested it with and without the caret in the prompt and the model produces no difference really except... when it starts to run out of things to say, it displays the caret. It still has the same behavior without the caret... except it is harder to tell when it is starting to have a problem.