hltcoe / sandle

Run a large language modeling SANDbox in your Local Environment
Other
7 stars 1 forks source link

Add a warning if the prompt ends with whitespace #6

Closed ccmaymay closed 2 years ago

ccmaymay commented 2 years ago

Note the OpenAI QA example text ends with "A:" with no space, suggesting they may have the same issue. The OpenAI playground gives a warning when the prompt has a trailing space: "Warning: Your text ends in a trailing space, which causes worse performance due to how the API splits text into tokens."

Screen Shot 2022-07-11 at 4 05 56 PM