search

petals-infra / chat.petals.dev

💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client
https://chat.petals.dev
308 stars 79 forks source link

Suppress the default "AI:" and "Human:" prompts in few-shot mode #6

Closed tijszwinkels closed 1 year ago

tijszwinkels commented 1 year ago

Especially the "AI:" prompt formally couldn't be deleted, and threw the AI off sometimes.

Example:

Before:

Screenshot 2023-01-19 at 14 54 57

after:

Screenshot 2023-01-19 at 14 55 06
borzunov commented 1 year ago

Thanks for the PR, it makes sense!

borzunov commented 1 year ago

Just shipped your changes to http://chat.petals.ml/