Use cont_token for bloomz

petals-infra / chat.petals.dev

💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client

https://chat.petals.dev

308 stars 79 forks source link

Closed borzunov closed 1 year ago

borzunov commented 1 year ago

This option was superseded by extra_stop_sequences.