matrixgpt / matrix-chatgpt-bot

Talk to ChatGPT via any Matrix client!
GNU Affero General Public License v3.0
230 stars 64 forks source link

Why does this send responses seperated by <|im_sep> and not im_start and im_stop? #278

Open ACiDGRiM opened 4 months ago

ACiDGRiM commented 4 months ago

I'm using an openai compatible api that expects im_start/im_stop, but this is sending im_sep which breaks things.

I don't see any documentation on openai for im_sep, is there a reason this is used here?