search

collabora / WhisperFusion

WhisperFusion builds upon the capabilities of WhisperLive and WhisperSpeech to provide a seamless conversations with an AI.
1.55k stars 110 forks source link

Update chatml prompt formatting #59

Closed makaveli10 closed 3 months ago

makaveli10 commented 3 months ago

Manually create chatml prompt format as the apply_chat_template produces incorrect prompt. Also, skip_special_tokens when decoding the output tokens

Should fix https://github.com/collabora/WhisperFusion/issues/55