matrixgpt / matrix-chatgpt-bot

Talk to ChatGPT via any Matrix client!
GNU Affero General Public License v3.0
235 stars 63 forks source link

Optionally disable replies to audio messages or prevent chatgpt from replying to this. #88

Closed bramenn closed 1 year ago

bramenn commented 1 year ago

I am making a plug-in to send audio to the room and have Whisper convert them to text.

The possibility of disabling audio message replies, as it interferes with text generation in Whisper. Thank you for considering my suggestion.

image

max298 commented 1 year ago

I even think this should be the default behavior, as ChatGPT won't interpret anything other than text.

max298 commented 1 year ago

I've just created #90.

However I'd like to discuss if we should add another environment parameter like IGNORE_NON_TEXT_MSG or just ignore non-text messages by default. I think from a user perspective it would be nice to have the possibility of getting a reply from ChatGPT saying it can't process non-text, so you know whats up instead of just silence. So another ENV would make sense in my opinion.

bertybuttface commented 1 year ago

I've just created #90.

However I'd like to discuss if we should add another environment parameter like IGNORE_NON_TEXT_MSG or just ignore non-text messages by default. I think from a user perspective it would be nice to have the possibility of getting a reply from ChatGPT saying it can't process non-text, so you know whats up instead of just silence. So another ENV would make sense in my opinion.

I think we just ignore by default, ChatGPT will never add image support and if we choose to add it we will have to use a different AI backend which isn't on the roadmap by now.

max298 commented 1 year ago

True, but I like how users might upload some pictures / other stuff and ChatGPT answers that it is not able to process the attachment, letting the user know this won't work, instead of just silence.

bramenn commented 1 year ago

It should be default to ignore these types of unsupported messages. If we want it to say something we have several options: