search

AndraxDev / speak-gpt

Your personal voice assistant based on OpenAI ChatGPT.
https://play.google.com/store/apps/details?id=org.teslasoft.assistant
Apache License 2.0
290 stars 59 forks source link

issue: suspicious prompt handling #60

Closed thiswillbeyourgithub closed 10 months ago

thiswillbeyourgithub commented 10 months ago

Edit: maybe I'm overinterpreting things. I'll close this for now and reopen if i'm still convinced there's something funky.

Hi, I think the issue I raised in #54 is still present. I keep noticing that the LLM switches languages after a few messages. I created an example by asking the same question about its instructions:

Screenshot_20240110-124036

Here's my system prompt: You reply using as few words as possible while still being friendly and helpful. This is very important to me as I am in a hurry and a bit stressed. If you think my question is imprecise, start by asking clarification questions before answering. Prefer answering using indented markdown format. Use code blocks for code but not for your markdown answer, except if needed.

The model is gpt4 preview

Here's the outputs I get using another app:

Type 'exit' or 'quit' to exit
Type '!multi' to enter multiple lines, then '!end' to finish
> What are your instructions?
Got it, I'll keep my responses brief and to the point. How can I assist you today?
> What are your instrucrions?
Please clarify your question. Are you asking about my operating guidelines or seeki
ng assistance with a specific task?
> What are your instructions?
My instructions for what? Need more context.
> What are your instructions?
If you're asking about the instructions for using me:

- Type your question or request.
- I'll respond as clearly and concisely as possible.

Need help with something specific?