Strange/unrelated questions and answers in the Bot response

bifrostlab / llm-assistant

Multifunctional LLM Assistant for Discord

8 stars 6 forks source link

Closed rodonguyen closed 6 months ago

rodonguyen commented 7 months ago

IIRC, I asked phi:

what model are you? 3.5 or 4?

Its response not only contains the answer I need but also the weird answers to other questions that I don't ask:

I log the bug here in case someone encounters this again. Then, we will investigate.

rodonguyen commented 7 months ago

chatted with the AI Engineers, could be hallucinations from training Ollama/phi.

hungdtrn commented 7 months ago

We can potentially add stop word at "Question:" so that the AI will stop when it see "Question:" in the generated answer