search

jeffdapaz / VisualChatGPTStudio

Add chatGPT functionalities directly on Visual Studio
https://marketplace.visualstudio.com/items?itemName=jefferson-pires.VisualChatGPTStudio
MIT License
210 stars 51 forks source link

Empty system prompt for chat functionality is incompatible with local LLM (LM studio) #75

Closed Horschig closed 2 months ago

Horschig commented 4 months ago

When using the chat functionality, I get the following error:

image

Inspecting the server logs revealed that he system prompt is empty, and LM studio does not like an empty content field. The Turbo chat works though.

jeffdapaz commented 4 months ago

Hi @Horschig, thanks to advise about this issue.

It's true, for the Tool Window the System Message is not being setted.

I will add a new optional parameter at the Extension Options to be possible set the System Message for the Tool Window. Will be on next release soon.

jeffdapaz commented 4 months ago

@Horschig,

I already published a new version that contains the new parameter "Tool Window System Message" in the Extension's Options". Now you can set a System Message to that window.

I think now you do not have this problem anymore with this custom LLM, but if not, you can come back here to tell.

Horschig commented 4 months ago

Thanks, this works now. However, I have the same issue when I want to use the "Ask Anything" function (Alt+8).

jeffdapaz commented 4 months ago

It's true, I forgot that the Ask Anything command also doesn't use System Message.

I will provide a correction and make it available in the next release.

Thanks for letting me know about.

Horschig commented 4 months ago

no worries, thanks for the effort!

jeffdapaz commented 2 months ago

Closing this issue because I published a new release with updated Ask Anything command that sends Tool Window System Message as System Message.