[BUG]: Information about chat model isn't stored

Mintplex-Labs / anything-llm

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, and more.

https://anythingllm.com

MIT License

26.53k stars 2.65k forks source link

[BUG]: Information about chat model isn't stored #955

Closed ErykCh closed 7 months ago

ErykCh commented 7 months ago

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

Hi, version 1.4.1 on windows

after setting chat model and saving (update workspace on the bottom) when I back again to this tab there is:

Are there known steps to reproduce?

No response

shatfield4 commented 7 months ago

Does this only happen on OpenRouter or all LLMs? Are you changing the LLM provider in the LLM preference menu after setting the chat model under workspace settings? Every time you switch the LLM provider under LLM preferences, it is supposed to switch back to system default.

ErykCh commented 7 months ago

No, I don't touch LLM Provider. Its OpenRouter all the time.

timothycarambat commented 7 months ago

Currently unable to replicate in AnythingLLM Desktop 1.4.0 Using other providers, but also including OpenRouter.

Set OpenRouter as LLM Preference with some model
Set multiple workspace to use different model from same provider & Save.

On revisit the model is still selected and chats honor this.

Recommendation: Ensure on the latest version and to full quit AnythingLLM and restart to ensure all migrations are present.