The CUSTOM_MODELS variable seems to work. In the app settings, "mixtral" is the only option in the dropdown, and it is selected by default.
The CODE variable does not seem to do anything. When I click the "auth" link to enter a password, I can type anything and it works. I can even ignore the "auth" message and just start entering prompts.
Describe the bug I have this setup at abc.com, and a LocalAI instance setup at xyz.com. I have the following docker compose file:
The CUSTOM_MODELS variable seems to work. In the app settings, "mixtral" is the only option in the dropdown, and it is selected by default.
The CODE variable does not seem to do anything. When I click the "auth" link to enter a password, I can type anything and it works. I can even ignore the "auth" message and just start entering prompts.
When I try entering a prompt, the request always goes to https://abc.com/v1/chat/completions, regardless of what I set in the BASE_URL variable. It should be going to https://xyz.com/v1/chat/completions
To Reproduce
docker compose up -d
Expected behavior The CODE environment variable should require the correct password. Requests should go to the domain set in the BASE_URL variable.
Screenshots If applicable, add screenshots to help explain your problem.
Deployment
Desktop (please complete the following information):