Add ALLOW_MODEL_SWITCHING environment variable, set to false by default for best performance. Switching between models takes a long time, so it is ideal to leave this false and reset the server with different models defined in the .env file. The option is still available to freely switch and deal with the delay by setting this to true
Add
ALLOW_MODEL_SWITCHING
environment variable, set tofalse
by default for best performance. Switching between models takes a long time, so it is ideal to leave this false and reset the server with different models defined in the.env
file. The option is still available to freely switch and deal with the delay by setting this totrue