DevXT-LLC / ezlocalai

ezlocalai is an easy to set up local artificial intelligence server with OpenAI Style Endpoints.
MIT License
66 stars 12 forks source link

Add `ALLOW_MODEL_SWITCHING` environment variable #22

Closed Josh-XT closed 5 months ago

Josh-XT commented 5 months ago

Add ALLOW_MODEL_SWITCHING environment variable, set to false by default for best performance. Switching between models takes a long time, so it is ideal to leave this false and reset the server with different models defined in the .env file. The option is still available to freely switch and deal with the delay by setting this to true