search

DevXT-LLC / ezlocalai

ezlocalai is an easy to set up local artificial intelligence server with OpenAI Style Endpoints.
MIT License
72 stars 13 forks source link

Is there a endpoint I can invoke to download a certain model? #25

Closed Daksh closed 7 months ago

Daksh commented 7 months ago

I was facing this issue where in a new setup, my requests seemed to be not working or timing out. I figured (most likely) that it is because the model was not downloaded and my connection was not fast enough for it to happen quickly. What is the best way of using the endpoints? Is there an endpoint I can invoke first to download the required model and keep checking progress of the download?

Josh-XT commented 7 months ago

You can modify the DEFAULT_MODEL in your .env file to a different model name from the model list to have it download when the server starts.