When running a large LLM like llama3-70B locally, the first message to it often times out due to the time it takes ollama to load the model the very first time. Trying again will work since the model will already be loaded or 'hot'.
This is a problem with other UIs I've used too. There needs to be a way for this thing to tell the difference between a long load time and a problem with ollama.
When running a large LLM like llama3-70B locally, the first message to it often times out due to the time it takes ollama to load the model the very first time. Trying again will work since the model will already be loaded or 'hot'.
This is a problem with other UIs I've used too. There needs to be a way for this thing to tell the difference between a long load time and a problem with ollama.