As a user, there is no indication the weights for the local LLM are being loaded.
What the user currently sees is no response and no indication they can resubmit the question.
The local LLM has a status endpoint that is immediately available. The search.php code should query that endpoint first, and wait until it finished loading to submit the query.
As a user, there is no indication the weights for the local LLM are being loaded.
What the user currently sees is no response and no indication they can resubmit the question.
The local LLM has a status endpoint that is immediately available. The
search.phpcode should query that endpoint first, and wait until it finished loading to submit the query.