Closed jangmarker closed 1 month ago
With genv 1.4.1 genv llm works for the multi-user use case. But genv remote llm doesn't seem to have picked up on the change:
genv llm
genv remote llm
$ genv remote -H <host> llm ps HOST MODEL PORT CREATED EID USER <host> llama2:7b/45893N/A 2 hours ago 2891 <user>
note how the model is reported as "llama2:7b/45893" with the port presumably being "N/A".
Correspondingly, the following happens:
$ genv remote -H <host> llm attach llama2:7b Could not find LLM model 'llama2:7b' $ genv remote -H <host> llm attach llama2:7b/45893 pulling manifest Error: pull model manifest: file does not exist
hi @jangmarker thanks for this issue! I fixed it and released Genv 1.4.2.
pls let me know if this issue is not resolved.
thanks again!
It's fixed, thanks a lot!
With genv 1.4.1
genv llm
works for the multi-user use case. Butgenv remote llm
doesn't seem to have picked up on the change:note how the model is reported as "llama2:7b/45893" with the port presumably being "N/A".
Correspondingly, the following happens: