search

containers / podman-desktop-extension-ai-lab

Work with LLMs on a local environment using containers
https://podman-desktop.io/extensions/ai-lab
Apache License 2.0
182 stars 39 forks source link

Cannot pull the recipe and copy the model onto the podman machine with hyperv virtualization provider #1885

Closed odockal closed 1 month ago

odockal commented 1 month ago

Bug description

I am getting error for pulling a summarizer recipe and uploading the model when on podman machine with hyper V provider on windows.

Errors say:

Something went wrong while pulling Summarizer: Error: (HTTP code 500) server error - container create: statfs /C:\Users\Ondrej\.local\share\containers\podman-desktop\extensions-storage\redhat.ai-lab\models\hf.instructlab.granite-7b-lab-GGUF: no such file or directory

Something went wrong while starting the inference server: Error: (HTTP code 500) server error - container create: statfs /C:\Users\Ondrej\.local\share\containers\podman-desktop\extensions-storage\redhat.ai-lab\models\hf.instructlab.granite-7b-lab-GGUF: no such file or directory

Image

Operating system

windows 10

Installation Method

from Podman-Desktop extension page

Version

next (development version)

Steps to reproduce

  1. Podman Desktop 1.13.2
  2. AI-lab from Catalog 1.2.3
  3. Podman Machine (12 GB memory, 5 CPUs) with hyperv
  4. Start summarizer recire
  5. Assert: Project is running Actual result: Errors pulling a project and copying the model

Relevant log output

main ↪️ [ai-lab] Something went wrong while trying to stat remote model path Error: Command execution failed with exit code 1 at ChildProcess. (C:\Users\Ondrej\AppData\Local\Temp\2nELiQSbfBJmGdVdMl3N7AC2Ovh\resources\app.asar\packages\main\dist\index.cjs:342:13022) at ChildProcess.emit (node:events:519:28) at ChildProcess._handle.onexit (node:internal/child_process:294:12)

update images Error: connect ENOENT \.\pipe\podman-machine-default (anonymous) @ event-store.ts:237 Promise.catch (anonymous) @ event-store.ts:236 setTimeout o @ event-store.ts:228 await in o (anonymous) @ event-store.ts:262 emit @ VM4 sandbox_bundle:2 send @ VM5:2 (anonymous) @ VM5:2 emit @ VM4 sandbox_bundle:2 onMessage @ VM4 sandbox_bundle:2

Additional context

No response

jeffmaury commented 1 month ago

Copying model file should be limited to WSL

jeffmaury commented 1 month ago

Podman AI Lab is not supported on Hyper-V as Podman Hyper-V does not support volume binding until Podman 5.3

Closing as it is not related to Podman AI Lab