containers / podman-desktop-extension-ai-lab

Work with LLMs on a local environment using containers
https://podman-desktop.io/extensions/ai-lab
Apache License 2.0
181 stars 36 forks source link

Podman AI Lab extension catalog minor recipe list issues #1068

Open mattreid opened 6 months ago

mattreid commented 6 months ago

Bug description

I updated Podman Desktop and installed the Podman AI Lab extension. When looking at the model catalog list, the list cuts off the CPU badge when the RAM requirements badge takes up more space than expected. I see this on the two models that list RAM in MB, instead of GB, the U is cut off and the full badge doesn't show.

Additionally, there's a Size and Age column with sort arrows next to each. Clicking those doesn't change the order of the list for me, only Name adjusts the sort. Does size correspond to the RAM usage? or is it supposed to list disk space required for size? I don't see any metadata that corresponds to Age in the list. Is that supposed to list when it was last published? What does it mean to say CPU there? Would all of these only be CPU accelerated on my M2 Pro MacBook?

Edit: after downloading a model, the downloaded model lists a size and age. It wasn't clear to me from the previous state that it would populate later. You may want to consider abbreviating the unit of time in age, or reassessing how much space is allocated for that column. No matter how wide I make the window, when age is listed in seconds, the s is cutoff and doesn't display.

I was expecting to see more information from the details page when clicking a model, or being offered a download button there, in case the description convinced me I want to try that, rather than going back to the list and downloading from there.

Operating system

M2 Pro MacBook 14.4.1

Installation Method

Installer from website/GitHub releases

Version

1.10.2

Steps to reproduce

Updated a previous install to have the latest Podman Desktop and Podman. Installed the latest version of the Podman AI Lab extension, and went to the Catalog list of models.

Relevant log output

No response

Additional context

Screenshot 2024-05-07 at 3 16 53 PM Screenshot 2024-05-07 at 3 26 19 PM

lstocchi commented 6 months ago

Thanks @mattreid for the feedback. We'll enhance the models page. I moved the issue to the right repo, if you have any other suggestions do not hesitate to let us know. Thank you!! 🙏

mattreid commented 6 months ago

Whoops, thanks for moving it @lstocchi, I should know better.

It doesn't relate to the model list, but when viewing an AI App, after starting it up, it would make sense to me to offer a way to stop it from that page. I see controls to Delete, Open, or Restart, but what about if I'm done running it and just want to turn it off? I can go to Pods, and that has a Stop button, but it would be quicker if there were some way from the app page. Similarly, there's no way to Stop from the Running AI Apps list, just Delete, Open, or in the overflow - Restart, and Open Recipe.

lstocchi commented 6 months ago

@mattreid that was made on purpose as a pod does not have a concept of "pausing/stopping", either it is running or it is terminated. So we wanted to be close to that native behavior. But you're not the first person that is lost about it so i thin k we should discuss about it and see how we can improve this part. I'm going to open an issue by mentioning your comment. Thanks again!!