search

codeproject / CodeProject.AI-Server

CodeProject.AI Server is a self contained service that software developers can include in, and distribute with, their applications in order to augment their apps with the power of AI.
Other
635 stars 143 forks source link

GPU image on dockerhub has not been updated in months whereas the other images were updated a 19 days ago. #78

Closed nabheet closed 5 months ago

nabheet commented 10 months ago

Area of Concern

Describe the bug I cannot find a 2.3 version with the GPU tag on dockerhub.

Expected behavior I am hoping that all platforms should have their latest pointing to 2.3.4.

AKHwyJunkie commented 9 months ago

It appears there have been some different forks in the GPU versions to reflect CUDA 11 vs. 12, so your previous tag might need to be updated. Documented a bit here. Both these run v2.3.2.

docker pull codeproject/ai-server:cuda11_7-2.3.2
docker pull codeproject/ai-server:cuda12_2-2.3.2

FWIW, I've followed this project for quite awhile now. It's not been uncommon for the Docker version to fall behind the Windows version. Hard to say their exact development cycle, but I do think they focus more on Windows based bug fixes and then eventually roll the various updates into the Docker deployment every few versions. I've also seen the tags (and even the Docker Hub designation) change without much fanfare or notice. Always good to check here for current tags.

nabheet commented 9 months ago

Thanks! I did find the cuda versions later and forgot to update this issue. I am currently using the cuda 12 version 2.3.2 image. Looks like the 2.3.4 version is only available for rpi and arm64. It would be nice to have this version for other supported platforms too.

AKHwyJunkie commented 9 months ago

In case you hadn't noticed, Chris pushed v2.4.6 to the Docker repository today. Requires manual tags. Still figuring out how to use the new mesh feature and routing, but might be interesting to you since you wanted to get into v2.4.

nabheet commented 9 months ago

Thanks! giving it whirl now :smiley:

nabheet commented 9 months ago

This mesh stuff looks interesting!

tylergibson commented 6 months ago

Bumping to the top again - it’s been 6 months and now multiple releases behind cpu images.

scratch that - re-read through the docs and see that gpu is now tagged under cuda tags - maybe a docs update and a note on dockerhub that the gpu tag is deprecated

AKHwyJunkie commented 6 months ago

scratch that - re-read through the docs and see that gpu is now tagged under cuda tags - maybe a docs update and a note on dockerhub that the gpu tag is deprecated

One thing I've found quite helpful with this project is to review the tags on Docker Hub. There's been minor differences between releases and changes in the tagging structure. I suspect this will eventually even itself out, but Docker Hub always shows you latest releases and the appropriate tag to use to get the image you want.

ChrisMaunder commented 5 months ago

Docker images have all been updated. Please check tags