search

cvat-ai / cvat

Annotate better with CVAT, the industry-leading data engine for machine learning. Used and trusted by teams at any scale, for data of any scale.
https://cvat.ai
MIT License
12.12k stars 2.94k forks source link

Deploy model with Nuclio on macOS #8107

Closed DP1701 closed 4 weeks ago

DP1701 commented 1 month ago

Hello everyone,

I am currently trying to configure CVAT so that I can also use the auto annotation function on macOS 10.14. I was able to get the SAM model to run, but not the other examples, e.g. dextr or yolo-v3-tf.

My approach:

Install of CVAT with docker compose -f docker-compose.yml -f components/serverless/docker-compose.serverless.yml up -d and nuclio, as it states on this page. Then I have to install SAM with the following command:

nuctl deploy --project-name cvat --path "`pwd`/pytorch/facebookresearch/sam/nuclio/" --file "`pwd`/pytorch/facebookresearch/sam/nuclio/function.yaml" --platform local

Trying it with ./deploy_cpu.sh pytorch/facebookresearch/sam/nuclio/ is useless, as it causes problems on macOS despite the activation of the globstar option.

If I now try the same approach with dextr or yolo-v3-tf, the following information is displayed on the console: 

% nuctl deploy --project-name cvat --path "`pwd`/openvino/omz/public/yolo-v3-tf/nuclio/"  --file "`pwd`/openvino/omz/public/yolo-v3-tf/nuclio/function.yaml" --platform local
24.07.02 11:35:25.037                     nuctl (I) Deploying function {"name": "openvino-omz-public-yolo-v3-tf"}
24.07.02 11:35:25.038                     nuctl (I) Building {"builderKind": "docker", "versionInfo": "Label: 1.11.24, Git commit: f2a3900d23b92fd3639dc9cb765044ef53a4fb2b, OS: darwin, Arch: amd64, Go version: go1.19.10", "name": "openvino-omz-public-yolo-v3-tf"}
24.07.02 11:35:25.392                     nuctl (I) Staging files and preparing base images
24.07.02 11:35:25.396                     nuctl (I) Building processor image {"registryURL": "", "taggedImageName": "cvat.openvino.omz.public.yolo-v3-tf:latest"}
24.07.02 11:35:25.397     nuctl.platform.docker (I) Pulling image {"imageName": "quay.io/nuclio/handler-builder-python-onbuild:1.11.24-amd64"}
24.07.02 11:35:29.070     nuctl.platform.docker (I) Pulling image {"imageName": "quay.io/nuclio/uhttpc:0.0.1-amd64"}
24.07.02 11:35:31.927            nuctl.platform (I) Building docker image {"image": "cvat.openvino.omz.public.yolo-v3-tf:latest"}
24.07.02 11:35:33.245     nuctl.platform.docker (W) Docker command outputted to stderr - this may result in errors {"workingDir": "/var/folders/4v/_qhpbctd5sj154f5lq35t2wh0000gq/T/nuclio-build-188433718/staging", "cmd": "docker build --network host --force-rm -t cvat.openvino.omz.public.yolo-v3-tf:latest -f /var/folders/4v/_qhpbctd5sj154f5lq35t2wh0000gq/T/nuclio-build-188433718/staging/Dockerfile.processor   --build-arg NUCLIO_LABEL=1.11.24 --build-arg NUCLIO_ARCH=amd64 --build-arg NUCLIO_BUILD_LOCAL_HANDLER_DIR=handler  .", "stderr": "#0 building with \"desktop-linux\" instance using docker driver\n\n#1 [internal] load .dockerignore\n#1 transferring context: 2B done\n#1 DONE 0.0s\n\n#2 [internal] load build definition from Dockerfile.processor\n#2 transferring dockerfile: 959B done\n#2 DONE 0.0s\n\n#3 [internal] load metadata for docker.io/library/cvat.openvino.omz.public.yolo-v3-tf.base:latest\n#3 ERROR: pull access denied, repository does not exist or may require authorization: server message: insufficient_scope: authorization failed\n------\n > [internal] load metadata for docker.io/library/cvat.openvino.omz.public.yolo-v3-tf.base:latest:\n------\nDockerfile.processor:6\n--------------------\n   4 |     \n   5 |     # From the base image\n   6 | >>> FROM cvat.openvino.omz.public.yolo-v3-tf.base\n   7 |     \n   8 |     \n--------------------\nERROR: failed to solve: cvat.openvino.omz.public.yolo-v3-tf.base: pull access denied, repository does not exist or may require authorization: server message: insufficient_scope: authorization failed\n\nView build details: docker-desktop://dashboard/build/desktop-linux/desktop-linux/qi7ebhxkwvfd65hus8faw21c0\n"}
24.07.02 11:35:33.255                     nuctl (W) Failed to create a function; setting the function status {"err": "Failed to build processor image", "errVerbose": "\nError - exit status 1\n    /nuclio/pkg/cmdrunner/shellrunner.go:114\n\nCall stack:\nstdout:\n\nstderr:\n#0 building with \"desktop-linux\" instance using docker driver\n\n#1 [internal] load .dockerignore\n#1 transferring context: 2B done\n#1 DONE 0.0s\n\n#2 [internal] load build definition from Dockerfile.processor\n#2 transferring dockerfile: 959B done\n#2 DONE 0.0s\n\n#3 [internal] load metadata for docker.io/library/cvat.openvino.omz.public.yolo-v3-tf.base:latest\n#3 ERROR: pull access denied, repository does not exist or may require authorization: server message: insufficient_scope: authorization failed\n------\n > [internal] load metadata for docker.io/library/cvat.openvino.omz.public.yolo-v3-tf.base:latest:\n------\nDockerfile.processor:6\n--------------------\n   4 |     \n   5 |     # From the base image\n   6 | >>> FROM cvat.openvino.omz.public.yolo-v3-tf.base\n   7 |     \n   8 |     \n--------------------\nERROR: failed to solve: cvat.openvino.omz.public.yolo-v3-tf.base: pull access denied, repository does not exist or may require authorization: server message: insufficient_scope: authorization failed\n\nView build details: docker-desktop://dashboard/build/desktop-linux/desktop-linux/qi7ebhxkwvfd65hus8faw21c0\n\n    /nuclio/pkg/cmdrunner/shellrunner.go:114\nFailed to build\n    /nuclio/pkg/dockerclient/shell.go:116\nFailed to build docker image\n    .../pkg/containerimagebuilderpusher/docker.go:70\nFailed to build processor image\n    /nuclio/pkg/processor/build/builder.go:264\nFailed to build processor image"}

Error - exit status 1
    /nuclio/pkg/cmdrunner/shellrunner.go:114

Call stack:
stdout:

stderr:
#0 building with "desktop-linux" instance using docker driver

#1 [internal] load .dockerignore
#1 transferring context: 2B done
#1 DONE 0.0s

#2 [internal] load build definition from Dockerfile.processor
#2 transferring dockerfile: 959B done
#2 DONE 0.0s

#3 [internal] load metadata for docker.io/library/cvat.openvino.omz.public.yolo-v3-tf.base:latest
#3 ERROR: pull access denied, repository does not exist or may require authorization: server message: insufficient_scope: authorization failed
------
 > [internal] load metadata for docker.io/library/cvat.openvino.omz.public.yolo-v3-tf.base:latest:
------
Dockerfile.processor:6
--------------------
   4 |     
   5 |     # From the base image
   6 | >>> FROM cvat.openvino.omz.public.yolo-v3-tf.base
   7 |     
   8 |     
--------------------
ERROR: failed to solve: cvat.openvino.omz.public.yolo-v3-tf.base: pull access denied, repository does not exist or may require authorization: server message: insufficient_scope: authorization failed

View build details: docker-desktop://dashboard/build/desktop-linux/desktop-linux/qi7ebhxkwvfd65hus8faw21c0

    /nuclio/pkg/cmdrunner/shellrunner.go:114
Failed to build
    /nuclio/pkg/dockerclient/shell.go:116
Failed to build docker image
    .../pkg/containerimagebuilderpusher/docker.go:70
Failed to build processor image
    /nuclio/pkg/processor/build/builder.go:264
Failed to deploy function
    ...//nuclio/pkg/platform/abstract/platform.go:227

Does anyone know what the reason for this is?

DP1701 commented 1 month ago

Has this ever been tested under macOS?