hanxiao / mindspore-jina-example

https://hanxiao.io/2020/10/28/Mindspore-powered-Neural-Search-in-Jina/
Apache License 2.0
6 stars 1 forks source link

jina hub build wrong #1

Closed huxiaoman7 closed 4 years ago

huxiaoman7 commented 4 years ago

when I run: jina hub build MindsporeLeNet/ --pull --test-uses

it shows: ` ▢️ /usr/local/bin/jina hub build MindsporeLeNet/ --pull --test-uses πŸ”§οΈ cli = hub πŸ”§οΈ daemon = False πŸ”§οΈ dry-run = False πŸ”§οΈ host-info = False πŸ”§οΈ hub = build πŸ”§οΈ password = πŸ”§οΈ path = MindsporeLeNet/ πŸ”§οΈ prune-images = False πŸ”§οΈ pull = True πŸ”§οΈ push = False πŸ”§οΈ raise-error = False πŸ”§οΈ registry = https://index.docker.io/v1/ πŸ”§οΈ repository = jinahub πŸ”§οΈ test-uses = True πŸ”§οΈ username =

      HubIO@5831[I]:building MindsporeLeNet/...
      HubIO@5831[I]:completeness check

βœ“ Dockerfile MindsporeLeNet/Dockerfile βœ“ manifest.yml MindsporeLeNet/manifest.yml βœ“ README.md MindsporeLeNet/README.md βœ“ requirements.txt MindsporeLeNet/requirements.txt βœ“ .yml ['MindsporeLeNet/config.yml'] βœ“ .py ['MindsporeLeNet/init.py'] βœ“ tests ['MindsporeLeNet/tests/test_mindsporelenet.py']

      HubIO@5831[W]:update is missing in your manifest.yml, you may want to check it
      HubIO@5831[I]:Step 1/9 : FROM mindspore/mindspore-cpu:1.0.0
      HubIO@5831[I]:
      HubIO@5831[I]: ---> 911e2669bbcb
      HubIO@5831[I]:Step 2/9 : LABEL ai.jina.hub.name="MindsporeLeNet" ai.jina.hub.description="Encoding image into vectors using mindspore" ai.jina.hub.type="pod" ai.jina.hub.author="Jina AI Dev-Team (dev-team@jina.ai)" ai.jina.hub.url="https://jina.ai" ai.jina.hub.documentation="https://github.com/jina-ai/jina-hub" ai.jina.hub.version="0.0.2" ai.jina.hub.vendor="Jina AI Limited" ai.jina.hub.license="apache-2.0" ai.jina.hub.avatar="None" ai.jina.hub.platform="['linux/amd64']" ai.jina.hub.keywords="['mindspore', 'lenet']" ai.jina.hub.manifest_version="1" ai.jina.hub.kind="encoder"
      HubIO@5831[I]:
      HubIO@5831[I]: ---> Using cache
      HubIO@5831[I]: ---> f5618804429c
      HubIO@5831[I]:Step 3/9 : COPY . /workspace
      HubIO@5831[I]:
      HubIO@5831[I]: ---> Using cache
      HubIO@5831[I]: ---> 8b50af6b09a2
      HubIO@5831[I]:Step 4/9 : WORKDIR /workspace
      HubIO@5831[I]:
      HubIO@5831[I]: ---> Using cache
      HubIO@5831[I]: ---> 788d29789d6f
      HubIO@5831[I]:Step 5/9 : ENV PATH="/root/.local/bin:${PATH}"
      HubIO@5831[I]:
      HubIO@5831[I]: ---> Using cache
      HubIO@5831[I]: ---> 9b982915cc4a
      HubIO@5831[I]:Step 6/9 : RUN pip install --user -r requirements.txt
      HubIO@5831[I]:
      HubIO@5831[I]: ---> Using cache
      HubIO@5831[I]: ---> d1773ee54ec4
      HubIO@5831[I]:Step 7/9 : RUN cd lenet &&     python train.py --data_path data/fashion/ --ckpt_path ckpt --device_target="CPU" &&     cd -
      HubIO@5831[I]:
      HubIO@5831[I]: ---> Using cache
      HubIO@5831[I]: ---> 2b21830a6fa2
      HubIO@5831[I]:Step 8/9 : RUN pip install --user pytest && pytest -s
      HubIO@5831[I]:
      HubIO@5831[I]: ---> Using cache
      HubIO@5831[I]: ---> 46aee6d5234b
      HubIO@5831[I]:Step 9/9 : ENTRYPOINT ["jina", "pod", "--uses", "config.yml"]
      HubIO@5831[I]:
      HubIO@5831[I]: ---> Using cache
      HubIO@5831[I]: ---> 1730bdbb593c
      HubIO@5831[I]:Successfully built 1730bdbb593c
      HubIO@5831[I]:Successfully tagged jinahub/pod.encoder.mindsporelenet:0.0.2
      HubIO@5831[I]:building MindsporeLeNet/ takes 4 seconds (4.64s)
      HubIO@5831[S]:πŸŽ‰ built jinahub/pod.encoder.mindsporelenet:0.0.2 (sha256:1730bdbb59) uncompressed size: 1.1 GB
basic_woman@5838[I]:waiting ready signal from the container
basic_woman@5838[I]:JINA@ 1[W]:due to the missing dependencies or bad implementations, ['jina.hub.crafters.nlp.TikaExtractor'] can not be imported if you are using these executors/drivers, they wont work. You can use `jina check` to list all executors and drivers
basic_woman@5838[I]:
basic_woman@5838[I]:▢️  /root/.local/bin/jina pod --uses config.yml --name basic_woman --identity 4fd086ce1a1511ebb66b829e098a6000 --port-in 51186 --port-out 51187 --port-ctrl 51188 --pea-id 0 --role SINGLETON --port-expose 51189
basic_woman@5838[I]:check-version = False
basic_woman@5838[I]:πŸ”§οΈ                            cli = pod
basic_woman@5838[I]:compress-hwm = -1
basic_woman@5838[I]:compress-lwm = 1.0
basic_woman@5838[I]:ctrl-with-ipc = False
basic_woman@5838[I]:daemon = False
basic_woman@5838[I]:dump-interval = 240
basic_woman@5838[I]:entrypoint = None
basic_woman@5838[I]:exit-no-dump = False
basic_woman@5838[I]:host = 0.0.0.0
basic_woman@5838[I]:host-in = 0.0.0.0
basic_woman@5838[I]:host-out = 0.0.0.0
basic_woman@5838[I]:πŸ”§οΈ                       identity = 4fd086ce1a1511ebb66b829e098a60
basic_woman@5838[I]:log-config = /root/.local/lib/python3.7/sit
basic_woman@5838[I]:log-remote = False
basic_woman@5838[I]:max-idle-time = 60
basic_woman@5838[I]:max-message-size = -1
basic_woman@5838[I]:memory-hwm = -1
basic_woman@5838[I]:πŸ”§οΈ                           name = basic_woman
basic_woman@5838[I]:num-part = 0
basic_woman@5838[I]:parallel = 1
basic_woman@5838[I]:πŸ”§οΈ                         pea-id = 0
basic_woman@5838[I]:polling = ANY
basic_woman@5838[I]:πŸ”§οΈ                      port-ctrl = 51188
basic_woman@5838[I]:πŸ”§οΈ                    port-expose = 51189
basic_woman@5838[I]:πŸ”§οΈ                        port-in = 51186
basic_woman@5838[I]:πŸ”§οΈ                       port-out = 51187
basic_woman@5838[I]:proxy = False
basic_woman@5838[I]:pull-latest = False
basic_woman@5838[I]:py-modules = None
basic_woman@5838[I]:read-only = False
basic_woman@5838[I]:πŸ”§οΈ                           role = SINGLETON
basic_woman@5838[I]:runtime = process
basic_woman@5838[I]:scheduling = LOAD_BALANCE
basic_woman@5838[I]:separated-workspace = False
basic_woman@5838[I]:shutdown-idle = False
basic_woman@5838[I]:skip-on-error = NONE
basic_woman@5838[I]:socket-in = PULL_BIND
basic_woman@5838[I]:socket-out = PUSH_BIND
basic_woman@5838[I]:ssh-keyfile = None
basic_woman@5838[I]:ssh-password = None
basic_woman@5838[I]:ssh-server = None
basic_woman@5838[I]:timeout = -1
basic_woman@5838[I]:timeout-ctrl = 5000
basic_woman@5838[I]:timeout-ready = 10000
basic_woman@5838[I]:πŸ”§οΈ                           uses = config.yml
basic_woman@5838[I]:uses-after = None
basic_woman@5838[I]:uses-before = None
basic_woman@5838[I]:uses-internal = BaseExecutor
basic_woman@5838[I]:volumes = None
basic_woman@5838[I]:
basic_woman@5838[I]:basic_woman@16[I]:post initiating, this may take some time...
basic_woman@5838[I]:basic_woman@16[I]:post initiating, this may take some time takes 0 seconds (0.41s)
basic_woman@5838[I]:basic_woman@16[S]:successfully built MindsporeLeNet from a yaml config
basic_woman@5838[I]:basic_woman@16[I]:setting up sockets...
basic_woman@5838[I]:basic_woman@16[I]:input tcp://0.0.0.0:51186 (PULL_BIND)      output tcp://0.0.0.0:51187 (PUSH_BIND)  control over tcp://0.0.0.0:51188 (PAIR_BIND)
basic_woman@5838[S]:ready and listening
basic_woman@5838[I]:basic_woman@16[S]:ready and listening
       JINA@5831[I]:using <class 'uvloop.Loop'> as event loop
    gateway@5831[S]:gateway is listening at: 0.0.0.0:51193
       Flow@5831[I]:2 Pods (i.e. 2 Peas) are running in this Flow
       Flow@5831[S]:flow is now ready for use, current build_level is 1
    gateway@5831[S]:terminated
basic_woman@5838[I]:basic_woman@16[I]:received "control" from ctlβ–Έβš
basic_woman@5838[I]:basic_woman@16[I]:RequestLoopEnd() causes the breaking from the event loop
basic_woman@5838[I]:basic_woman@16[I]:no update since 2020-10-29 18:34:01, will not save. If you really want to save it, call "touch()" before "save()" to force saving
basic_woman@5838[I]:basic_woman@16[I]:executor says there is nothing to save
basic_woman@5838[I]:basic_woman@16[I]:#sent: 0 #recv: 1 sent_size: 0 Bytes recv_size: 150 Bytes
basic_woman@5838[I]:basic_woman@16[I]:#sent: 1 #recv: 1 sent_size: 215 Bytes recv_size: 150 Bytes
basic_woman@5838[I]:basic_woman@16[S]:terminated
basic_woman@5838[S]:terminated
       Flow@5831[S]:flow is closed and all resources should be released already, current build level is 0`

could you tell me how to fix it?

hanxiao commented 4 years ago

nothing to fix. no error

Charlotte notifications@github.com于2020εΉ΄10月29ζ—₯ 周四19:39ε†™ι“οΌš

when I run: jina hub build MindsporeLeNet/ --pull --test-uses

it shows: ` ▢️ /usr/local/bin/jina hub build MindsporeLeNet/ --pull --test-uses πŸ”§οΈ cli = hub πŸ”§οΈ daemon = False πŸ”§οΈ dry-run = False πŸ”§οΈ host-info = False πŸ”§οΈ hub = build πŸ”§οΈ password = πŸ”§οΈ path = MindsporeLeNet/ πŸ”§οΈ prune-images = False πŸ”§οΈ pull = True πŸ”§οΈ push = False πŸ”§οΈ raise-error = False πŸ”§οΈ registry = https://index.docker.io/v1/ πŸ”§οΈ repository = jinahub πŸ”§οΈ test-uses = True πŸ”§οΈ username =

  HubIO@5831[I]:building MindsporeLeNet/...

  HubIO@5831[I]:completeness check

βœ“ Dockerfile MindsporeLeNet/Dockerfile βœ“ manifest.yml MindsporeLeNet/manifest.yml βœ“ README.md MindsporeLeNet/README.md βœ“ requirements.txt MindsporeLeNet/requirements.txt βœ“ .yml ['MindsporeLeNet/config.yml'] βœ“ .py ['MindsporeLeNet/init.py'] βœ“ tests ['MindsporeLeNet/tests/test_mindsporelenet.py']

  HubIO@5831[W]:update is missing in your manifest.yml, you may want to check it

  HubIO@5831[I]:Step 1/9 : FROM mindspore/mindspore-cpu:1.0.0

  HubIO@5831[I]:

  HubIO@5831[I]: ---> 911e2669bbcb

  HubIO@5831[I]:Step 2/9 : LABEL ai.jina.hub.name="MindsporeLeNet" ai.jina.hub.description="Encoding image into vectors using mindspore" ai.jina.hub.type="pod" ai.jina.hub.author="Jina AI Dev-Team (dev-team@jina.ai)" ai.jina.hub.url="https://jina.ai" ai.jina.hub.documentation="https://github.com/jina-ai/jina-hub" ai.jina.hub.version="0.0.2" ai.jina.hub.vendor="Jina AI Limited" ai.jina.hub.license="apache-2.0" ai.jina.hub.avatar="None" ai.jina.hub.platform="['linux/amd64']" ai.jina.hub.keywords="['mindspore', 'lenet']" ai.jina.hub.manifest_version="1" ai.jina.hub.kind="encoder"

  HubIO@5831[I]:

  HubIO@5831[I]: ---> Using cache

  HubIO@5831[I]: ---> f5618804429c

  HubIO@5831[I]:Step 3/9 : COPY . /workspace

  HubIO@5831[I]:

  HubIO@5831[I]: ---> Using cache

  HubIO@5831[I]: ---> 8b50af6b09a2

  HubIO@5831[I]:Step 4/9 : WORKDIR /workspace

  HubIO@5831[I]:

  HubIO@5831[I]: ---> Using cache

  HubIO@5831[I]: ---> 788d29789d6f

  HubIO@5831[I]:Step 5/9 : ENV PATH="/root/.local/bin:${PATH}"

  HubIO@5831[I]:

  HubIO@5831[I]: ---> Using cache

  HubIO@5831[I]: ---> 9b982915cc4a

  HubIO@5831[I]:Step 6/9 : RUN pip install --user -r requirements.txt

  HubIO@5831[I]:

  HubIO@5831[I]: ---> Using cache

  HubIO@5831[I]: ---> d1773ee54ec4

  HubIO@5831[I]:Step 7/9 : RUN cd lenet &&     python train.py --data_path data/fashion/ --ckpt_path ckpt --device_target="CPU" &&     cd -

  HubIO@5831[I]:

  HubIO@5831[I]: ---> Using cache

  HubIO@5831[I]: ---> 2b21830a6fa2

  HubIO@5831[I]:Step 8/9 : RUN pip install --user pytest && pytest -s

  HubIO@5831[I]:

  HubIO@5831[I]: ---> Using cache

  HubIO@5831[I]: ---> 46aee6d5234b

  HubIO@5831[I]:Step 9/9 : ENTRYPOINT ["jina", "pod", "--uses", "config.yml"]

  HubIO@5831[I]:

  HubIO@5831[I]: ---> Using cache

  HubIO@5831[I]: ---> 1730bdbb593c

  HubIO@5831[I]:Successfully built 1730bdbb593c

  HubIO@5831[I]:Successfully tagged jinahub/pod.encoder.mindsporelenet:0.0.2

  HubIO@5831[I]:building MindsporeLeNet/ takes 4 seconds (4.64s)

  HubIO@5831[S]:πŸŽ‰ built jinahub/pod.encoder.mindsporelenet:0.0.2 (sha256:1730bdbb59) uncompressed size: 1.1 GB

basic_woman@5838[I]:waiting ready signal from the container

basic_woman@5838[I]:JINA@ 1[W]:due to the missing dependencies or bad implementations, ['jina.hub.crafters.nlp.TikaExtractor'] can not be imported if you are using these executors/drivers, they wont work. You can use jina check to list all executors and drivers

basic_woman@5838[I]:

basic_woman@5838[I]:▢️ /root/.local/bin/jina pod --uses config.yml --name basic_woman --identity 4fd086ce1a1511ebb66b829e098a6000 --port-in 51186 --port-out 51187 --port-ctrl 51188 --pea-id 0 --role SINGLETON --port-expose 51189

basic_woman@5838[I]:check-version = False

basic_woman@5838[I]:πŸ”§οΈ cli = pod

basic_woman@5838[I]:compress-hwm = -1

basic_woman@5838[I]:compress-lwm = 1.0

basic_woman@5838[I]:ctrl-with-ipc = False

basic_woman@5838[I]:daemon = False

basic_woman@5838[I]:dump-interval = 240

basic_woman@5838[I]:entrypoint = None

basic_woman@5838[I]:exit-no-dump = False

basic_woman@5838[I]:host = 0.0.0.0

basic_woman@5838[I]:host-in = 0.0.0.0

basic_woman@5838[I]:host-out = 0.0.0.0

basic_woman@5838[I]:πŸ”§οΈ identity = 4fd086ce1a1511ebb66b829e098a60

basic_woman@5838[I]:log-config = /root/.local/lib/python3.7/sit

basic_woman@5838[I]:log-remote = False

basic_woman@5838[I]:max-idle-time = 60

basic_woman@5838[I]:max-message-size = -1

basic_woman@5838[I]:memory-hwm = -1

basic_woman@5838[I]:πŸ”§οΈ name = basic_woman

basic_woman@5838[I]:num-part = 0

basic_woman@5838[I]:parallel = 1

basic_woman@5838[I]:πŸ”§οΈ pea-id = 0

basic_woman@5838[I]:polling = ANY

basic_woman@5838[I]:πŸ”§οΈ port-ctrl = 51188

basic_woman@5838[I]:πŸ”§οΈ port-expose = 51189

basic_woman@5838[I]:πŸ”§οΈ port-in = 51186

basic_woman@5838[I]:πŸ”§οΈ port-out = 51187

basic_woman@5838[I]:proxy = False

basic_woman@5838[I]:pull-latest = False

basic_woman@5838[I]:py-modules = None

basic_woman@5838[I]:read-only = False

basic_woman@5838[I]:πŸ”§οΈ role = SINGLETON

basic_woman@5838[I]:runtime = process

basic_woman@5838[I]:scheduling = LOAD_BALANCE

basic_woman@5838[I]:separated-workspace = False

basic_woman@5838[I]:shutdown-idle = False

basic_woman@5838[I]:skip-on-error = NONE

basic_woman@5838[I]:socket-in = PULL_BIND

basic_woman@5838[I]:socket-out = PUSH_BIND

basic_woman@5838[I]:ssh-keyfile = None

basic_woman@5838[I]:ssh-password = None

basic_woman@5838[I]:ssh-server = None

basic_woman@5838[I]:timeout = -1

basic_woman@5838[I]:timeout-ctrl = 5000

basic_woman@5838[I]:timeout-ready = 10000

basic_woman@5838[I]:πŸ”§οΈ uses = config.yml

basic_woman@5838[I]:uses-after = None

basic_woman@5838[I]:uses-before = None

basic_woman@5838[I]:uses-internal = BaseExecutor

basic_woman@5838[I]:volumes = None

basic_woman@5838[I]:

basic_woman@5838[I]:basic_woman@16[I]:post initiating, this may take some time...

basic_woman@5838[I]:basic_woman@16[I]:post initiating, this may take some time takes 0 seconds (0.41s)

basic_woman@5838[I]:basic_woman@16[S]:successfully built MindsporeLeNet from a yaml config

basic_woman@5838[I]:basic_woman@16[I]:setting up sockets...

basic_woman@5838[I]:basic_woman@16[I]:input tcp://0.0.0.0:51186 (PULL_BIND) output tcp://0.0.0.0:51187 (PUSH_BIND) control over tcp://0.0.0.0:51188 (PAIR_BIND)

basic_woman@5838[S]:ready and listening

basic_woman@5838[I]:basic_woman@16[S]:ready and listening

   JINA@5831[I]:using <class 'uvloop.Loop'> as event loop

gateway@5831[S]:gateway is listening at: 0.0.0.0:51193

   Flow@5831[I]:2 Pods (i.e. 2 Peas) are running in this Flow

   Flow@5831[S]:flow is now ready for use, current build_level is 1

gateway@5831[S]:terminated

basic_woman@5838[I]:basic_woman@16[I]:received "control" from ctlβ–Έβš

basic_woman@5838[I]:basic_woman@16[I]:RequestLoopEnd() causes the breaking from the event loop

basic_woman@5838[I]:basic_woman@16[I]:no update since 2020-10-29 18:34:01, will not save. If you really want to save it, call "touch()" before "save()" to force saving

basic_woman@5838[I]:basic_woman@16[I]:executor says there is nothing to save

basic_woman@5838[I]:basic_woman@16[I]:#sent: 0 #recv: 1 sent_size: 0 Bytes recv_size: 150 Bytes

basic_woman@5838[I]:basic_woman@16[I]:#sent: 1 #recv: 1 sent_size: 215 Bytes recv_size: 150 Bytes

basic_woman@5838[I]:basic_woman@16[S]:terminated

basic_woman@5838[S]:terminated

   Flow@5831[S]:flow is closed and all resources should be released already, current build level is 0`

could you tell me how to fix it?

β€” You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/hanxiao/mindspore-jina-example/issues/1, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAPSL2U7VJTU34VUGOHVFI3SNGZF7ANCNFSM4TEDSBOA .

-- [image: photo] Han Xiao Founder & CEO, Jina AI

han.xiao@jina.ai

-- CONFIDENTIALITY NOTICE: This e-mail communication and any attachments may contain confidential and privileged information for the use of the designated recipients named above. If you are not the intended recipient, you are hereby notified that you have received this communication in error and that any review, disclosure, dissemination, distribution or copying of it or its contents is strictly prohibited. If you have received this communication in error, please notify the sender by return e-mail and delete and/or destroy all copies of this communication and any attachments.

huxiaoman7 commented 4 years ago

sorry, I ignored the successfully build info, then I run jina hello-world --uses-index helloworld.flow.index.yml --uses-query helloworld.flow.query.yml it worked successfully! Nice tutorial!