search

jina-ai / examples

Jina examples and demos to help you get started
https://docs.jina.ai
Apache License 2.0
453 stars 140 forks source link

multires-lyrics-search failed #411

Closed yiouyou closed 3 years ago

yiouyou commented 3 years ago

With phyon3.7

python app.py search failed as below:

(py37-multires-lyrics-search) sz@pc:/mnt/d/jina-ai/multires-lyrics-search$ python app.py search
      chunk_seg@29123[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
      tf_encode@29125[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
      tf_encode@29125[I]:input tcp://0.0.0.0:33479 (PULL_BIND) output tcp://0.0.0.0:59281 (PUSH_CONNECT) control over tcp://0.0.0.0:52867 (PAIR_BIND)
      chunk_seg@29123[I]:input tcp://0.0.0.0:44523 (PULL_BIND) output tcp://0.0.0.0:33479 (PUSH_CONNECT) control over tcp://0.0.0.0:46723 (PAIR_BIND)
 chunk_idx/head@29133[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
 chunk_idx/head@29133[I]:input tcp://0.0.0.0:59281 (PULL_BIND) output tcp://0.0.0.0:50163 (PUB_BIND) control over tcp://0.0.0.0:43895 (PAIR_BIND)
 chunk_idx/tail@29138[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
 chunk_idx/tail@29138[I]:input tcp://0.0.0.0:56449 (PULL_BIND) output tcp://0.0.0.0:59901 (PUSH_CONNECT) control over tcp://0.0.0.0:58045 (PAIR_BIND)
    chunk_idx/1@29143[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
    chunk_idx/1@29143[I]:input tcp://0.0.0.0:50163 (SUB_CONNECT) output tcp://0.0.0.0:56449 (PUSH_CONNECT) control over tcp://0.0.0.0:47495 (PAIR_BIND)
    chunk_idx/2@29148[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
    chunk_idx/2@29148[I]:input tcp://0.0.0.0:50163 (SUB_CONNECT) output tcp://0.0.0.0:56449 (PUSH_CONNECT) control over tcp://0.0.0.0:43511 (PAIR_BIND)
    chunk_idx/3@29153[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
    chunk_idx/3@29153[I]:input tcp://0.0.0.0:50163 (SUB_CONNECT) output tcp://0.0.0.0:56449 (PUSH_CONNECT) control over tcp://0.0.0.0:49541 (PAIR_BIND)
    chunk_idx/4@29158[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
    chunk_idx/4@29158[I]:input tcp://0.0.0.0:50163 (SUB_CONNECT) output tcp://0.0.0.0:56449 (PUSH_CONNECT) control over tcp://0.0.0.0:50077 (PAIR_BIND)
   BaseExecutor@29133[I]:post_init may take some time...
   BaseExecutor@29133[I]:post_init may take some time takes 0 seconds (0.00s)
   BaseExecutor@29138[I]:post_init may take some time...
TransformerTorchEncoder@29125[I]:post_init may take some time...
   BaseExecutor@29138[I]:post_init may take some time takes 0 seconds (0.00s)
    Sentencizer@29123[I]:post_init may take some time...
    Sentencizer@29123[I]:post_init may take some time takes 0 seconds (0.00s)
   BaseExecutor@29138[S]:successfully built BaseExecutor from a yaml config
   BaseExecutor@29133[S]:successfully built BaseExecutor from a yaml config
    Sentencizer@29123[S]:successfully built Sentencizer from a yaml config
         ranker@29167[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
         ranker@29167[I]:input tcp://0.0.0.0:59901 (PULL_BIND) output tcp://0.0.0.0:60467 (PUSH_CONNECT) control over tcp://0.0.0.0:33217 (PAIR_BIND)
        doc_idx@29172[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
        doc_idx@29172[I]:input tcp://0.0.0.0:60467 (PULL_BIND) output tcp://0.0.0.0:33023 (PUSH_BIND) control over tcp://0.0.0.0:51315 (PAIR_BIND)
      chunk_seg@29105[S]:ready and listening
        gateway@29177[I]:starting jina.peapods.runtimes.asyncio.rest.RESTRuntime...
   NumpyIndexer@29143[I]:post_init may take some time...
   NumpyIndexer@29143[I]:post_init may take some time takes 0 seconds (0.00s)
   NumpyIndexer@29148[I]:post_init may take some time...
   NumpyIndexer@29143[S]:restore NumpyIndexer from ./workspace/chunk_compound_indexer-1/vecidx-1/vecidx.bin
   NumpyIndexer@29148[I]:post_init may take some time takes 0 seconds (0.00s)
   NumpyIndexer@29148[S]:restore NumpyIndexer from ./workspace/chunk_compound_indexer-2/vecidx-2/vecidx.bin
BinaryPbIndexer@29143[I]:post_init may take some time...
BinaryPbIndexer@29143[I]:post_init may take some time takes 0 seconds (0.00s)
BinaryPbIndexer@29148[I]:post_init may take some time...
BinaryPbIndexer@29148[I]:post_init may take some time takes 0 seconds (0.00s)
BinaryPbIndexer@29143[S]:restore BinaryPbIndexer from ./workspace/chunk_compound_indexer-1/chunkidx-1/chunkidx.bin
BinaryPbIndexer@29148[S]:restore BinaryPbIndexer from ./workspace/chunk_compound_indexer-2/chunkidx-2/chunkidx.bin
CompoundIndexer@29143[I]:post_init may take some time...
   NumpyIndexer@29153[I]:post_init may take some time...
   NumpyIndexer@29153[I]:post_init may take some time takes 0 seconds (0.00s)
CompoundIndexer@29148[I]:post_init may take some time...
CompoundIndexer@29143[I]:post_init may take some time takes 0 seconds (0.00s)
CompoundIndexer@29148[I]:post_init may take some time takes 0 seconds (0.00s)
   NumpyIndexer@29153[S]:restore NumpyIndexer from ./workspace/chunk_compound_indexer-3/vecidx-3/vecidx.bin
CompoundIndexer@29143[S]:successfully built CompoundIndexer from a yaml config
CompoundIndexer@29143[W]:Setting workspace of vecidx to ./workspace/chunk_compound_indexer-1
CompoundIndexer@29143[W]:Setting workspace of chunkidx to ./workspace/chunk_compound_indexer-1
CompoundIndexer@29148[S]:successfully built CompoundIndexer from a yaml config
CompoundIndexer@29148[W]:Setting workspace of vecidx to ./workspace/chunk_compound_indexer-2
CompoundIndexer@29148[W]:Setting workspace of chunkidx to ./workspace/chunk_compound_indexer-2
   NumpyIndexer@29158[I]:post_init may take some time...
   NumpyIndexer@29158[I]:post_init may take some time takes 0 seconds (0.00s)
   NumpyIndexer@29158[S]:restore NumpyIndexer from ./workspace/chunk_compound_indexer-4/vecidx-4/vecidx.bin
BinaryPbIndexer@29153[I]:post_init may take some time...
BinaryPbIndexer@29153[I]:post_init may take some time takes 0 seconds (0.00s)
BinaryPbIndexer@29153[S]:restore BinaryPbIndexer from ./workspace/chunk_compound_indexer-3/chunkidx-3/chunkidx.bin
         ranker@29167[C]:can not load the executor from pods/ranker.yml
BinaryPbIndexer@29158[I]:post_init may take some time...
BinaryPbIndexer@29158[I]:post_init may take some time takes 0 seconds (0.00s)
CompoundIndexer@29153[I]:post_init may take some time...
CompoundIndexer@29153[I]:post_init may take some time takes 0 seconds (0.00s)
BinaryPbIndexer@29158[S]:restore BinaryPbIndexer from ./workspace/chunk_compound_indexer-4/chunkidx-4/chunkidx.bin
CompoundIndexer@29153[S]:successfully built CompoundIndexer from a yaml config
CompoundIndexer@29153[W]:Setting workspace of vecidx to ./workspace/chunk_compound_indexer-3
CompoundIndexer@29153[W]:Setting workspace of chunkidx to ./workspace/chunk_compound_indexer-3
CompoundIndexer@29158[I]:post_init may take some time...
CompoundIndexer@29158[I]:post_init may take some time takes 0 seconds (0.00s)
CompoundIndexer@29158[S]:successfully built CompoundIndexer from a yaml config
CompoundIndexer@29158[W]:Setting workspace of vecidx to ./workspace/chunk_compound_indexer-4
CompoundIndexer@29158[W]:Setting workspace of chunkidx to ./workspace/chunk_compound_indexer-4
         ranker@29167[E]:ExecutorFailToLoad() during <bound method ZEDRuntime.setup of <jina.peapods.runtimes.zmq.zed.ZEDRuntime object at 0x7fb54c707cd0>>
 add "--hide-exc-info" to suppress the exception details
Traceback (most recent call last):
  File "/mnt/d/py37-multires-lyrics-search/lib/python3.7/site-packages/jina/peapods/runtimes/zmq/zed.py", line 62, in _load_executor
    read_only=self.args.read_only)
  File "/mnt/d/py37-multires-lyrics-search/lib/python3.7/site-packages/jina/jaml/__init__.py", line 414, in load_config
    return JAML.load(revert_tag_yml, substitute=False)
  File "/mnt/d/py37-multires-lyrics-search/lib/python3.7/site-packages/jina/jaml/__init__.py", line 89, in load
    r = yaml.load(stream, Loader=JinaLoader)
  File "/mnt/d/py37-multires-lyrics-search/lib/python3.7/site-packages/yaml/__init__.py", line 114, in load
    return loader.get_single_data()
  File "/mnt/d/py37-multires-lyrics-search/lib/python3.7/site-packages/yaml/constructor.py", line 51, in get_single_data
    return self.construct_document(node)
  File "/mnt/d/py37-multires-lyrics-search/lib/python3.7/site-packages/yaml/constructor.py", line 55, in construct_document
    data = self.construct_object(node)
  File "/mnt/d/py37-multires-lyrics-search/lib/python3.7/site-packages/yaml/constructor.py", line 100, in construct_object
    data = constructor(self, node)
  File "/mnt/d/py37-multires-lyrics-search/lib/python3.7/site-packages/jina/jaml/__init__.py", line 328, in _from_yaml
    return get_parser(cls, version=data.get('version', None)).parse(cls, data)
  File "/mnt/d/py37-multires-lyrics-search/lib/python3.7/site-packages/jina/jaml/parsers/executor/legacy.py", line 115, in parse
    obj = cls(**data.get('with', {}), metas=data.get('metas', {}), requests=data.get('requests', {}))
  File "/mnt/d/py37-multires-lyrics-search/lib/python3.7/site-packages/jina/executors/__init__.py", line 47, in __call__
    obj = type.__call__(cls, *args, **kwargs)
  File "/mnt/d/py37-multires-lyrics-search/lib/python3.7/site-packages/jina/executors/decorators.py", line 144, in arg_wrapper
    f = func(self, *args, **kwargs)
TypeError: __init__() missing 1 required positional argument: 'is_reversed_score'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/mnt/d/py37-multires-lyrics-search/lib/python3.7/site-packages/jina/peapods/peas/__init__.py", line 66, in run
    self.runtime.setup()
  File "/mnt/d/py37-multires-lyrics-search/lib/python3.7/site-packages/jina/peapods/runtimes/zmq/zed.py", line 41, in setup
    self._load_executor()
  File "/mnt/d/py37-multires-lyrics-search/lib/python3.7/site-packages/jina/peapods/runtimes/zmq/zed.py", line 73, in _load_executor
    raise ExecutorFailToLoad from ex
jina.excepts.ExecutorFailToLoad
BinaryPbIndexer@29172[I]:post_init may take some time...
BinaryPbIndexer@29172[I]:post_init may take some time takes 0 seconds (0.00s)
BinaryPbIndexer@29172[S]:restore BinaryPbIndexer from ./workspace/doc_indexer.bin
           JINA@29177[I]:input tcp://0.0.0.0:33023 (PULL_CONNECT) output tcp://0.0.0.0:44523 (PUSH_CONNECT) control over ipc:///tmp/tmp8tedvtok (PAIR_BIND)
           JINA@29177[I]:
    Jina REST interface
    💬 Swagger UI:      http://localhost:65481/docs
    📚 Redoc     :      http://localhost:65481/redoc

           JINA@29177[S]:ready and listening
        gateway@29177[S]:RESTRuntime is listening at: 0.0.0.0:65481
TransformerTorchEncoder@29125[I]:post_init may take some time takes 11 seconds (11.50s)
TransformerTorchEncoder@29125[S]:successfully built TransformerTorchEncoder from a yaml config
      tf_encode@29105[S]:ready and listening
 chunk_idx/head@29105[S]:ready and listening
 chunk_idx/tail@29105[S]:ready and listening
    chunk_idx/1@29105[S]:ready and listening
    chunk_idx/2@29105[S]:ready and listening
    chunk_idx/3@29105[S]:ready and listening
    chunk_idx/4@29105[S]:ready and listening
         ranker@29105[S]:terminated
           Flow@29105[E]:ranker:<jina.peapods.pods.BasePod object at 0x7fb54ee90590> can not be started due to RuntimeFailToStart(), Flow is aborted
           JINA@29177[I]:#sent: 0 #recv: 0 sent_size: 0 Bytes recv_size: 0 Bytes
        gateway@29105[S]:terminated
        doc_idx@29172[I]:recv ControlRequest  from ctl▸doc_idx/ZEDRuntime▸⚐
        doc_idx@29172[I]:#sent: 1 #recv: 1 sent_size: 247 Bytes recv_size: 138 Bytes
        doc_idx@29172[I]:indexer size: 99 physical size: 19.8 MB
        doc_idx@29172[I]:no update since 2021-03-02 18:49:40, will not save. If you really want to save it, call "touch()" before "save()" to force saving
        doc_idx@29105[S]:terminated
    chunk_idx/4@29158[I]:recv ControlRequest  from ctl▸chunk_idx/4/ZEDRuntime▸⚐
    chunk_idx/4@29158[I]:#sent: 1 #recv: 1 sent_size: 249 Bytes recv_size: 137 Bytes
   NumpyIndexer@29158[I]:indexer size: 733 physical size: 2.3 MB
   NumpyIndexer@29158[I]:no update since 2021-03-02 18:49:41, will not save. If you really want to save it, call "touch()" before "save()" to force saving
BinaryPbIndexer@29158[I]:indexer size: 733 physical size: 2.4 MB
BinaryPbIndexer@29158[I]:no update since 2021-03-02 18:49:41, will not save. If you really want to save it, call "touch()" before "save()" to force saving
   NumpyIndexer@29158[I]:no update since 2021-03-02 18:49:41, will not save. If you really want to save it, call "touch()" before "save()" to force saving
BinaryPbIndexer@29158[I]:no update since 2021-03-02 18:49:41, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/4@29158[I]:no update since 2021-03-02 18:50:16, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/4@29105[S]:terminated
    chunk_idx/3@29153[I]:recv ControlRequest  from ctl▸chunk_idx/3/ZEDRuntime▸⚐
    chunk_idx/3@29153[I]:#sent: 1 #recv: 1 sent_size: 251 Bytes recv_size: 138 Bytes
   NumpyIndexer@29153[I]:indexer size: 1042 physical size: 3.2 MB
   NumpyIndexer@29153[I]:no update since 2021-03-02 18:49:40, will not save. If you really want to save it, call "touch()" before "save()" to force saving
BinaryPbIndexer@29153[I]:indexer size: 1042 physical size: 3.4 MB
BinaryPbIndexer@29153[I]:no update since 2021-03-02 18:49:41, will not save. If you really want to save it, call "touch()" before "save()" to force saving
   NumpyIndexer@29153[I]:no update since 2021-03-02 18:49:40, will not save. If you really want to save it, call "touch()" before "save()" to force saving
BinaryPbIndexer@29153[I]:no update since 2021-03-02 18:49:41, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/3@29153[I]:no update since 2021-03-02 18:50:16, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/3@29105[S]:terminated
    chunk_idx/2@29148[I]:recv ControlRequest  from ctl▸chunk_idx/2/ZEDRuntime▸⚐
    chunk_idx/2@29148[I]:#sent: 1 #recv: 1 sent_size: 251 Bytes recv_size: 138 Bytes
   NumpyIndexer@29148[I]:indexer size: 657 physical size: 2.0 MB
   NumpyIndexer@29148[I]:no update since 2021-03-02 18:49:40, will not save. If you really want to save it, call "touch()" before "save()" to force saving
BinaryPbIndexer@29148[I]:indexer size: 657 physical size: 2.1 MB
BinaryPbIndexer@29148[I]:no update since 2021-03-02 18:49:41, will not save. If you really want to save it, call "touch()" before "save()" to force saving
   NumpyIndexer@29148[I]:no update since 2021-03-02 18:49:40, will not save. If you really want to save it, call "touch()" before "save()" to force saving
BinaryPbIndexer@29148[I]:no update since 2021-03-02 18:49:41, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/2@29148[I]:no update since 2021-03-02 18:50:16, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/2@29105[S]:terminated
    chunk_idx/1@29143[I]:recv ControlRequest  from ctl▸chunk_idx/1/ZEDRuntime▸⚐
    chunk_idx/1@29143[I]:#sent: 1 #recv: 1 sent_size: 251 Bytes recv_size: 138 Bytes
   NumpyIndexer@29143[I]:indexer size: 671 physical size: 2.1 MB
   NumpyIndexer@29143[I]:no update since 2021-03-02 18:49:40, will not save. If you really want to save it, call "touch()" before "save()" to force saving
BinaryPbIndexer@29143[I]:indexer size: 671 physical size: 2.2 MB
BinaryPbIndexer@29143[I]:no update since 2021-03-02 18:49:41, will not save. If you really want to save it, call "touch()" before "save()" to force saving
   NumpyIndexer@29143[I]:no update since 2021-03-02 18:49:40, will not save. If you really want to save it, call "touch()" before "save()" to force saving
BinaryPbIndexer@29143[I]:no update since 2021-03-02 18:49:41, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/1@29143[I]:no update since 2021-03-02 18:50:16, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/1@29105[S]:terminated
 chunk_idx/tail@29138[I]:recv ControlRequest  from ctl▸chunk_idx/tail/ZEDRuntime▸⚐
 chunk_idx/tail@29138[I]:#sent: 1 #recv: 1 sent_size: 254 Bytes recv_size: 138 Bytes
 chunk_idx/tail@29138[I]:no update since 2021-03-02 18:50:15, will not save. If you really want to save it, call "touch()" before "save()" to force saving
 chunk_idx/tail@29105[S]:terminated
 chunk_idx/head@29133[I]:recv ControlRequest  from ctl▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/head@29133[I]:#sent: 1 #recv: 1 sent_size: 252 Bytes recv_size: 137 Bytes
 chunk_idx/head@29133[I]:no update since 2021-03-02 18:50:15, will not save. If you really want to save it, call "touch()" before "save()" to force saving
 chunk_idx/head@29105[S]:terminated
      tf_encode@29125[I]:recv ControlRequest  from ctl▸tf_encode/ZEDRuntime▸⚐
      tf_encode@29125[I]:#sent: 1 #recv: 1 sent_size: 247 Bytes recv_size: 137 Bytes
      tf_encode@29125[I]:no update since 2021-03-02 18:50:15, will not save. If you really want to save it, call "touch()" before "save()" to force saving
      tf_encode@29105[S]:terminated
      chunk_seg@29123[I]:recv ControlRequest  from ctl▸chunk_seg/ZEDRuntime▸⚐
      chunk_seg@29123[I]:#sent: 1 #recv: 1 sent_size: 249 Bytes recv_size: 138 Bytes
      chunk_seg@29123[I]:no update since 2021-03-02 18:50:15, will not save. If you really want to save it, call "touch()" before "save()" to force saving
      chunk_seg@29105[S]:terminated
           Flow@29105[S]:flow is closed and all resources are released, current build level is 0
Traceback (most recent call last):
  File "app.py", line 91, in <module>
    main()
  File "app.py", line 83, in main
    search()
  File "app.py", line 52, in search
    with f:
  File "/mnt/d/py37-multires-lyrics-search/lib/python3.7/site-packages/jina/flow/base.py", line 399, in __enter__
    return self.start()
  File "/mnt/d/py37-multires-lyrics-search/lib/python3.7/site-packages/jina/flow/base.py", line 438, in start
    v.wait_start_success()
  File "/mnt/d/py37-multires-lyrics-search/lib/python3.7/site-packages/jina/peapods/pods/__init__.py", line 221, in wait_start_success
    p.wait_start_success()
  File "/mnt/d/py37-multires-lyrics-search/lib/python3.7/site-packages/jina/peapods/peas/__init__.py", line 126, in wait_start_success
    raise RuntimeFailToStart
jina.excepts.RuntimeFailToStart

python app.py index seems working.

(py37-multires-lyrics-search) sz@pc:/mnt/d/jina-ai/multires-lyrics-search$ python app.py index
      segmenter@28189[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
   encoder/head@28191[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
      segmenter@28189[I]:input tcp://0.0.0.0:36613 (SUB_CONNECT) output tcp://0.0.0.0:54513 (PUSH_CONNECT) control over tcp://0.0.0.0:48455 (PAIR_BIND)
   encoder/head@28191[I]:input tcp://0.0.0.0:54513 (PULL_BIND) output tcp://0.0.0.0:34233 (ROUTER_BIND) control over tcp://0.0.0.0:55113 (PAIR_BIND)
   encoder/tail@28199[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
   encoder/tail@28199[I]:input tcp://0.0.0.0:52329 (PULL_BIND) output tcp://0.0.0.0:45355 (PUSH_CONNECT) control over tcp://0.0.0.0:53947 (PAIR_BIND)
      encoder/1@28204[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
      encoder/1@28204[I]:input tcp://0.0.0.0:34233 (DEALER_CONNECT) output tcp://0.0.0.0:52329 (PUSH_CONNECT) control over tcp://0.0.0.0:37895 (PAIR_BIND)
      encoder/2@28209[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
      encoder/2@28209[I]:input tcp://0.0.0.0:34233 (DEALER_CONNECT) output tcp://0.0.0.0:52329 (PUSH_CONNECT) control over tcp://0.0.0.0:60963 (PAIR_BIND)
 chunk_idx/head@28214[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
 chunk_idx/head@28214[I]:input tcp://0.0.0.0:45355 (PULL_BIND) output tcp://0.0.0.0:49501 (ROUTER_BIND) control over tcp://0.0.0.0:51695 (PAIR_BIND)
 chunk_idx/tail@28219[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
 chunk_idx/tail@28219[I]:input tcp://0.0.0.0:50649 (PULL_BIND) output tcp://0.0.0.0:40599 (PUSH_CONNECT) control over tcp://0.0.0.0:57273 (PAIR_BIND)
    chunk_idx/1@28224[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
    chunk_idx/1@28224[I]:input tcp://0.0.0.0:49501 (DEALER_CONNECT) output tcp://0.0.0.0:50649 (PUSH_CONNECT) control over tcp://0.0.0.0:38435 (PAIR_BIND)
   BaseExecutor@28199[I]:post_init may take some time...
   BaseExecutor@28199[I]:post_init may take some time takes 0 seconds (0.00s)
   BaseExecutor@28191[I]:post_init may take some time...
   BaseExecutor@28191[I]:post_init may take some time takes 0 seconds (0.00s)
    Sentencizer@28189[I]:post_init may take some time...
    Sentencizer@28189[I]:post_init may take some time takes 0 seconds (0.00s)
   BaseExecutor@28199[S]:successfully built BaseExecutor from a yaml config
   BaseExecutor@28191[S]:successfully built BaseExecutor from a yaml config
    Sentencizer@28189[S]:successfully built Sentencizer from a yaml config
    chunk_idx/2@28232[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
    chunk_idx/2@28232[I]:input tcp://0.0.0.0:49501 (DEALER_CONNECT) output tcp://0.0.0.0:50649 (PUSH_CONNECT) control over tcp://0.0.0.0:54961 (PAIR_BIND)
    chunk_idx/3@28237[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
    chunk_idx/3@28237[I]:input tcp://0.0.0.0:49501 (DEALER_CONNECT) output tcp://0.0.0.0:50649 (PUSH_CONNECT) control over tcp://0.0.0.0:52573 (PAIR_BIND)
    chunk_idx/4@28242[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
    chunk_idx/4@28242[I]:input tcp://0.0.0.0:49501 (DEALER_CONNECT) output tcp://0.0.0.0:50649 (PUSH_CONNECT) control over tcp://0.0.0.0:40393 (PAIR_BIND)
   BaseExecutor@28214[I]:post_init may take some time...
   BaseExecutor@28214[I]:post_init may take some time takes 0 seconds (0.00s)
   BaseExecutor@28219[I]:post_init may take some time...
   BaseExecutor@28214[S]:successfully built BaseExecutor from a yaml config
   BaseExecutor@28219[I]:post_init may take some time takes 0 seconds (0.00s)
TransformerTorchEncoder@28204[I]:post_init may take some time...
        doc_idx@28250[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
   BaseExecutor@28219[S]:successfully built BaseExecutor from a yaml config
        doc_idx@28250[I]:input tcp://0.0.0.0:36613 (SUB_CONNECT) output tcp://0.0.0.0:40599 (PUSH_CONNECT) control over tcp://0.0.0.0:34515 (PAIR_BIND)
       join_all@28255[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
       join_all@28255[I]:input tcp://0.0.0.0:40599 (PULL_BIND) output tcp://0.0.0.0:47535 (PUSH_BIND) control over tcp://0.0.0.0:39895 (PAIR_BIND)
      segmenter@28171[S]:ready and listening
        gateway@28260[I]:starting jina.peapods.runtimes.asyncio.grpc.GRPCRuntime...
   encoder/head@28171[S]:ready and listening
   encoder/tail@28171[S]:ready and listening
TransformerTorchEncoder@28209[I]:post_init may take some time...
   NumpyIndexer@28224[I]:post_init may take some time...
BinaryPbIndexer@28250[I]:post_init may take some time...
BinaryPbIndexer@28250[I]:post_init may take some time takes 0 seconds (0.00s)
   NumpyIndexer@28224[I]:post_init may take some time takes 0 seconds (0.00s)
   NumpyIndexer@28232[I]:post_init may take some time...
   NumpyIndexer@28232[I]:post_init may take some time takes 0 seconds (0.00s)
BinaryPbIndexer@28250[S]:successfully built BinaryPbIndexer from a yaml config
   NumpyIndexer@28232[S]:successfully built NumpyIndexer from a yaml config
   NumpyIndexer@28224[S]:successfully built NumpyIndexer from a yaml config
   BaseExecutor@28255[I]:post_init may take some time...
   BaseExecutor@28255[I]:post_init may take some time takes 0 seconds (0.00s)
   NumpyIndexer@28237[I]:post_init may take some time...
BinaryPbIndexer@28232[I]:post_init may take some time...
BinaryPbIndexer@28224[I]:post_init may take some time...
   NumpyIndexer@28237[I]:post_init may take some time takes 0 seconds (0.00s)
BinaryPbIndexer@28224[I]:post_init may take some time takes 0 seconds (0.00s)
   BaseExecutor@28255[S]:successfully built BaseExecutor from a yaml config
BinaryPbIndexer@28232[I]:post_init may take some time takes 0 seconds (0.00s)
BinaryPbIndexer@28224[S]:successfully built BinaryPbIndexer from a yaml config
BinaryPbIndexer@28232[S]:successfully built BinaryPbIndexer from a yaml config
   NumpyIndexer@28237[S]:successfully built NumpyIndexer from a yaml config
CompoundIndexer@28224[I]:post_init may take some time...
CompoundIndexer@28224[I]:post_init may take some time takes 0 seconds (0.00s)
CompoundIndexer@28224[S]:successfully built CompoundIndexer from a yaml config
CompoundIndexer@28224[W]:Setting workspace of vecidx to ./workspace/chunk_compound_indexer-1
CompoundIndexer@28232[I]:post_init may take some time...
CompoundIndexer@28224[W]:Setting workspace of chunkidx to ./workspace/chunk_compound_indexer-1
CompoundIndexer@28232[I]:post_init may take some time takes 0 seconds (0.00s)
CompoundIndexer@28232[S]:successfully built CompoundIndexer from a yaml config
CompoundIndexer@28232[W]:Setting workspace of vecidx to ./workspace/chunk_compound_indexer-2
CompoundIndexer@28232[W]:Setting workspace of chunkidx to ./workspace/chunk_compound_indexer-2
BinaryPbIndexer@28237[I]:post_init may take some time...
BinaryPbIndexer@28237[I]:post_init may take some time takes 0 seconds (0.00s)
BinaryPbIndexer@28237[S]:successfully built BinaryPbIndexer from a yaml config
CompoundIndexer@28237[I]:post_init may take some time...
CompoundIndexer@28237[I]:post_init may take some time takes 0 seconds (0.00s)
CompoundIndexer@28237[S]:successfully built CompoundIndexer from a yaml config
CompoundIndexer@28237[W]:Setting workspace of vecidx to ./workspace/chunk_compound_indexer-3
CompoundIndexer@28237[W]:Setting workspace of chunkidx to ./workspace/chunk_compound_indexer-3
   NumpyIndexer@28242[I]:post_init may take some time...
   NumpyIndexer@28242[I]:post_init may take some time takes 0 seconds (0.00s)
   NumpyIndexer@28242[S]:successfully built NumpyIndexer from a yaml config
BinaryPbIndexer@28242[I]:post_init may take some time...
BinaryPbIndexer@28242[I]:post_init may take some time takes 0 seconds (0.00s)
BinaryPbIndexer@28242[S]:successfully built BinaryPbIndexer from a yaml config
CompoundIndexer@28242[I]:post_init may take some time...
CompoundIndexer@28242[I]:post_init may take some time takes 0 seconds (0.00s)
CompoundIndexer@28242[S]:successfully built CompoundIndexer from a yaml config
CompoundIndexer@28242[W]:Setting workspace of vecidx to ./workspace/chunk_compound_indexer-4
CompoundIndexer@28242[W]:Setting workspace of chunkidx to ./workspace/chunk_compound_indexer-4
 chunk_idx/head@28214[I]:recv ControlRequest  from chunk_idx/1▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/head@28214[I]:recv ControlRequest  from chunk_idx/4▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/head@28214[I]:recv ControlRequest  from chunk_idx/2▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/head@28214[I]:recv ControlRequest  from chunk_idx/3▸chunk_idx/head/ZEDRuntime▸⚐
        gateway@28260[I]:input tcp://0.0.0.0:47535 (PULL_CONNECT) output tcp://0.0.0.0:36613 (PUB_BIND) control over ipc:///tmp/tmpykip6po1 (PAIR_BIND)
        gateway@28260[S]:GRPCRuntime is listening at: 0.0.0.0:42539
TransformerTorchEncoder@28204[I]:post_init may take some time takes 8 seconds (8.34s)
TransformerTorchEncoder@28209[I]:post_init may take some time takes 8 seconds (8.30s)
TransformerTorchEncoder@28204[S]:successfully built TransformerTorchEncoder from a yaml config
TransformerTorchEncoder@28209[S]:successfully built TransformerTorchEncoder from a yaml config
      encoder/1@28171[S]:ready and listening
      encoder/2@28171[S]:ready and listening
 chunk_idx/head@28171[S]:ready and listening
 chunk_idx/tail@28171[S]:ready and listening
    chunk_idx/1@28171[S]:ready and listening
    chunk_idx/2@28171[S]:ready and listening
    chunk_idx/3@28171[S]:ready and listening
    chunk_idx/4@28171[S]:ready and listening
        doc_idx@28171[S]:ready and listening
       join_all@28171[S]:ready and listening
        gateway@28171[S]:ready and listening
           Flow@28171[I]:6 Pods (i.e. 14 Peas) are running in this Flow
   encoder/head@28191[I]:recv ControlRequest  from encoder/2▸encoder/head/ZEDRuntime▸⚐
   encoder/head@28191[I]:recv ControlRequest  from encoder/1▸encoder/head/ZEDRuntime▸⚐
           Flow@28171[S]:🎉 Flow is ready to use, accepting gRPC request
           Flow@28171[I]:
        🖥️ Local access:        tcp://0.0.0.0:42539
        🔒 Private network:     tcp://172.23.57.32:42539
        🌐 Public address:      tcp://119.39.3.93:42539
         Client@28171[S]:connected to the gateway at 0.0.0.0:42539!
index |█                   | 📃      0 ⏱️ 0.0s 🐎 0.0/s      0      batchindex ...              gateway@28260[I]:prefetching 50 requests...
        gateway@28260[W]:if this takes too long, you may want to take smaller "--prefetch" or ask client to reduce "--request-size"
        gateway@28260[I]:prefetching 50 requests takes 0 seconds (0.13s)
        doc_idx@28250[I]:recv IndexRequest  from gateway▸doc_idx/ZEDRuntime▸⚐
      segmenter@28189[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸⚐
        doc_idx@28250[I]:#sent: 0 #recv: 1 sent_size: 0 Bytes recv_size: 5.2 KB
        doc_idx@28250[I]:recv IndexRequest  from gateway▸doc_idx/ZEDRuntime▸⚐
        doc_idx@28250[I]:#sent: 1 #recv: 2 sent_size: 5.4 KB recv_size: 12.1 KB
        doc_idx@28250[I]:recv IndexRequest  from gateway▸doc_idx/ZEDRuntime▸⚐
        doc_idx@28250[I]:#sent: 2 #recv: 3 sent_size: 12.4 KB recv_size: 18.9 KB
        doc_idx@28250[I]:recv IndexRequest  from gateway▸doc_idx/ZEDRuntime▸⚐
        doc_idx@28250[I]:#sent: 3 #recv: 4 sent_size: 19.4 KB recv_size: 25.2 KB
        doc_idx@28250[I]:recv IndexRequest  from gateway▸doc_idx/ZEDRuntime▸⚐
        doc_idx@28250[I]:#sent: 4 #recv: 5 sent_size: 25.8 KB recv_size: 30.6 KB
        doc_idx@28250[I]:recv IndexRequest  from gateway▸doc_idx/ZEDRuntime▸⚐
        doc_idx@28250[I]:#sent: 5 #recv: 6 sent_size: 31.3 KB recv_size: 36.0 KB
        doc_idx@28250[I]:recv IndexRequest  from gateway▸doc_idx/ZEDRuntime▸⚐
        doc_idx@28250[I]:#sent: 6 #recv: 7 sent_size: 36.9 KB recv_size: 42.2 KB
        doc_idx@28250[I]:recv IndexRequest  from gateway▸doc_idx/ZEDRuntime▸⚐
        doc_idx@28250[I]:#sent: 7 #recv: 8 sent_size: 43.2 KB recv_size: 48.2 KB
        doc_idx@28250[I]:recv IndexRequest  from gateway▸doc_idx/ZEDRuntime▸⚐
        doc_idx@28250[I]:#sent: 8 #recv: 9 sent_size: 49.5 KB recv_size: 54.5 KB
        doc_idx@28250[I]:recv IndexRequest  from gateway▸doc_idx/ZEDRuntime▸⚐
        doc_idx@28250[I]:#sent: 9 #recv: 10 sent_size: 55.9 KB recv_size: 61.5 KB
        doc_idx@28250[I]:recv IndexRequest  from gateway▸doc_idx/ZEDRuntime▸⚐
        doc_idx@28250[I]:#sent: 10 #recv: 11 sent_size: 63.0 KB recv_size: 67.2 KB
        doc_idx@28250[I]:recv IndexRequest  from gateway▸doc_idx/ZEDRuntime▸⚐
        doc_idx@28250[I]:#sent: 11 #recv: 12 sent_size: 68.8 KB recv_size: 73.2 KB
      segmenter@28189[I]:#sent: 0 #recv: 1 sent_size: 0 Bytes recv_size: 5.2 KB
        doc_idx@28250[I]:recv IndexRequest  from gateway▸doc_idx/ZEDRuntime▸⚐
        doc_idx@28250[I]:#sent: 12 #recv: 13 sent_size: 75.0 KB recv_size: 75.8 KB
      segmenter@28189[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸⚐
   encoder/head@28191[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸⚐
   encoder/head@28191[I]:#sent: 0 #recv: 3 sent_size: 0 Bytes recv_size: 16.9 KB
      encoder/1@28204[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸⚐
       join_all@28255[I]:recv IndexRequest (1/2 parts) from gateway▸doc_idx/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:recv IndexRequest (1/2 parts) from gateway▸doc_idx/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:recv IndexRequest (1/2 parts) from gateway▸doc_idx/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:recv IndexRequest (1/2 parts) from gateway▸doc_idx/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:recv IndexRequest (1/2 parts) from gateway▸doc_idx/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:recv IndexRequest (1/2 parts) from gateway▸doc_idx/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:recv IndexRequest (1/2 parts) from gateway▸doc_idx/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:recv IndexRequest (1/2 parts) from gateway▸doc_idx/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:recv IndexRequest (1/2 parts) from gateway▸doc_idx/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:recv IndexRequest (1/2 parts) from gateway▸doc_idx/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:recv IndexRequest (1/2 parts) from gateway▸doc_idx/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:recv IndexRequest (1/2 parts) from gateway▸doc_idx/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:recv IndexRequest (1/2 parts) from gateway▸doc_idx/ZEDRuntime▸join_all/ZEDRuntime▸⚐
      segmenter@28189[I]:#sent: 1 #recv: 2 sent_size: 16.5 KB recv_size: 12.1 KB
   encoder/head@28191[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸⚐
      segmenter@28189[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸⚐
   encoder/head@28191[I]:#sent: 1 #recv: 4 sent_size: 16.6 KB recv_size: 38.0 KB
      encoder/2@28209[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸⚐
      segmenter@28189[I]:#sent: 2 #recv: 3 sent_size: 37.8 KB recv_size: 18.9 KB
      segmenter@28189[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸⚐
      segmenter@28189[I]:#sent: 3 #recv: 4 sent_size: 55.7 KB recv_size: 25.2 KB
      segmenter@28189[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸⚐
      segmenter@28189[I]:#sent: 4 #recv: 5 sent_size: 74.0 KB recv_size: 30.6 KB
      segmenter@28189[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸⚐
      segmenter@28189[I]:#sent: 5 #recv: 6 sent_size: 90.1 KB recv_size: 36.0 KB
      segmenter@28189[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸⚐
      segmenter@28189[I]:#sent: 6 #recv: 7 sent_size: 103.7 KB recv_size: 42.2 KB
      segmenter@28189[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸⚐
      segmenter@28189[I]:#sent: 7 #recv: 8 sent_size: 124.2 KB recv_size: 48.2 KB
      segmenter@28189[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸⚐
      segmenter@28189[I]:#sent: 8 #recv: 9 sent_size: 140.3 KB recv_size: 54.5 KB
      segmenter@28189[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸⚐
      segmenter@28189[I]:#sent: 9 #recv: 10 sent_size: 156.7 KB recv_size: 61.5 KB
      segmenter@28189[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸⚐
      segmenter@28189[I]:#sent: 10 #recv: 11 sent_size: 174.0 KB recv_size: 67.2 KB
      segmenter@28189[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸⚐
      segmenter@28189[I]:#sent: 11 #recv: 12 sent_size: 190.6 KB recv_size: 73.2 KB
      segmenter@28189[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸⚐
      segmenter@28189[I]:#sent: 12 #recv: 13 sent_size: 208.1 KB recv_size: 75.8 KB
      encoder/2@28209[I]:#sent: 1 #recv: 1 sent_size: 291 Bytes recv_size: 21.2 KB
      encoder/1@28204[I]:#sent: 1 #recv: 1 sent_size: 291 Bytes recv_size: 16.6 KB
   encoder/head@28191[I]:recv ControlRequest  from encoder/2▸encoder/head/ZEDRuntime▸⚐
   encoder/head@28191[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸⚐
   encoder/head@28191[I]:#sent: 2 #recv: 6 sent_size: 37.9 KB recv_size: 56.2 KB
   encoder/head@28191[I]:recv ControlRequest  from encoder/1▸encoder/head/ZEDRuntime▸⚐
   encoder/head@28191[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸⚐
   encoder/head@28191[I]:#sent: 3 #recv: 8 sent_size: 56.0 KB recv_size: 74.6 KB
      encoder/2@28209[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸⚐
      encoder/1@28204[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸⚐
   encoder/tail@28199[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸⚐
   encoder/tail@28199[I]:#sent: 0 #recv: 1 sent_size: 0 Bytes recv_size: 927.0 KB
   encoder/tail@28199[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸⚐
   encoder/tail@28199[I]:#sent: 1 #recv: 2 sent_size: 927.1 KB recv_size: 1.5 MB
 chunk_idx/head@28214[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/head@28214[I]:#sent: 0 #recv: 5 sent_size: 0 Bytes recv_size: 927.9 KB
 chunk_idx/head@28214[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/head@28214[I]:#sent: 1 #recv: 6 sent_size: 927.2 KB recv_size: 1.5 MB
    chunk_idx/3@28237[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/3/ZEDRuntime▸⚐
    chunk_idx/2@28232[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/2/ZEDRuntime▸⚐
    chunk_idx/2@28232[I]:#sent: 1 #recv: 1 sent_size: 293 Bytes recv_size: 646.5 KB
    chunk_idx/3@28237[I]:#sent: 1 #recv: 1 sent_size: 293 Bytes recv_size: 927.1 KB
 chunk_idx/head@28214[I]:recv ControlRequest  from chunk_idx/2▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/head@28214[I]:recv ControlRequest  from chunk_idx/3▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/2/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:#sent: 0 #recv: 1 sent_size: 0 Bytes recv_size: 646.5 KB
 chunk_idx/tail@28219[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/3/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:#sent: 1 #recv: 2 sent_size: 646.7 KB recv_size: 1.5 MB
       join_all@28255[I]:recv IndexRequest (2/2 parts) from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/2/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:#sent: 0 #recv: 14 sent_size: 0 Bytes recv_size: 723.6 KB
       join_all@28255[I]:recv IndexRequest (2/2 parts) from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/3/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:#sent: 1 #recv: 15 sent_size: 646.9 KB recv_size: 1.6 MB
index |██                  | 📃     16 ⏱️ 2.3s 🐎 6.9/s      2      batch      encoder/1@28204[I]:#sent: 3 #recv: 2 sent_size: 646.9 KB recv_size: 34.8 KB
   encoder/head@28191[I]:recv ControlRequest  from encoder/1▸encoder/head/ZEDRuntime▸⚐
   encoder/tail@28199[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸⚐
   encoder/head@28191[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸⚐
   encoder/head@28191[I]:#sent: 4 #recv: 10 sent_size: 74.3 KB recv_size: 90.9 KB
   encoder/tail@28199[I]:#sent: 2 #recv: 3 sent_size: 1.5 MB recv_size: 2.4 MB
      encoder/1@28204[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸⚐
 chunk_idx/head@28214[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/head@28214[I]:#sent: 2 #recv: 9 sent_size: 1.5 MB recv_size: 2.4 MB
    chunk_idx/4@28242[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/4/ZEDRuntime▸⚐
    chunk_idx/4@28242[I]:#sent: 1 #recv: 1 sent_size: 293 Bytes recv_size: 851.2 KB
 chunk_idx/head@28214[I]:recv ControlRequest  from chunk_idx/4▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/4/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:#sent: 2 #recv: 3 sent_size: 1.5 MB recv_size: 2.4 MB
       join_all@28255[I]:recv IndexRequest (2/2 parts) from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/4/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:#sent: 2 #recv: 16 sent_size: 1.5 MB recv_size: 2.4 MB
index |███                 | 📃     24 ⏱️ 3.6s 🐎 6.6/s      3      batch      encoder/2@28209[I]:#sent: 3 #recv: 2 sent_size: 927.6 KB recv_size: 39.2 KB
   encoder/head@28191[I]:recv ControlRequest  from encoder/2▸encoder/head/ZEDRuntime▸⚐
   encoder/tail@28199[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸⚐
   encoder/tail@28199[I]:#sent: 3 #recv: 4 sent_size: 2.4 MB recv_size: 3.0 MB
   encoder/head@28191[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸⚐
   encoder/head@28191[I]:#sent: 5 #recv: 12 sent_size: 90.6 KB recv_size: 104.6 KB
 chunk_idx/head@28214[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/head@28214[I]:#sent: 3 #recv: 11 sent_size: 2.4 MB recv_size: 3.0 MB
      encoder/2@28209[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸⚐
    chunk_idx/1@28224[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/1/ZEDRuntime▸⚐
    chunk_idx/1@28224[I]:#sent: 1 #recv: 1 sent_size: 293 Bytes recv_size: 678.4 KB
 chunk_idx/head@28214[I]:recv ControlRequest  from chunk_idx/1▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/1/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:#sent: 3 #recv: 4 sent_size: 2.4 MB recv_size: 3.0 MB
       join_all@28255[I]:recv IndexRequest (2/2 parts) from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/1/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:#sent: 3 #recv: 17 sent_size: 2.4 MB recv_size: 3.1 MB
index |████                | 📃     32 ⏱️ 4.0s 🐎 7.9/s      4      batch      encoder/1@28204[I]:#sent: 5 #recv: 3 sent_size: 1.5 MB recv_size: 51.0 KB
   encoder/head@28191[I]:recv ControlRequest  from encoder/1▸encoder/head/ZEDRuntime▸⚐
   encoder/tail@28199[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸⚐
   encoder/head@28191[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸⚐
   encoder/tail@28199[I]:#sent: 4 #recv: 5 sent_size: 3.0 MB recv_size: 3.6 MB
   encoder/head@28191[I]:#sent: 6 #recv: 14 sent_size: 104.2 KB recv_size: 125.2 KB
 chunk_idx/head@28214[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/head@28214[I]:#sent: 4 #recv: 13 sent_size: 3.0 MB recv_size: 3.6 MB
      encoder/1@28204[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸⚐
    chunk_idx/3@28237[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/3/ZEDRuntime▸⚐
      encoder/2@28209[I]:#sent: 5 #recv: 3 sent_size: 1.6 MB recv_size: 52.8 KB
   encoder/head@28191[I]:recv ControlRequest  from encoder/2▸encoder/head/ZEDRuntime▸⚐
   encoder/tail@28199[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸⚐
   encoder/tail@28199[I]:#sent: 5 #recv: 6 sent_size: 3.6 MB recv_size: 4.1 MB
   encoder/head@28191[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸⚐
   encoder/head@28191[I]:#sent: 7 #recv: 16 sent_size: 124.8 KB recv_size: 141.5 KB
 chunk_idx/head@28214[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/head@28214[I]:#sent: 5 #recv: 14 sent_size: 3.6 MB recv_size: 4.1 MB
      encoder/2@28209[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸⚐
    chunk_idx/2@28232[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/2/ZEDRuntime▸⚐
    chunk_idx/3@28237[I]:#sent: 3 #recv: 2 sent_size: 927.9 KB recv_size: 1.5 MB
 chunk_idx/head@28214[I]:recv ControlRequest  from chunk_idx/3▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/3/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:#sent: 4 #recv: 5 sent_size: 3.0 MB recv_size: 3.6 MB
       join_all@28255[I]:recv IndexRequest (2/2 parts) from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/3/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:#sent: 4 #recv: 18 sent_size: 3.0 MB recv_size: 3.7 MB
index |█████               | 📃     40 ⏱️ 5.0s 🐎 8.0/s      5      batch    chunk_idx/2@28232[I]:#sent: 3 #recv: 2 sent_size: 647.2 KB recv_size: 1.1 MB
 chunk_idx/head@28214[I]:recv ControlRequest  from chunk_idx/2▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/2/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:#sent: 5 #recv: 6 sent_size: 3.6 MB recv_size: 4.1 MB
       join_all@28255[I]:recv IndexRequest (2/2 parts) from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/2/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:#sent: 5 #recv: 19 sent_size: 3.6 MB recv_size: 4.2 MB
index |██████              | 📃     48 ⏱️ 5.0s 🐎 9.5/s      6      batch      encoder/2@28209[I]:#sent: 7 #recv: 4 sent_size: 2.1 MB recv_size: 68.9 KB
   encoder/head@28191[I]:recv ControlRequest  from encoder/2▸encoder/head/ZEDRuntime▸⚐
   encoder/tail@28199[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸⚐
   encoder/head@28191[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸⚐
   encoder/tail@28199[I]:#sent: 6 #recv: 7 sent_size: 4.1 MB recv_size: 4.8 MB
   encoder/head@28191[I]:#sent: 8 #recv: 18 sent_size: 141.0 KB recv_size: 158.0 KB
 chunk_idx/head@28214[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸⚐
      encoder/2@28209[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸⚐
 chunk_idx/head@28214[I]:#sent: 6 #recv: 17 sent_size: 4.1 MB recv_size: 4.8 MB
    chunk_idx/4@28242[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/4/ZEDRuntime▸⚐
    chunk_idx/4@28242[I]:#sent: 3 #recv: 2 sent_size: 852.0 KB recv_size: 1.5 MB
 chunk_idx/head@28214[I]:recv ControlRequest  from chunk_idx/4▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/4/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:#sent: 6 #recv: 7 sent_size: 4.1 MB recv_size: 4.8 MB
       join_all@28255[I]:recv IndexRequest (2/2 parts) from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/4/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:#sent: 6 #recv: 20 sent_size: 4.1 MB recv_size: 4.9 MB
index |███████             | 📃     56 ⏱️ 6.3s 🐎 8.9/s      7      batch      encoder/1@28204[I]:#sent: 7 #recv: 4 sent_size: 2.0 MB recv_size: 71.5 KB
   encoder/head@28191[I]:recv ControlRequest  from encoder/1▸encoder/head/ZEDRuntime▸⚐
   encoder/tail@28199[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸⚐
   encoder/head@28191[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸⚐
   encoder/tail@28199[I]:#sent: 7 #recv: 8 sent_size: 4.8 MB recv_size: 5.6 MB
   encoder/head@28191[I]:#sent: 9 #recv: 20 sent_size: 157.5 KB recv_size: 175.5 KB
 chunk_idx/head@28214[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸⚐
      encoder/1@28204[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸⚐
 chunk_idx/head@28214[I]:#sent: 7 #recv: 19 sent_size: 4.8 MB recv_size: 5.6 MB
    chunk_idx/1@28224[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/1/ZEDRuntime▸⚐
    chunk_idx/1@28224[I]:#sent: 3 #recv: 2 sent_size: 679.1 KB recv_size: 1.5 MB
 chunk_idx/head@28214[I]:recv ControlRequest  from chunk_idx/1▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/1/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:#sent: 7 #recv: 8 sent_size: 4.8 MB recv_size: 5.6 MB
       join_all@28255[I]:recv IndexRequest (2/2 parts) from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/1/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:#sent: 7 #recv: 21 sent_size: 4.8 MB recv_size: 5.7 MB
index |████████            | 📃     64 ⏱️ 6.6s 🐎 9.8/s      8      batch      encoder/2@28209[I]:#sent: 9 #recv: 5 sent_size: 2.8 MB recv_size: 85.4 KB
   encoder/head@28191[I]:recv ControlRequest  from encoder/2▸encoder/head/ZEDRuntime▸⚐
   encoder/tail@28199[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸⚐
   encoder/tail@28199[I]:#sent: 8 #recv: 9 sent_size: 5.6 MB recv_size: 6.3 MB
   encoder/head@28191[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸⚐
   encoder/head@28191[I]:#sent: 10 #recv: 22 sent_size: 174.9 KB recv_size: 192.3 KB
 chunk_idx/head@28214[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/head@28214[I]:#sent: 8 #recv: 21 sent_size: 5.6 MB recv_size: 6.3 MB
      encoder/2@28209[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸⚐
    chunk_idx/3@28237[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/3/ZEDRuntime▸⚐
    chunk_idx/3@28237[I]:#sent: 5 #recv: 3 sent_size: 1.5 MB recv_size: 2.1 MB
 chunk_idx/head@28214[I]:recv ControlRequest  from chunk_idx/3▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/3/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:#sent: 8 #recv: 9 sent_size: 5.6 MB recv_size: 6.3 MB
       join_all@28255[I]:recv IndexRequest (2/2 parts) from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/3/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:#sent: 8 #recv: 22 sent_size: 5.6 MB recv_size: 6.3 MB
index |█████████           | 📃     72 ⏱️ 7.8s 🐎 9.2/s      9      batch      encoder/1@28204[I]:#sent: 9 #recv: 5 sent_size: 2.9 MB recv_size: 88.8 KB
   encoder/head@28191[I]:recv ControlRequest  from encoder/1▸encoder/head/ZEDRuntime▸⚐
   encoder/tail@28199[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸⚐
   encoder/head@28191[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸⚐
   encoder/tail@28199[I]:#sent: 9 #recv: 10 sent_size: 6.3 MB recv_size: 6.9 MB
   encoder/head@28191[I]:#sent: 11 #recv: 24 sent_size: 191.6 KB recv_size: 209.9 KB
      encoder/1@28204[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸⚐
 chunk_idx/head@28214[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/head@28214[I]:#sent: 9 #recv: 23 sent_size: 6.3 MB recv_size: 6.9 MB
    chunk_idx/2@28232[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/2/ZEDRuntime▸⚐
    chunk_idx/2@28232[I]:#sent: 5 #recv: 3 sent_size: 1.1 MB recv_size: 1.7 MB
 chunk_idx/head@28214[I]:recv ControlRequest  from chunk_idx/2▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/2/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:#sent: 9 #recv: 10 sent_size: 6.3 MB recv_size: 6.9 MB
       join_all@28255[I]:recv IndexRequest (2/2 parts) from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/2/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:#sent: 9 #recv: 23 sent_size: 6.3 MB recv_size: 7.0 MB
index |██████████          | 📃     80 ⏱️ 8.9s 🐎 9.0/s     10      batch      encoder/2@28209[I]:#sent: 11 #recv: 6 sent_size: 3.4 MB recv_size: 102.0 KB
   encoder/head@28191[I]:recv ControlRequest  from encoder/2▸encoder/head/ZEDRuntime▸⚐
   encoder/tail@28199[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸⚐
   encoder/head@28191[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸⚐
   encoder/head@28191[I]:#sent: 12 #recv: 26 sent_size: 209.2 KB recv_size: 217.5 KB
   encoder/tail@28199[I]:#sent: 10 #recv: 11 sent_size: 6.9 MB recv_size: 7.5 MB
      encoder/2@28209[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸⚐
 chunk_idx/head@28214[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/head@28214[I]:#sent: 10 #recv: 25 sent_size: 6.9 MB recv_size: 7.5 MB
    chunk_idx/4@28242[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/4/ZEDRuntime▸⚐
    chunk_idx/4@28242[I]:#sent: 5 #recv: 3 sent_size: 1.5 MB recv_size: 2.2 MB
 chunk_idx/head@28214[I]:recv ControlRequest  from chunk_idx/4▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/4/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:#sent: 10 #recv: 11 sent_size: 6.9 MB recv_size: 7.5 MB
       join_all@28255[I]:recv IndexRequest (2/2 parts) from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/4/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:#sent: 10 #recv: 24 sent_size: 6.9 MB recv_size: 7.6 MB
index |███████████         | 📃     88 ⏱️ 9.4s 🐎 9.3/s     11      batch      encoder/2@28209[I]:#sent: 13 #recv: 7 sent_size: 4.0 MB recv_size: 109.5 KB
   encoder/head@28191[I]:recv ControlRequest  from encoder/2▸encoder/head/ZEDRuntime▸⚐
   encoder/tail@28199[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸⚐
   encoder/tail@28199[I]:#sent: 11 #recv: 12 sent_size: 7.5 MB recv_size: 7.8 MB
 chunk_idx/head@28214[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/head@28214[I]:#sent: 11 #recv: 27 sent_size: 7.5 MB recv_size: 7.8 MB
    chunk_idx/1@28224[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/1/ZEDRuntime▸⚐
    chunk_idx/1@28224[I]:#sent: 5 #recv: 3 sent_size: 1.5 MB recv_size: 1.8 MB
 chunk_idx/head@28214[I]:recv ControlRequest  from chunk_idx/1▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/1/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:#sent: 11 #recv: 12 sent_size: 7.5 MB recv_size: 7.8 MB
       join_all@28255[I]:recv IndexRequest (2/2 parts) from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/2/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/1/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:#sent: 11 #recv: 25 sent_size: 7.5 MB recv_size: 7.8 MB
index |████████████        | 📃     96 ⏱️ 9.9s 🐎 9.7/s     12      batch      encoder/1@28204[I]:#sent: 11 #recv: 6 sent_size: 3.5 MB recv_size: 106.3 KB
   encoder/head@28191[I]:recv ControlRequest  from encoder/1▸encoder/head/ZEDRuntime▸⚐
   encoder/tail@28199[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸⚐
   encoder/tail@28199[I]:#sent: 12 #recv: 13 sent_size: 7.8 MB recv_size: 8.5 MB
 chunk_idx/head@28214[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/head@28214[I]:#sent: 12 #recv: 29 sent_size: 7.8 MB recv_size: 8.5 MB
    chunk_idx/3@28237[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/3/ZEDRuntime▸⚐
    chunk_idx/3@28237[I]:#sent: 7 #recv: 4 sent_size: 2.1 MB recv_size: 2.8 MB
 chunk_idx/head@28214[I]:recv ControlRequest  from chunk_idx/3▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:recv IndexRequest  from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/3/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:#sent: 12 #recv: 13 sent_size: 7.8 MB recv_size: 8.5 MB
       join_all@28255[I]:recv IndexRequest (2/2 parts) from gateway▸segmenter/ZEDRuntime▸encoder/head/ZEDRuntime▸encoder/1/ZEDRuntime▸encoder/tail/ZEDRuntime▸chunk_idx/head/ZEDRuntime▸chunk_idx/3/ZEDRuntime▸chunk_idx/tail/ZEDRuntime▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:#sent: 12 #recv: 26 sent_size: 7.8 MB recv_size: 8.6 MB
index |█████████████       | 📃    104 ⏱️ 10.1s 🐎 10.3/s     13      batch    10 seconds (10.11s)
        ✅ done in ⏱ 10 seconds 🐎 10.3/s
        gateway@28260[I]:#sent: 13 #recv: 13 sent_size: 76.7 KB recv_size: 8.5 MB
        gateway@28171[S]:terminated
       join_all@28255[I]:recv ControlRequest  from ctl▸join_all/ZEDRuntime▸⚐
       join_all@28255[I]:#sent: 14 #recv: 27 sent_size: 8.5 MB recv_size: 8.6 MB
       join_all@28255[I]:no update since 2021-03-02 18:49:40, will not save. If you really want to save it, call "touch()" before "save()" to force saving
       join_all@28171[S]:terminated
        doc_idx@28250[I]:recv ControlRequest  from ctl▸doc_idx/ZEDRuntime▸⚐
        doc_idx@28250[I]:#sent: 14 #recv: 14 sent_size: 78.1 KB recv_size: 76.0 KB
        doc_idx@28250[I]:indexer size: 99 physical size: 19.3 MB
        doc_idx@28250[S]:artifacts of this executor (doc_indexer) is persisted to ./workspace/doc_indexer.bin
        doc_idx@28171[S]:terminated
    chunk_idx/4@28242[I]:recv ControlRequest  from ctl▸chunk_idx/4/ZEDRuntime▸⚐
    chunk_idx/4@28242[I]:#sent: 8 #recv: 4 sent_size: 2.2 MB recv_size: 2.2 MB
   NumpyIndexer@28242[I]:indexer size: 733 physical size: 2.1 MB
   NumpyIndexer@28242[S]:artifacts of this executor (vecidx) is persisted to ./workspace/chunk_compound_indexer-4/vecidx-4/vecidx.bin
BinaryPbIndexer@28242[I]:indexer size: 733 physical size: 2.4 MB
BinaryPbIndexer@28242[S]:artifacts of this executor (chunkidx) is persisted to ./workspace/chunk_compound_indexer-4/chunkidx-4/chunkidx.bin
   NumpyIndexer@28242[I]:no update since 2021-03-02 18:50:01, will not save. If you really want to save it, call "touch()" before "save()" to force saving
BinaryPbIndexer@28242[I]:no update since 2021-03-02 18:50:01, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/4@28242[I]:no update since 2021-03-02 18:49:41, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/4@28171[S]:terminated
    chunk_idx/3@28237[I]:recv ControlRequest  from ctl▸chunk_idx/3/ZEDRuntime▸⚐
    chunk_idx/3@28237[I]:#sent: 10 #recv: 5 sent_size: 2.8 MB recv_size: 2.8 MB
   NumpyIndexer@28237[I]:indexer size: 1042 physical size: 3.1 MB
   NumpyIndexer@28237[S]:artifacts of this executor (vecidx) is persisted to ./workspace/chunk_compound_indexer-3/vecidx-3/vecidx.bin
BinaryPbIndexer@28237[I]:indexer size: 1042 physical size: 3.4 MB
BinaryPbIndexer@28237[S]:artifacts of this executor (chunkidx) is persisted to ./workspace/chunk_compound_indexer-3/chunkidx-3/chunkidx.bin
   NumpyIndexer@28237[I]:no update since 2021-03-02 18:50:01, will not save. If you really want to save it, call "touch()" before "save()" to force saving
BinaryPbIndexer@28237[I]:no update since 2021-03-02 18:50:01, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/3@28237[I]:no update since 2021-03-02 18:49:41, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/3@28171[S]:terminated
    chunk_idx/2@28232[I]:recv ControlRequest  from ctl▸chunk_idx/2/ZEDRuntime▸⚐
    chunk_idx/2@28232[I]:#sent: 8 #recv: 4 sent_size: 1.8 MB recv_size: 1.7 MB
   NumpyIndexer@28232[I]:indexer size: 657 physical size: 1.9 MB
   NumpyIndexer@28232[S]:artifacts of this executor (vecidx) is persisted to ./workspace/chunk_compound_indexer-2/vecidx-2/vecidx.bin
BinaryPbIndexer@28232[I]:indexer size: 657 physical size: 2.1 MB
BinaryPbIndexer@28232[S]:artifacts of this executor (chunkidx) is persisted to ./workspace/chunk_compound_indexer-2/chunkidx-2/chunkidx.bin
   NumpyIndexer@28232[I]:no update since 2021-03-02 18:50:02, will not save. If you really want to save it, call "touch()" before "save()" to force saving
BinaryPbIndexer@28232[I]:no update since 2021-03-02 18:50:02, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/2@28232[I]:no update since 2021-03-02 18:49:41, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/2@28171[S]:terminated
    chunk_idx/1@28224[I]:recv ControlRequest  from ctl▸chunk_idx/1/ZEDRuntime▸⚐
    chunk_idx/1@28224[I]:#sent: 8 #recv: 4 sent_size: 1.8 MB recv_size: 1.8 MB
   NumpyIndexer@28224[I]:indexer size: 671 physical size: 2.0 MB
   NumpyIndexer@28224[S]:artifacts of this executor (vecidx) is persisted to ./workspace/chunk_compound_indexer-1/vecidx-1/vecidx.bin
BinaryPbIndexer@28224[I]:indexer size: 671 physical size: 2.2 MB
BinaryPbIndexer@28224[S]:artifacts of this executor (chunkidx) is persisted to ./workspace/chunk_compound_indexer-1/chunkidx-1/chunkidx.bin
   NumpyIndexer@28224[I]:no update since 2021-03-02 18:50:02, will not save. If you really want to save it, call "touch()" before "save()" to force saving
BinaryPbIndexer@28224[I]:no update since 2021-03-02 18:50:02, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/1@28224[I]:no update since 2021-03-02 18:49:41, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/1@28171[S]:terminated
 chunk_idx/tail@28219[I]:recv ControlRequest  from ctl▸chunk_idx/tail/ZEDRuntime▸⚐
 chunk_idx/tail@28219[I]:#sent: 14 #recv: 14 sent_size: 8.5 MB recv_size: 8.5 MB
 chunk_idx/tail@28219[I]:no update since 2021-03-02 18:49:40, will not save. If you really want to save it, call "touch()" before "save()" to force saving
 chunk_idx/tail@28171[S]:terminated
 chunk_idx/head@28214[I]:recv ControlRequest  from ctl▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/head@28214[I]:#sent: 14 #recv: 31 sent_size: 8.5 MB recv_size: 8.5 MB
 chunk_idx/head@28214[I]:no update since 2021-03-02 18:49:40, will not save. If you really want to save it, call "touch()" before "save()" to force saving
 chunk_idx/head@28171[S]:terminated
      encoder/2@28209[I]:recv ControlRequest  from ctl▸encoder/2/ZEDRuntime▸⚐
      encoder/2@28209[I]:#sent: 16 #recv: 8 sent_size: 4.3 MB recv_size: 109.6 KB
      encoder/2@28209[I]:no update since 2021-03-02 18:49:40, will not save. If you really want to save it, call "touch()" before "save()" to force saving
      encoder/2@28171[S]:terminated
      encoder/1@28204[I]:recv ControlRequest  from ctl▸encoder/1/ZEDRuntime▸⚐
      encoder/1@28204[I]:#sent: 14 #recv: 7 sent_size: 4.2 MB recv_size: 106.5 KB
      encoder/1@28204[I]:no update since 2021-03-02 18:49:40, will not save. If you really want to save it, call "touch()" before "save()" to force saving
      encoder/1@28171[S]:terminated
   encoder/tail@28199[I]:recv ControlRequest  from ctl▸encoder/tail/ZEDRuntime▸⚐
   encoder/tail@28199[I]:#sent: 14 #recv: 14 sent_size: 8.5 MB recv_size: 8.5 MB
   encoder/tail@28199[I]:no update since 2021-03-02 18:49:40, will not save. If you really want to save it, call "touch()" before "save()" to force saving
   encoder/tail@28171[S]:terminated
   encoder/head@28191[I]:recv ControlRequest  from ctl▸encoder/head/ZEDRuntime▸⚐
   encoder/head@28191[I]:#sent: 14 #recv: 29 sent_size: 217.0 KB recv_size: 218.0 KB
   encoder/head@28191[I]:no update since 2021-03-02 18:49:40, will not save. If you really want to save it, call "touch()" before "save()" to force saving
   encoder/head@28171[S]:terminated
      segmenter@28189[I]:recv ControlRequest  from ctl▸segmenter/ZEDRuntime▸⚐
      segmenter@28189[I]:#sent: 14 #recv: 14 sent_size: 215.8 KB recv_size: 76.0 KB
      segmenter@28189[I]:no update since 2021-03-02 18:49:40, will not save. If you really want to save it, call "touch()" before "save()" to force saving
      segmenter@28171[S]:terminated
           Flow@28171[S]:flow is closed and all resources are released, current build level is 0
cristianmtr commented 3 years ago

Works for me.

Are you sure you deleted the old modules and re-installed in a clean environment?

Here's my pip freeze:

aiofiles==0.6.0
arrow==0.17.0
attrs==20.3.0
binaryornot==0.4.4
certifi==2020.12.5
chardet==4.0.0
click==7.1.2
cookiecutter==1.7.2
docker==4.4.1
fastapi==0.63.0
filelock==3.0.12
fluent-logger==0.9.6
gevent==21.1.2
greenlet==1.0.0
grpcio==1.35.0
h11==0.12.0
idna==2.10
iniconfig==1.1.1
jina==1.0.0
Jinja2==2.11.2
jinja2-time==0.2.0
joblib==1.0.0
kaggle==1.5.10
lz4==3.1.1
MarkupSafe==1.1.1
msgpack==0.6.2
numpy==1.19.5
packaging==20.8
pluggy==0.13.1
poyo==0.5.0
protobuf==3.14.0
py==1.10.0
pydantic==1.7.3
pyparsing==2.4.7
pytest==6.1.2
python-dateutil==2.8.1
python-magic==0.4.18
python-multipart==0.0.5
python-slugify==4.0.1
PyYAML==5.4.1
pyzmq==21.0.1
regex==2020.11.13
requests==2.25.1
sacremoses==0.0.43
six==1.15.0
starlette==0.13.6
text-unidecode==1.3
tokenizers==0.9.4
toml==0.10.2
torch==1.7.1
tornado==6.1
tqdm==4.56.0
transformers==4.1.1
typing-extensions==3.7.4.3
urllib3==1.26.2
uvicorn==0.13.3
uvloop==0.14.0
websocket-client==0.57.0
websockets==8.1
wsproto==1.0.0
zope.event==4.5.0
zope.interface==5.2.0
JoanFM commented 3 years ago

Hey @yiouyou , this error is fixed in the latest master. We provided backcompatibility to a breaking change we made.

yiouyou commented 3 years ago

Double checked again. With fresh new env: pip install -U pip pip install -r requirements pip list

Package            Version
------------------ ----------
aiofiles           0.6.0
arrow              1.0.2
attrs              20.3.0
binaryornot        0.4.4
certifi            2020.12.5
chardet            4.0.0
click              7.1.2
cookiecutter       1.7.2
docker             4.4.4
fastapi            0.63.0
filelock           3.0.12
fluent-logger      0.9.6
gevent             21.1.2
greenlet           1.0.0
grpcio             1.36.0
h11                0.12.0
idna               2.10
importlib-metadata 3.7.0
iniconfig          1.1.1
jina               1.0.0
Jinja2             2.11.3
jinja2-time        0.2.0
joblib             1.0.1
kaggle             1.5.10
lz4                3.1.1
MarkupSafe         1.1.1
msgpack            0.6.2
numpy              1.20.1
packaging          20.9
pip                21.0.1
pluggy             0.13.1
poyo               0.5.0
protobuf           3.15.3
py                 1.10.0
pydantic           1.8
pyparsing          2.4.7
pytest             6.1.2
python-dateutil    2.8.1
python-magic       0.4.22
python-multipart   0.0.5
python-slugify     4.0.1
PyYAML             5.4.1
pyzmq              22.0.3
regex              2020.11.13
requests           2.25.1
sacremoses         0.0.43
setuptools         47.1.0
six                1.15.0
starlette          0.13.6
text-unidecode     1.3
tokenizers         0.9.4
toml               0.10.2
torch              1.7.1
tornado            6.1
tqdm               4.58.0
transformers       4.1.1
typing-extensions  3.7.4.3
urllib3            1.26.3
uvicorn            0.13.4
uvloop             0.15.2
websocket-client   0.57.0
websockets         8.1
wsproto            1.0.0
zipp               3.4.0
zope.event         4.5.0
zope.interface     5.2.0

At least with the code right now, it'll fail. btw, the used code is the downloaded zip. image

JoanFM commented 3 years ago

Hey @yiouyou , as a first workaround, what u can do is to make sure the ranker.yml of the multires-lyrics-example is using the proper inverse_score parameter.

cristianmtr commented 3 years ago

FYI I didn't have to upgrade to latest master.

@yiouyou Did you make any changes to the example? By default the parameter that you see mentioned in the exception is provided:

https://github.com/jina-ai/examples/blob/f520395eeaa1d3b90f00bd4565b784a8330b8f12/multires-lyrics-search/pods/ranker.yml#L4

yiouyou commented 3 years ago

I didn't change anything and downloaded+run again. The ranker.yml is:

!SimpleAggregateRanker
with:
  aggregate_function: 'min'
  inverse_score: true
requests:
  on:
    ControlRequest:
      - !ControlReqDriver {}
    SearchRequest:
      - !Chunk2DocRankDriver {}
cristianmtr commented 3 years ago

Strange. I tried running it on both Python 3.7.10 and Python 3.8.5. What specific version of Python are you running?

pip freeze for 3.7.10

aiofiles==0.6.0
arrow==1.0.2
attrs==20.3.0
binaryornot==0.4.4
certifi==2020.12.5
chardet==4.0.0
click==7.1.2
cookiecutter==1.7.2
docker==4.4.4
fastapi==0.63.0
filelock==3.0.12
fluent-logger==0.9.6
gevent==21.1.2
greenlet==1.0.0
grpcio==1.36.0
h11==0.12.0
idna==2.10
importlib-metadata==3.7.0
iniconfig==1.1.1
jina==1.0.0
Jinja2==2.11.3
jinja2-time==0.2.0
joblib==1.0.1
kaggle==1.5.10
lz4==3.1.1
MarkupSafe==1.1.1
msgpack==0.6.2
numpy==1.20.1
packaging==20.9
pluggy==0.13.1
poyo==0.5.0
protobuf==3.15.3
py==1.10.0
pydantic==1.8
pyparsing==2.4.7
pytest==6.1.2
python-dateutil==2.8.1
python-magic==0.4.22
python-multipart==0.0.5
python-slugify==4.0.1
PyYAML==5.4.1
pyzmq==22.0.3
regex==2020.11.13
requests==2.25.1
sacremoses==0.0.43
six==1.15.0
starlette==0.13.6
text-unidecode==1.3
tokenizers==0.9.4
toml==0.10.2
torch==1.7.1
tornado==6.1
tqdm==4.58.0
transformers==4.1.1
typing-extensions==3.7.4.3
urllib3==1.26.3
uvicorn==0.13.4
uvloop==0.15.2
websocket-client==0.57.0
websockets==8.1
wsproto==1.0.0
zipp==3.4.0
zope.event==4.5.0
zope.interface==5.2.0

Can you try to paste this to a file and install them with pip install -r file.txt? Then can you try to re-index?

yiouyou commented 3 years ago

I'm using python 3.7.9. Will do as you suggested. Still unlucky:

(py37-mls) sz@pc:/mnt/d/jina-ai/multires-lyrics-search$ python app.py search
      chunk_seg@32662[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
      tf_encode@32664[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
      chunk_seg@32662[I]:input tcp://0.0.0.0:34729 (PULL_BIND) output tcp://0.0.0.0:41979 (PUSH_CONNECT) control over tcp://0.0.0.0:56977 (PAIR_BIND)
      tf_encode@32664[I]:input tcp://0.0.0.0:41979 (PULL_BIND) output tcp://0.0.0.0:42351 (PUSH_CONNECT) control over tcp://0.0.0.0:57959 (PAIR_BIND)
 chunk_idx/head@32672[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
 chunk_idx/head@32672[I]:input tcp://0.0.0.0:42351 (PULL_BIND) output tcp://0.0.0.0:43063 (PUB_BIND) control over tcp://0.0.0.0:34965 (PAIR_BIND)
 chunk_idx/tail@32677[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
 chunk_idx/tail@32677[I]:input tcp://0.0.0.0:41833 (PULL_BIND) output tcp://0.0.0.0:52891 (PUSH_CONNECT) control over tcp://0.0.0.0:42807 (PAIR_BIND)
    chunk_idx/1@32682[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
    chunk_idx/1@32682[I]:input tcp://0.0.0.0:43063 (SUB_CONNECT) output tcp://0.0.0.0:41833 (PUSH_CONNECT) control over tcp://0.0.0.0:49195 (PAIR_BIND)
    chunk_idx/2@32687[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
    chunk_idx/2@32687[I]:input tcp://0.0.0.0:43063 (SUB_CONNECT) output tcp://0.0.0.0:41833 (PUSH_CONNECT) control over tcp://0.0.0.0:49123 (PAIR_BIND)
    chunk_idx/3@32692[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
    chunk_idx/3@32692[I]:input tcp://0.0.0.0:43063 (SUB_CONNECT) output tcp://0.0.0.0:41833 (PUSH_CONNECT) control over tcp://0.0.0.0:47175 (PAIR_BIND)
    chunk_idx/4@32697[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
    chunk_idx/4@32697[I]:input tcp://0.0.0.0:43063 (SUB_CONNECT) output tcp://0.0.0.0:41833 (PUSH_CONNECT) control over tcp://0.0.0.0:38163 (PAIR_BIND)
TransformerTorchEncoder@32664[I]:post_init may take some time...
   BaseExecutor@32672[I]:post_init may take some time...
   BaseExecutor@32672[I]:post_init may take some time takes 0 seconds (0.00s)
   BaseExecutor@32677[I]:post_init may take some time...
   BaseExecutor@32677[I]:post_init may take some time takes 0 seconds (0.00s)
    Sentencizer@32662[I]:post_init may take some time...
    Sentencizer@32662[I]:post_init may take some time takes 0 seconds (0.00s)
   BaseExecutor@32672[S]:successfully built BaseExecutor from a yaml config
   BaseExecutor@32677[S]:successfully built BaseExecutor from a yaml config
    Sentencizer@32662[S]:successfully built Sentencizer from a yaml config
         ranker@32706[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
         ranker@32706[I]:input tcp://0.0.0.0:52891 (PULL_BIND) output tcp://0.0.0.0:42683 (PUSH_CONNECT) control over tcp://0.0.0.0:37509 (PAIR_BIND)
        doc_idx@32711[I]:starting jina.peapods.runtimes.zmq.zed.ZEDRuntime...
        doc_idx@32711[I]:input tcp://0.0.0.0:42683 (PULL_BIND) output tcp://0.0.0.0:43193 (PUSH_BIND) control over tcp://0.0.0.0:45709 (PAIR_BIND)
      chunk_seg@32644[S]:ready and listening
        gateway@32716[I]:starting jina.peapods.runtimes.asyncio.rest.RESTRuntime...
   NumpyIndexer@32682[I]:post_init may take some time...
   NumpyIndexer@32682[I]:post_init may take some time takes 0 seconds (0.00s)
   NumpyIndexer@32687[I]:post_init may take some time...
   NumpyIndexer@32687[I]:post_init may take some time takes 0 seconds (0.00s)
   NumpyIndexer@32682[S]:restore NumpyIndexer from ./workspace/chunk_compound_indexer-1/vecidx-1/vecidx.bin
   NumpyIndexer@32687[S]:restore NumpyIndexer from ./workspace/chunk_compound_indexer-2/vecidx-2/vecidx.bin
BinaryPbIndexer@32682[I]:post_init may take some time...
BinaryPbIndexer@32687[I]:post_init may take some time...
BinaryPbIndexer@32682[I]:post_init may take some time takes 0 seconds (0.00s)
BinaryPbIndexer@32687[I]:post_init may take some time takes 0 seconds (0.00s)
BinaryPbIndexer@32682[S]:restore BinaryPbIndexer from ./workspace/chunk_compound_indexer-1/chunkidx-1/chunkidx.bin
BinaryPbIndexer@32687[S]:restore BinaryPbIndexer from ./workspace/chunk_compound_indexer-2/chunkidx-2/chunkidx.bin
CompoundIndexer@32687[I]:post_init may take some time...
CompoundIndexer@32682[I]:post_init may take some time...
CompoundIndexer@32687[I]:post_init may take some time takes 0 seconds (0.00s)
CompoundIndexer@32682[I]:post_init may take some time takes 0 seconds (0.00s)
CompoundIndexer@32687[S]:successfully built CompoundIndexer from a yaml config
CompoundIndexer@32682[S]:successfully built CompoundIndexer from a yaml config
CompoundIndexer@32682[W]:Setting workspace of vecidx to ./workspace/chunk_compound_indexer-1
CompoundIndexer@32687[W]:Setting workspace of vecidx to ./workspace/chunk_compound_indexer-2
CompoundIndexer@32682[W]:Setting workspace of chunkidx to ./workspace/chunk_compound_indexer-1
CompoundIndexer@32687[W]:Setting workspace of chunkidx to ./workspace/chunk_compound_indexer-2
         ranker@32706[C]:can not load the executor from pods/ranker.yml
   NumpyIndexer@32692[I]:post_init may take some time...
   NumpyIndexer@32692[I]:post_init may take some time takes 0 seconds (0.00s)
   NumpyIndexer@32692[S]:restore NumpyIndexer from ./workspace/chunk_compound_indexer-3/vecidx-3/vecidx.bin
   NumpyIndexer@32697[I]:post_init may take some time...
   NumpyIndexer@32697[I]:post_init may take some time takes 0 seconds (0.00s)
   NumpyIndexer@32697[S]:restore NumpyIndexer from ./workspace/chunk_compound_indexer-4/vecidx-4/vecidx.bin
BinaryPbIndexer@32692[I]:post_init may take some time...
BinaryPbIndexer@32692[I]:post_init may take some time takes 0 seconds (0.00s)
BinaryPbIndexer@32692[S]:restore BinaryPbIndexer from ./workspace/chunk_compound_indexer-3/chunkidx-3/chunkidx.bin
BinaryPbIndexer@32697[I]:post_init may take some time...
BinaryPbIndexer@32697[I]:post_init may take some time takes 0 seconds (0.00s)
BinaryPbIndexer@32697[S]:restore BinaryPbIndexer from ./workspace/chunk_compound_indexer-4/chunkidx-4/chunkidx.bin
CompoundIndexer@32692[I]:post_init may take some time...
CompoundIndexer@32692[I]:post_init may take some time takes 0 seconds (0.00s)
CompoundIndexer@32697[I]:post_init may take some time...
CompoundIndexer@32697[I]:post_init may take some time takes 0 seconds (0.00s)
CompoundIndexer@32692[S]:successfully built CompoundIndexer from a yaml config
CompoundIndexer@32692[W]:Setting workspace of vecidx to ./workspace/chunk_compound_indexer-3
CompoundIndexer@32692[W]:Setting workspace of chunkidx to ./workspace/chunk_compound_indexer-3
CompoundIndexer@32697[S]:successfully built CompoundIndexer from a yaml config
CompoundIndexer@32697[W]:Setting workspace of vecidx to ./workspace/chunk_compound_indexer-4
CompoundIndexer@32697[W]:Setting workspace of chunkidx to ./workspace/chunk_compound_indexer-4
         ranker@32706[E]:ExecutorFailToLoad() during <bound method ZEDRuntime.setup of <jina.peapods.runtimes.zmq.zed.ZEDRuntime object at 0x7f384c02f790>>
 add "--hide-exc-info" to suppress the exception details
Traceback (most recent call last):
  File "/mnt/d/jina-ai/py37-mls/lib/python3.7/site-packages/jina/peapods/runtimes/zmq/zed.py", line 62, in _load_executor
    read_only=self.args.read_only)
  File "/mnt/d/jina-ai/py37-mls/lib/python3.7/site-packages/jina/jaml/__init__.py", line 414, in load_config
    return JAML.load(revert_tag_yml, substitute=False)
  File "/mnt/d/jina-ai/py37-mls/lib/python3.7/site-packages/jina/jaml/__init__.py", line 89, in load
    r = yaml.load(stream, Loader=JinaLoader)
  File "/mnt/d/jina-ai/py37-mls/lib/python3.7/site-packages/yaml/__init__.py", line 114, in load
    return loader.get_single_data()
  File "/mnt/d/jina-ai/py37-mls/lib/python3.7/site-packages/yaml/constructor.py", line 51, in get_single_data
    return self.construct_document(node)
  File "/mnt/d/jina-ai/py37-mls/lib/python3.7/site-packages/yaml/constructor.py", line 55, in construct_document
    data = self.construct_object(node)
  File "/mnt/d/jina-ai/py37-mls/lib/python3.7/site-packages/yaml/constructor.py", line 100, in construct_object
    data = constructor(self, node)
  File "/mnt/d/jina-ai/py37-mls/lib/python3.7/site-packages/jina/jaml/__init__.py", line 328, in _from_yaml
    return get_parser(cls, version=data.get('version', None)).parse(cls, data)
  File "/mnt/d/jina-ai/py37-mls/lib/python3.7/site-packages/jina/jaml/parsers/executor/legacy.py", line 115, in parse
    obj = cls(**data.get('with', {}), metas=data.get('metas', {}), requests=data.get('requests', {}))
  File "/mnt/d/jina-ai/py37-mls/lib/python3.7/site-packages/jina/executors/__init__.py", line 47, in __call__
    obj = type.__call__(cls, *args, **kwargs)
  File "/mnt/d/jina-ai/py37-mls/lib/python3.7/site-packages/jina/executors/decorators.py", line 144, in arg_wrapper
    f = func(self, *args, **kwargs)
TypeError: __init__() missing 1 required positional argument: 'is_reversed_score'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/mnt/d/jina-ai/py37-mls/lib/python3.7/site-packages/jina/peapods/peas/__init__.py", line 66, in run
    self.runtime.setup()
  File "/mnt/d/jina-ai/py37-mls/lib/python3.7/site-packages/jina/peapods/runtimes/zmq/zed.py", line 41, in setup
    self._load_executor()
  File "/mnt/d/jina-ai/py37-mls/lib/python3.7/site-packages/jina/peapods/runtimes/zmq/zed.py", line 73, in _load_executor
    raise ExecutorFailToLoad from ex
jina.excepts.ExecutorFailToLoad
BinaryPbIndexer@32711[I]:post_init may take some time...
BinaryPbIndexer@32711[I]:post_init may take some time takes 0 seconds (0.00s)
BinaryPbIndexer@32711[S]:restore BinaryPbIndexer from ./workspace/doc_indexer.bin
           JINA@32716[I]:input tcp://0.0.0.0:43193 (PULL_CONNECT) output tcp://0.0.0.0:34729 (PUSH_CONNECT) control over ipc:///tmp/tmp9yux_ig5 (PAIR_BIND)
           JINA@32716[I]:
    Jina REST interface
    💬 Swagger UI:      http://localhost:65481/docs
    📚 Redoc     :      http://localhost:65481/redoc

           JINA@32716[S]:ready and listening
        gateway@32716[S]:RESTRuntime is listening at: 0.0.0.0:65481
TransformerTorchEncoder@32664[I]:post_init may take some time takes 11 seconds (11.53s)
TransformerTorchEncoder@32664[S]:successfully built TransformerTorchEncoder from a yaml config
      tf_encode@32644[S]:ready and listening
 chunk_idx/head@32644[S]:ready and listening
 chunk_idx/tail@32644[S]:ready and listening
    chunk_idx/1@32644[S]:ready and listening
    chunk_idx/2@32644[S]:ready and listening
    chunk_idx/3@32644[S]:ready and listening
    chunk_idx/4@32644[S]:ready and listening
         ranker@32644[S]:terminated
           Flow@32644[E]:ranker:<jina.peapods.pods.BasePod object at 0x7f384bffd9d0> can not be started due to RuntimeFailToStart(), Flow is aborted
           JINA@32716[I]:#sent: 0 #recv: 0 sent_size: 0 Bytes recv_size: 0 Bytes
        gateway@32644[S]:terminated
        doc_idx@32711[I]:recv ControlRequest  from ctl▸doc_idx/ZEDRuntime▸⚐
        doc_idx@32711[I]:#sent: 1 #recv: 1 sent_size: 245 Bytes recv_size: 137 Bytes
        doc_idx@32711[I]:indexer size: 99 physical size: 19.8 MB
        doc_idx@32711[I]:no update since 2021-03-02 20:40:24, will not save. If you really want to save it, call "touch()" before "save()" to force saving
        doc_idx@32644[S]:terminated
    chunk_idx/4@32697[I]:recv ControlRequest  from ctl▸chunk_idx/4/ZEDRuntime▸⚐
    chunk_idx/4@32697[I]:#sent: 1 #recv: 1 sent_size: 251 Bytes recv_size: 138 Bytes
   NumpyIndexer@32697[I]:indexer size: 792 physical size: 2.4 MB
   NumpyIndexer@32697[I]:no update since 2021-03-02 20:40:24, will not save. If you really want to save it, call "touch()" before "save()" to force saving
BinaryPbIndexer@32697[I]:indexer size: 792 physical size: 2.6 MB
BinaryPbIndexer@32697[I]:no update since 2021-03-02 20:40:24, will not save. If you really want to save it, call "touch()" before "save()" to force saving
   NumpyIndexer@32697[I]:no update since 2021-03-02 20:40:24, will not save. If you really want to save it, call "touch()" before "save()" to force saving
BinaryPbIndexer@32697[I]:no update since 2021-03-02 20:40:24, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/4@32697[I]:no update since 2021-03-02 20:40:59, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/4@32644[S]:terminated
    chunk_idx/3@32692[I]:recv ControlRequest  from ctl▸chunk_idx/3/ZEDRuntime▸⚐
    chunk_idx/3@32692[I]:#sent: 1 #recv: 1 sent_size: 251 Bytes recv_size: 138 Bytes
   NumpyIndexer@32692[I]:indexer size: 907 physical size: 2.8 MB
   NumpyIndexer@32692[I]:no update since 2021-03-02 20:40:24, will not save. If you really want to save it, call "touch()" before "save()" to force saving
BinaryPbIndexer@32692[I]:indexer size: 907 physical size: 3.0 MB
BinaryPbIndexer@32692[I]:no update since 2021-03-02 20:40:24, will not save. If you really want to save it, call "touch()" before "save()" to force saving
   NumpyIndexer@32692[I]:no update since 2021-03-02 20:40:24, will not save. If you really want to save it, call "touch()" before "save()" to force saving
BinaryPbIndexer@32692[I]:no update since 2021-03-02 20:40:24, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/3@32692[I]:no update since 2021-03-02 20:40:59, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/3@32644[S]:terminated
    chunk_idx/2@32687[I]:recv ControlRequest  from ctl▸chunk_idx/2/ZEDRuntime▸⚐
    chunk_idx/2@32687[I]:#sent: 1 #recv: 1 sent_size: 251 Bytes recv_size: 138 Bytes
   NumpyIndexer@32687[I]:indexer size: 671 physical size: 2.1 MB
   NumpyIndexer@32687[I]:no update since 2021-03-02 20:40:24, will not save. If you really want to save it, call "touch()" before "save()" to force saving
BinaryPbIndexer@32687[I]:indexer size: 671 physical size: 2.2 MB
BinaryPbIndexer@32687[I]:no update since 2021-03-02 20:40:24, will not save. If you really want to save it, call "touch()" before "save()" to force saving
   NumpyIndexer@32687[I]:no update since 2021-03-02 20:40:24, will not save. If you really want to save it, call "touch()" before "save()" to force saving
BinaryPbIndexer@32687[I]:no update since 2021-03-02 20:40:24, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/2@32687[I]:no update since 2021-03-02 20:40:59, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/2@32644[S]:terminated
    chunk_idx/1@32682[I]:recv ControlRequest  from ctl▸chunk_idx/1/ZEDRuntime▸⚐
    chunk_idx/1@32682[I]:#sent: 1 #recv: 1 sent_size: 249 Bytes recv_size: 137 Bytes
   NumpyIndexer@32682[I]:indexer size: 733 physical size: 2.3 MB
   NumpyIndexer@32682[I]:no update since 2021-03-02 20:40:24, will not save. If you really want to save it, call "touch()" before "save()" to force saving
BinaryPbIndexer@32682[I]:indexer size: 733 physical size: 2.4 MB
BinaryPbIndexer@32682[I]:no update since 2021-03-02 20:40:24, will not save. If you really want to save it, call "touch()" before "save()" to force saving
   NumpyIndexer@32682[I]:no update since 2021-03-02 20:40:24, will not save. If you really want to save it, call "touch()" before "save()" to force saving
BinaryPbIndexer@32682[I]:no update since 2021-03-02 20:40:24, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/1@32682[I]:no update since 2021-03-02 20:40:59, will not save. If you really want to save it, call "touch()" before "save()" to force saving
    chunk_idx/1@32644[S]:terminated
 chunk_idx/tail@32677[I]:recv ControlRequest  from ctl▸chunk_idx/tail/ZEDRuntime▸⚐
 chunk_idx/tail@32677[I]:#sent: 1 #recv: 1 sent_size: 254 Bytes recv_size: 138 Bytes
 chunk_idx/tail@32677[I]:no update since 2021-03-02 20:40:59, will not save. If you really want to save it, call "touch()" before "save()" to force saving
 chunk_idx/tail@32644[S]:terminated
 chunk_idx/head@32672[I]:recv ControlRequest  from ctl▸chunk_idx/head/ZEDRuntime▸⚐
 chunk_idx/head@32672[I]:#sent: 1 #recv: 1 sent_size: 254 Bytes recv_size: 138 Bytes
 chunk_idx/head@32672[I]:no update since 2021-03-02 20:40:59, will not save. If you really want to save it, call "touch()" before "save()" to force saving
 chunk_idx/head@32644[S]:terminated
      tf_encode@32664[I]:recv ControlRequest  from ctl▸tf_encode/ZEDRuntime▸⚐
      tf_encode@32664[I]:#sent: 1 #recv: 1 sent_size: 249 Bytes recv_size: 138 Bytes
      tf_encode@32664[I]:no update since 2021-03-02 20:40:59, will not save. If you really want to save it, call "touch()" before "save()" to force saving
      tf_encode@32644[S]:terminated
      chunk_seg@32662[I]:recv ControlRequest  from ctl▸chunk_seg/ZEDRuntime▸⚐
      chunk_seg@32662[I]:#sent: 1 #recv: 1 sent_size: 249 Bytes recv_size: 138 Bytes
      chunk_seg@32662[I]:no update since 2021-03-02 20:40:59, will not save. If you really want to save it, call "touch()" before "save()" to force saving
      chunk_seg@32644[S]:terminated
           Flow@32644[S]:flow is closed and all resources are released, current build level is 0
Traceback (most recent call last):
  File "app.py", line 91, in <module>
    main()
  File "app.py", line 83, in main
    search()
  File "app.py", line 52, in search
    with f:
  File "/mnt/d/jina-ai/py37-mls/lib/python3.7/site-packages/jina/flow/base.py", line 399, in __enter__
    return self.start()
  File "/mnt/d/jina-ai/py37-mls/lib/python3.7/site-packages/jina/flow/base.py", line 438, in start
    v.wait_start_success()
  File "/mnt/d/jina-ai/py37-mls/lib/python3.7/site-packages/jina/peapods/pods/__init__.py", line 221, in wait_start_success
    p.wait_start_success()
  File "/mnt/d/jina-ai/py37-mls/lib/python3.7/site-packages/jina/peapods/peas/__init__.py", line 126, in wait_start_success
    raise RuntimeFailToStart
jina.excepts.RuntimeFailToStart

Can't find anything wrong with yanker.yml.

Yongxuanzhang commented 3 years ago

One thing we can try is to change inverse_score to is_reversed_score inranker.yml. From this TypeError: __init__() missing 1 required positional argument: 'is_reversed_score'. We changed the is_reversed_score to inverse_score recently, this error message probably means you're using the old version of Jina hub executors.

Related PRs: https://github.com/jina-ai/jina-hub/pull/4146 https://github.com/jina-ai/examples/pull/404/files

If changing back this param works for you locally, could you try to upgrade Jina to the latest version?

If this is the case, I will update our requirements.txt accordingly. Thanks for your feedback!

yiouyou commented 3 years ago

You're right! To change inverse_score to is_reversed_score fixed the problem. It's not about env issue.

Yongxuanzhang commented 3 years ago

You're right! To change inverse_score to is_reversed_score fixed the problem. It's not about env issue.

😄 Glad to see it is fixed. env is part of this issue. Since we updated the ranker.yml in the example repo. We should use the correct combination of param setting and Jina version. A simple mapping for this param: Jina version<1.0.7 is_reversed_score Jina version>=1.0.7 both is_reversed_score inverse_score are ok.

I will double-check this example to update the requirement.txt soon. Thank you again for your feedback!

yiouyou commented 3 years ago

One more feedback: Jina 1.0.0 with is_reversed_score is working. But, Jina 1.0.7 with inverse_socre doesn't work for me.

cristianmtr commented 3 years ago

How did you install that version of Jina? You need to install the hub modules with it, where the ranker is provided. Like so pip install 'jina[hub,http]'==1.0.7. I just tested it and it worked for me.

FionnD commented 3 years ago

Hi @yiouyou, I'm closing this issue because there was no update since @cristianmtr last question. If you find more information please reopen this issue.