Closed florian-hoenicke closed 1 year ago
can you please run with JINA_LOG_LEVEL=DEBUG
?
Here are the complete logs before the timeout is happening
WARNING: No blkio throttle.read_bps_device support
WARNING: No blkio throttle.write_bps_device support
WARNING: No blkio throttle.read_iops_device support
WARNING: No blkio throttle.write_iops_device support
Run a jina flow locally
⠋ Fetching auth0-unified-448f11965ce142b6/PrintTestExecutor2622 from Jina Hub
⠙ Fetching auth0-unified-448f11965ce142b6/PrintTestExecutor2622 from Jina Hub
⠹ Fetching auth0-unified-448f11965ce142b6/PrintTestExecutor2622 from Jina Hub
⠹ Fetching auth0-unified-448f11965ce142b6/PrintTestExecutor2622 from Jina Hub
...
🐳 will use Docker image: jinahub/1xum4h0g:644686d75dc4fb62032a1793
DEBUG gateway/rep-0@6372 adding connection for deployment [04/24/23 22:57:35]
printtestexecutor2622/heads/0 to
grpc://127.0.0.1:55538
DEBUG gateway/rep-0@6372 connection for deployment
printtestexecutor2622/heads/0 to
grpc://127.0.0.1:55538 added
INFO: Waiting for application startup.
DEBUG gateway/rep-0@6372 Running GatewayRuntime warmup [04/24/23 22:57:38]
DEBUG gateway/rep-0@6372 starting warmup task for
deployment printtestexecutor2622
INFO: Application startup complete.
INFO: Uvicorn running on http://127.0.0.1:8080 (Press CTRL+C to quit)
DEBUG gateway/rep-0@21116 ready and listening [04/24/23 22:57:38]
🐳
🐳
MMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMWWWMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM…
🐳
MMMMMMMMMMMMMMMMMMMMMMMMMMMMMWNNNNNNNWMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM…
🐳
MMMMMMMMMMMMMMMMMMMMMMMMMMMMMNNNNNNNNNMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM…
🐳
MMMMMMMMMMMMMMMMMMMMMMMMMMMMMWNNNNNNNNMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM…
🐳
MMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMWNNNWWMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM…
🐳
MMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM…
🐳
MMMMMMMMMMMMWxxxxxxxxxOMMMMMNxxxxxxxxx0MMMMMKddddddxkKWMMMMMMMMMMMMXOxdddxONMM…
🐳
MMMMMMMMMMMMXllllllllldMMMMM0lllllllllxMMMMMOllllllllllo0MMMMMMMM0olllllllllo0…
🐳
MMMMMMMMMMMMXllllllllldMMMMM0lllllllllxMMMMMOlllllllllllloWMMMMMdlllllllllllll…
🐳
MMMMMMMMMMMMXllllllllldMMMMM0lllllllllxMMMMMOllllllllllllloMMMM0llllllllllllll…
🐳
MMMMMMMMMMMMKllllllllldMMMMM0lllllllllxMMMMMOllllllllllllllKMMM0llllllllllllll…
🐳
MMMMMMMMMMMMKllllllllldMMMMM0lllllllllxMMMMMOllllllllllllll0MMMMolllllllllllll…
🐳
MWOkkkkk0MMMKlllllllllkMMMMM0lllllllllxMMMMMOllllllllllllll0MMMMMxllllllllllll…
🐳
NkkkkkkkkkMMKlllllllloMMMMMM0lllllllllxMMMMMOllllllllllllll0MMMMMMWOdollllllll…
🐳
KkkkkkkkkkNMKllllllldMMMMMMMMWWWWWWWWWMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM…
🐳
MOkkkkkkk0MMKllllldXMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM…
🐳
MMWX00KXMMMMXxk0XMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM…
🐳
🐳
🐳 /usr/local/bin/jina executor --uses config.yml --name
🐳 printtestexecutor2622/rep-0 --workspace-id d6f76d5ee3f6442dae28eab7b091596e
🐳 --extra-search-paths
🐳 C:\Users\hoenicke\jina\gptdeploy\microservice\PrintTestExecutor2622\0_\v1
🐳 --polling ANY --native --host 127.0.0.1 --env {"OPENAI_API_KEY":
🐳 "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"} --noblock-on-start
--port
🐳 55538 --port-monitoring 59671
🐳
╭───────────────────────┬─────────────────────────────────────────────────────…
🐳 │ Argument │ Value …
│
🐳
├───────────────────────┼─────────────────────────────────────────────────────…
🐳 │ allow-concurrent │ False …
│
🐳 │ cli │ executor …
│
🐳 │ compression │ None …
│
🐳 │ connection-list │ None …
│
🐳 │ disable-auto-volume │ False …
│
🐳 │ docker-kwargs │ None …
│
🐳 │ entrypoint │ None …
│
🐳 │ env │ {'OPENAI_API_KEY': …
│
🐳 │ │
'sk-FjGRu4imV3nBukjgWE5pT3BlbkFJqzKgnUr2D07fRXJpAmr… │
🐳 │ env-from-secret │ None …
│
🐳 │ exit-on-exceptions │ [] …
│
🐳 │ extra-search-paths │
['C:\\Users\\hoenicke\\jina\\gptdeploy\\microservic… │
🐳 │ floating │ False …
│
🐳 │ force-network-mode │ AUTO …
│
🐳 │ force-update │ False …
│
🐳 │ gpus │ None …
│
🐳 │ grpc-channel-options │ None …
│
🐳 │ grpc-server-options │ None …
│
🐳 │ host │ ['127.0.0.1'] …
│
🐳 │ install-requirements │ False …
│
🐳 │ k8s-namespace │ None …
│
🐳 │ log-config │ default …
│
🐳 │ metrics │ False …
│
🐳 │ metrics-exporter-host │ None …
│
🐳 │ metrics-exporter-port │ None …
│
🐳 │ monitoring │ False …
│
🐳 │ name │ printtestexecutor2622/rep-0 …
│
🐳 │ native │ True …
│
🐳 │ no-reduce │ False …
│
🐳 │ noblock-on-start │ True …
│
🐳 │ output-array-type │ None …
│
🐳 │ pod-role │ WORKER …
│
🐳 │ polling │ ANY …
│
🐳 │ port │ [55538] …
│
🐳 │ port-monitoring │ [59671] …
│
🐳 │ prefer-platform │ None …
│
🐳 │ protocol │ [<ProtocolType.GRPC: 0>] …
│
🐳 │ py-modules │ None …
│
🐳 │ quiet │ False …
│
🐳 │ quiet-error │ False …
│
🐳 │ reload │ False …
│
🐳 │ replicas │ 1 …
│
🐳 │ retries │ -1 …
│
🐳 │ runtime-cls │ WorkerRuntime …
│
🐳 │ shard-id │ 0 …
│
🐳 │ shards │ 1 …
│
🐳 │ timeout-ctrl │ 60 …
│
🐳 │ timeout-ready │ 600000 …
│
🐳 │ timeout-send │ None …
│
🐳 │ traces-exporter-host │ None …
│
🐳 │ traces-exporter-port │ None …
│
🐳 │ tracing │ False …
│
🐳 │ uses │ config.yml …
│
🐳 │ uses-after-address │ None …
│
🐳 │ uses-before-address │ None …
│
🐳 │ uses-dynamic-batching │ None …
│
🐳 │ uses-metas │ None …
│
🐳 │ uses-requests │ None …
│
🐳 │ uses-with │ None …
│
🐳 │ volumes │ None …
│
🐳 │ workspace │ None …
│
🐳 │ workspace-id │ d6f76d5ee3f6442dae28eab7b091596e …
│
🐳
╰───────────────────────┴─────────────────────────────────────────────────────…
🐳 INFO printtestexecutor2622/rep-0@ 1 start server bound to [04/24/23
20:57:40]
🐳 127.0.0.1:55538
🐳 INFO printtestexecutor2622/rep-0@ 1 Executor [04/24/23
20:57:40]
🐳 PrintTestExecutor2622 started
Looks good but it is hanging until the timeout is raised
can you show me the code of this Executor?
while doing so, can u check if u can do jina ping executor grpc://0.0.0.0:port?
On the latest master, jina is hanging when deploying the following flow:
error: