linushio
commented
8 months ago 通过修改脚本后从其他服务器获得证书，成功部署secretpad后，psi算法报错，这里是alice节点的容器日志
":"b2010715-6bbf-4001-90e6-04014fc4ef20"},"status":{"$setElementOrder/conditions":[{"type":"Initialized"},{"type":"Ready"},{"type":"ContainersReady"},{"type":"PodScheduled"}],"conditions":[{"lastTransitionTime":"2024-03-02T05:58:00Z","reason":"PodFailed","status":"False","type":"Ready"},{"lastTransitionTime":"2024-03-02T05:58:00Z","reason":"PodFailed","status":"False","type":"ContainersReady"}],"containerStatuses":[{"containerID":"containerd://bd550f8449efb75a8b893aef3f0aad9774626959f5216af00343e6d0aebba8b3","image":"secretflow-registry.cn-hangzhou.cr.aliyuncs.com/secretflow/secretflow-lite-anolis8:1.3.0.dev20231120","imageID":"sha256:f1c20d8cb5c4c69d3997527e4912e794ba3cd7fa26bfaf6afa1383697c80ea9a","lastState":{},"name":"secretflow","ready":false,"restartCount":0,"started":false,"state":{"terminated":{"containerID":"containerd://bd550f8449efb75a8b893aef3f0aad9774626959f5216af00343e6d0aebba8b3","exitCode":1,"finishedAt":"2024-03-02T05:58:00Z","message":"WARNING:root:Since the GPL-licensed package unidecode is not installed, using Python's unicodedata package which yields worse results.\n2024-03-02 05:57:56,466|alice|INFO|secretflow|entry.py:start_ray:55| ray_conf: RayConfig(ray_node_ip_address='jtef-wfpdsawa-node-3-0-global.alice.svc', ray_node_manager_port=26768, ray_object_manager_port=26769, ray_client_server_port=26770, ray_worker_ports=[], ray_gcs_port=26767)\n2024-03-02 05:57:56,466|alice|INFO|secretflow|entry.py:start_ray:59| Trying to start ray head node at jtef-wfpdsawa-node-3-0-global.alice.svc, start command: RAY_BACKEND_LOG_LEVEL=debug RAY_grpc_enable_http_proxy=true OMP_NUM_THREADS=24 ray start --head --include-dashboard=false --disable-usage-stats --num-cpus=32 --node-ip-address=jtef-wfpdsawa-node-3-0-global.alice.svc --port=26767 --node-manager-port=26768 --object-manager-port=26769 --ray-client-server-port=26770\n2024-03-02 05:58:00,032|alice|INFO|secretflow|entry.py:start_ray:76| 2024-03-02 05:57:57,002\tINFO usage_lib.py:490 -- Usage stats collection is disabled.\n2024-03-02 05:57:57,002\tINFO scripts.py:702 -- Local node IP: jtef-wfpdsawa-node-3-0-global.alice.svc\n2024-03-02 05:57:59,898\tSUCC scripts.py:739 -- --------------------\n2024-03-02 05:57:59,898\tSUCC scripts.py:740 -- Ray runtime started.\n2024-03-02 05:57:59,898\tSUCC scripts.py:741 -- --------------------\n2024-03-02 05:57:59,898\tINFO scripts.py:743 -- Next steps\n2024-03-02 05:57:59,899\tINFO scripts.py:744 -- To connect to this Ray runtime from another node, run\n2024-03-02 05:57:59,899\tINFO scripts.py:747 -- ray start --address='jtef-wfpdsawa-node-3-0-global.alice.svc:26767'\n2024-03-02 05:57:59,899\tINFO scripts.py:763 -- Alternatively, use the following Python code:\n2024-03-02 05:57:59,899\tINFO scripts.py:765 -- import ray\n2024-03-02 05:57:59,899\tINFO scripts.py:769 -- ray.init(address='auto', _node_ip_address='jtef-wfpdsawa-node-3-0-global.alice.svc')\n2024-03-02 05:57:59,899\tINFO scripts.py:781 -- To connect to this Ray runtime from outside of the cluster, for example to\n2024-03-02 05:57:59,899\tINFO scripts.py:785 -- connect to a remote cluster from your laptop directly, use the following\n2024-03-02 05:57:59,899\tINFO scripts.py:789 -- Python code:\n2024-03-02 05:57:59,899\tINFO scripts.py:791 -- import ray\n2024-03-02 05:57:59,899\tINFO scripts.py:792 -- ray.init(address='ray://\u003chead_node_ip_address\u003e:26770')\n2024-03-02 05:57:59,899\tINFO scripts.py:801 -- To see the status of the cluster, use\n2024-03-02 05:57:59,899\tINFO scripts.py:802 -- ray status\n2024-03-02 05:57:59,899\tINFO scripts.py:812 -- If connection fails, check your firewall settings and network configuration.\n2024-03-02 05:57:59,899\tINFO scripts.py:820 -- To terminate the Ray runtime, run\n2024-03-02 05:57:59,899\tINFO scripts.py:821 -- ray stop\n\n2024-03-02 05:58:00,033|alice|INFO|secretflow|entry.py:start_ray:77| Succeeded to start ray head node at jtef-wfpdsawa-node-3-0-global.alice.svc.\nTraceback (most recent call last):\n File \"/usr/local/lib/python3.8/runpy.py\", line 194, in _run_module_as_main\n return _run_code(code, main_globals, None,\n File \"/usr/local/lib/python3.8/runpy.py\", line 87, in _run_code\n exec(code, run_globals)\n File \"/usr/local/lib/python3.8/site-packages/secretflow/kuscia/entry.py\", line 294, in \u003cmodule\u003e\n main()\n File \"/usr/local/lib/python3.8/site-packages/click/core.py\", line 1157, in call\n return self.main(args, kwargs)\n File \"/usr/local/lib/python3.8/site-packages/click/core.py\", line 1078, in main\n rv = self.invoke(ctx)\n File \"/usr/local/lib/python3.8/site-packages/click/core.py\", line 1434, in invoke\n return ctx.invoke(self.callback, ctx.params)\n File \"/usr/local/lib/python3.8/site-packages/click/core.py\", line 783, in invoke\n return __callback(args, **kwargs)\n File \"/usr/local/lib/python3.8/site-packages/secretflow/kuscia/entry.py\", line 261, in main\n sf_node_eval_param = preprocess_sf_node_eval_param(\n File \"/usr/local/lib/python3.8/site-packages/secretflow/kuscia/entry.py\", line 92, in preprocess_sf_node_eval_param\n comp_def = get_comp_def(param.domain, param.name, param.version)\n File \"/usr/local/lib/python3.8/site-packages/secretflow/component/entry.py\", line 104, in get_comp_def\n assert key in COMP_MAP\nAssertionError\n","reason":"Error","startedAt":"2024-03-02T05:57:54Z"}}}]}}
在alice、bob服务器分别增加脚本 docker exec -it root-kuscia-lite-alice sh scripts/deploy/init_kusciaapi_client_certs.sh docker cp root-kuscia-lite-alice:/home/kuscia/var/certs/kusciaapi-client.crt ./certs/client.crt docker cp root-kuscia-lite-alice:/home/kuscia/var/certs/kusciaapi-client.key ./certs/client.pem docker cp root-kuscia-lite-alice:/home/kuscia/var/certs/token ./certs/token docker cp root-kuscia-lite-alice:/home/kuscia/var/certs/ca.crt ./certs/ca.crt sudo scp ./certs/* app@192.168.50.192:/home/app/project/secretpad/temps/certs/alice
Chrisdehe
gshilei
haha-zwx-ooo
copy kuscia api lite:alice client certs
copy_kuscia_api_lite_client_certs ${ALICE_DOMAIN} ${volume_path}
copy kuscia api lite:bob client certs
copy_kuscia_api_lite_client_certs ${BOB_DOMAIN} ${volume_path} 获取证书是从当前服务器获取的 function copy_kuscia_api_lite_client_certs() { local domain_id=$1 local volume_path=$2 local IMAGE=$SECRETPAD_IMAGE local domain_ctr=${CTR_PREFIX}-lite-${domain_id}
generate client certs
docker exec -it ${domain_ctr} sh scripts/deploy/init_kusciaapi_client_certs.sh
copy result
tmp_path=${volume_path}/temps/certs/${domain_id} mkdir -p ${tmp_path} docker cp ${domain_ctr}:/${CTR_CERT_ROOT}/ca.crt ${tmp_path}/ca.crt docker cp ${domain_ctr}:/${CTR_CERT_ROOT}/kusciaapi-client.crt ${tmp_path}/client.crt docker cp ${domain_ctr}:/${CTR_CERT_ROOT}/kusciaapi-client.key ${tmp_path}/client.pem docker cp ${domain_ctr}:/${CTR_CERT_ROOT}/token ${tmp_path}/token docker run -d --rm --name ${CTR_PREFIX}-dummy --volume=${volume_path}/secretpad/config/certs:/tmp/temp $IMAGE tail -f /dev/null >/dev/null 2>&1 docker cp -a ${tmp_path} ${CTR_PREFIX}-dummy:/tmp/temp/ docker rm -f ${CTR_PREFIX}-dummy >/dev/null 2>&1 rm -rf ${volume_path}/temp log "copy kuscia api client lite :${domain_id} certs to web server container done" }