search

secretflow / kuscia

Kuscia(Kubernetes-based Secure Collaborative InfrA) is a K8s-based privacy-preserving computing task orchestration framework.
https://www.secretflow.org.cn/docs/kuscia/latest/zh-Hans
Apache License 2.0
73 stars 55 forks source link

onehot_encode失败 #374

Closed T-ze-yu closed 2 weeks ago

T-ze-yu commented 4 months ago

Issue Type

Running

Search for existing issues similar to yours

Yes

OS Platform and Distribution

Linux 20.04.1-Ubuntu

Kuscia Version

kuscia 0.8.0b0

Deployment

docker

deployment Version

Docker version 24.0.5

App Running type

secretflow

App Running version

secretflow 1.6.1b0

Configuration file used to run kuscia.

mode: autonomy
domainID: p169
domainKeyData: LS0tLS1CRUdJTiBSU0EgUFJJVkFURSBLRVktLS0tLQpNSUlFcEFJQkFBS0NBUUVBNmRHSEkwcmM5ZHR5T2FlQnlsb3dNRkpTYW84ZWFkSThVWXVVNFF1WG53MlFkVmJ2ClRGVE1LR2NKeWozemMrbUdIR0p0RG9MTnlQN0dFVFd2cW1iZGpjMGxyOVBNcFRRWVhtN1RUSFEzcVpNZERyMUcKeDNQdkhGcjNQMlVYbjhhNUh2Y1VGYzFaa2w2R1pwVm5zNWpKdkY0YzgvYVpYNjUrZnBJS3cvclNKT2ZZV1k3bgpKckF4M3dzQUJsbllzMG10U0lqMXEzdW9tRWRCQTVrSk9HQ285TnR0LzNJeE12N3F2b2VvNFdKWldxTCtTcmM0CkpHRDRpQ2ZIZVVnb3p3d0NXUklaZGdyOGtZd2xFb0lnYUpUdkk4aWZxK1ZkaXNNeTZOOGlXSmxpQXVBSkp5RFYKdVJ4ZVBqeUEyaU1tbER4Ny91aXZwaFc3ZW42cjBmR3QyZ1NWelFJREFRQUJBb0lCQUNGMVRDTXV1VU90TFVFMgp5UW5Oc2d1WUhCY0hkOUNvdHR6c1hsZDlzeXFkWkVpR01pUDRGbWJKcDhyNjVuVjF1eTBnb0g1dEZVbG51NndHCnhLWmJwZVIrc0ovaWJPeE84aFhCUWhjMG9pcHYxTDZoTXhtamExbmhZblA5NFUySndEL0FGMjJ2UHR3RkRySnIKT3JXbWJXZTVCK2VaS0FWYkVOckh4eWFZSTY0SUFSWTNKYTdPTFA2N1VWSExZUElEV0RPRlppSVdKRjFBblZuMwowMWVpUitJMFZFaHBDZlA3ZTNpSWlETFFWT3diWno3bnFDbVhIeUd3aW1BWTdpWms3VzRaejhWdkVpRTFhMUxFCnRsbjFsSjkwYlpGVmo3dnJlU3EraW51M3gwMzA5YTNXOWhpSTZmZ0czMm84dnpTR1UwTmhHem8zN3pEU0N0d1QKTnRmZi9ya0NnWUVBOWZ6ckwvbVNSek82U3NLL3B5TnNkNGM5R3FpTnA1TGNCcWUreURzbWlrODg2dklDWXE2ZApZVTJ1aG1pbkV0Z1ZYcDlSVUVkUjF2b1k2VU41Y1hJellxc0FIZSt5VjgwNm8yTmhyNExaZjI1UDBYLzYzZHh4CldCeWhESXZKaUNhVjk0MC9BMThsanJiQ1MvOEFOVHA2ZktybFc1Mm03aGNjWmYrdzg5VjZLUE1DZ1lFQTgxWFAKQTBpL0NOWUFMWUltYmlBWk5IbkpZWDYrNEIzTDVwZkVSVU1zczhvalZKSTdmbk9pcjBaN1Vha0l6d3JReTFaNgpFN2w3YmZlTDFnN1lVWUZYWm05NE1JRGRHdWVaZ1FZWTBsVXFDQnk5RTYyMjBtaG5jZW5KYjFTSHM3U0pUUHJGCnRPSW5PVE44WjlGMzlyaU1qY2JmWXpxaEdlazRJaXJBTHRLNTlqOENnWUFJQmxvOTFHeDdPaXJIcVpiTEF4TFUKeTJxbzVmckpEcmR5MkNJWE1pYk51RXdLZGg2eHpYU0E2aUhaYkt5V3Bzbjdya0xlMVpUTDZKakxjMUlRNjJMVgp3ekpieDZnUHlUZ3lnRmw5ZWsxU0pPMGhyb1VtbTd4dTNYQTdrb3ZlanpPeFFjQmVnY29kMzhSeTZqeTlmOHpqCktFZ1hOd3R0RlAvdUsrcy82U1QxRlFLQmdRRHkzUmZxVFRidG1MbEFzbitzdGppeDJVT1hIU3RoQUJ3OElBbHkKbjZNRUpxR3dqT3I0UUcyRXhySGFSUDFYdDVIQkFLU0MvME1qOUVnSzgzSVBseW9tUU9jU2NlczhLUjlhV1QxNAo0Q3M5UVlHdEhGbzJFcUg4WGJ3QWM3dWxMbkZDOVo5Ujg4MzJGMTc1TjJXbVIzZHhJYVpmb1dxZE05b2tyOHAwCmNUbk5mUUtCZ1FEUHVjc2tmQmNRQ1hQZ0toOTBqa2E3b3E2SmtJcGZ4WE1KN1hKakw5NS8xNkRndFh2bSs4M3UKMWpjczBINzFsbGtQMS9WRjBWM1VPaDVrUDB4cHlqTnZLTVBTYXY2TVB2ckdad0NvY1dRelhJcG9aelJaNmxlMgpwMVB4NzVKMHNhZEFsc1VQZEJBRVZhOFFJVkxKU2R0K0N2by9udzl0ajljQm1EZjA2U0NPelE9PQotLS0tLUVORCBSU0EgUFJJVkFURSBLRVktLS0tLQo=
logLevel: INFO
runtime: runc
runk:
  namespace: ""
  dnsServers: []
  kubeconfigFile: ""
capacity:
  cpu: ""
  memory: ""
  pods: ""
  storage: ""
image:
  pullPolicy: ""
  defaultRegistry: ""
  registries: []
datastoreEndpoint: ""

What happend and What you expected to happen.

/job/create请求参数如下：
{'job_id': 'aqaecyndy8vhi75p', 'initiator': 'p169', 'max_parallelism': 1, 'tasks': [{'app_image': 'secretflow-image', 'parties': [{'domain_id': 'p169'}, {'domain_id': 'p170'}], 'alias': 'OnehotEncode', 'task_id': 'jaf4vv5bhka06ugr', 'task_input_config': '{"sf_datasource_config": {"p169": {"id": "default-data-source"}, "p170": {"id": "default-data-source"}}, "sf_cluster_desc": {"parties": ["p169", "p170"], "devices": [{"name": "spu", "type": "spu", "parties": ["p169", "p170"], "config": "{\\"runtime_config\\":{\\"protocol\\":\\"REF2K\\",\\"field\\":\\"FM64\\"},\\"link_desc\\":{\\"connect_retry_times\\":60,\\"connect_retry_interval_ms\\":1000,\\"brpc_channel_protocol\\":\\"http\\",\\"brpc_channel_connection_type\\":\\"pooled\\",\\"recv_timeout_ms\\":1200000,\\"http_timeout_ms\\":1200000}}"}, {"name": "heu", "type": "heu", "parties": ["p169", "p170"], "config": "{\\"mode\\": \\"PHEU\\", \\"schema\\": \\"paillier\\", \\"key_size\\": 2048}"}], "ray_fed_config": {"cross_silo_comm_backend": "brpc_link"}}, "sf_node_eval_param": {"domain": "preprocessing", "name": "onehot_encode", "version": "0.0.3", "attr_paths": ["input/input_data/feature_selects", "drop", "min_frequency", "report_rules"], "attrs": [{"ss": ["kasieg_11", "kasieg_12", "kasieg_13", "kasieg_14", "kasieg_15", "kasieg_16", "kasieg_17", "kasieg_18", "kasieg_19", "kasieg_20", "kasieg_1", "kasieg_2", "kasieg_3", "kasieg_4", "kasieg_5", "kasieg_6", "kasieg_7", "kasieg_8", "kasieg_9", "kasieg_10"]}, {"s": "no_drop"}, {"f": 0}, {"b": true}]}, "sf_input_ids": ["e1449345-psi-dataset"], "sf_output_ids": ["95bd2be9-output_dataset", "95bd2be9-onehot_rules", "95bd2be9-report"], "sf_output_uris": ["jobs/202407101638466494640/95bd2be9-output_dataset", "jobs/202407101638466494640/95bd2be9-onehot_rules", "jobs/202407101638466494640/95bd2be9-report"]}', 'priority': '100'}, {'app_image': 'secretflow-image', 'parties': [{'domain_id': 'p169'}, {'domain_id': 'p170'}], 'alias': 'Substitution', 'task_id': 'f2pw3ctyedox29h2', 'task_input_config': '{"sf_datasource_config": {"p169": {"id": "default-data-source"}, "p170": {"id": "default-data-source"}}, "sf_cluster_desc": {"parties": ["p169", "p170"], "devices": [{"name": "spu", "type": "spu", "parties": ["p169", "p170"], "config": "{\\"runtime_config\\":{\\"protocol\\":\\"REF2K\\",\\"field\\":\\"FM64\\"},\\"link_desc\\":{\\"connect_retry_times\\":60,\\"connect_retry_interval_ms\\":1000,\\"brpc_channel_protocol\\":\\"http\\",\\"brpc_channel_connection_type\\":\\"pooled\\",\\"recv_timeout_ms\\":1200000,\\"http_timeout_ms\\":1200000}}"}, {"name": "heu", "type": "heu", "parties": ["p169", "p170"], "config": "{\\"mode\\": \\"PHEU\\", \\"schema\\": \\"paillier\\", \\"key_size\\": 2048}"}], "ray_fed_config": {"cross_silo_comm_backend": "brpc_link"}}, "sf_node_eval_param": {"domain": "preprocessing", "name": "substitution", "version": "0.0.2", "attr_paths": [], "attrs": []}, "sf_input_ids": ["95bd2be9-output_dataset", "e1449345-psi-dataset"], "sf_output_ids": ["95bd2be9-substitution-dataset"], "sf_output_uris": ["jobs/202407101638466494640/95bd2be9-substitution-dataset"]}', 'priority': '100'}]}
希望onehot_encode运行成功

Kuscia log output.

2024-07-10T18:51:37.724884316+08:00 stderr F WARNING:root:Since the GPL-licensed package `unidecode` is not installed, using Python's `unicodedata` package which yields worse results.
2024-07-10T18:51:38.433441838+08:00 stdout F 2024-07-10 10:51:38,432|p169|INFO|secretflow|entry.py:start_ray:59| ray_conf: RayConfig(ray_node_ip_address='jaf4vv5bhka06ugr-0-global.p169.svc', ray_node_manager_port=31470, ray_object_manager_port=31471, ray_client_server_port=31472, ray_worker_ports=[], ray_gcs_port=31475)
2024-07-10T18:51:38.433516254+08:00 stdout F 2024-07-10 10:51:38,432|p169|INFO|secretflow|entry.py:start_ray:63| Trying to start ray head node at jaf4vv5bhka06ugr-0-global.p169.svc, start command: RAY_BACKEND_LOG_LEVEL=debug RAY_grpc_enable_http_proxy=true OMP_NUM_THREADS=4 ray start --head --include-dashboard=false --disable-usage-stats --num-cpus=32 --node-ip-address=jaf4vv5bhka06ugr-0-global.p169.svc --port=31475 --node-manager-port=31470 --object-manager-port=31471 --ray-client-server-port=31472
2024-07-10T18:51:41.15345814+08:00 stdout F 2024-07-10 10:51:41,152|p169|INFO|secretflow|entry.py:start_ray:80| 2024-07-10 10:51:39,041 INFO usage_lib.py:423 -- Usage stats collection is disabled.
2024-07-10T18:51:41.153477371+08:00 stdout F 2024-07-10 10:51:39,041    INFO scripts.py:744 -- Local node IP: jaf4vv5bhka06ugr-0-global.p169.svc
2024-07-10T18:51:41.153481538+08:00 stdout F 2024-07-10 10:51:40,988    SUCC scripts.py:781 -- --------------------
2024-07-10T18:51:41.153483986+08:00 stdout F 2024-07-10 10:51:40,988    SUCC scripts.py:782 -- Ray runtime started.
2024-07-10T18:51:41.153497457+08:00 stdout F 2024-07-10 10:51:40,988    SUCC scripts.py:783 -- --------------------
2024-07-10T18:51:41.153501952+08:00 stdout F 2024-07-10 10:51:40,989    INFO scripts.py:785 -- Next steps
2024-07-10T18:51:41.153504316+08:00 stdout F 2024-07-10 10:51:40,989    INFO scripts.py:788 -- To add another node to this Ray cluster, run
2024-07-10T18:51:41.153507589+08:00 stdout F 2024-07-10 10:51:40,989    INFO scripts.py:791 --   ray start --address='jaf4vv5bhka06ugr-0-global.p169.svc:31475'
2024-07-10T18:51:41.153510028+08:00 stdout F 2024-07-10 10:51:40,989    INFO scripts.py:800 -- To connect to this Ray cluster:
2024-07-10T18:51:41.153512303+08:00 stdout F 2024-07-10 10:51:40,989    INFO scripts.py:802 -- import ray
2024-07-10T18:51:41.153515033+08:00 stdout F 2024-07-10 10:51:40,989    INFO scripts.py:803 -- ray.init(_node_ip_address='jaf4vv5bhka06ugr-0-global.p169.svc')
2024-07-10T18:51:41.153517318+08:00 stdout F 2024-07-10 10:51:40,989    INFO scripts.py:834 -- To terminate the Ray runtime, run
2024-07-10T18:51:41.153519517+08:00 stdout F 2024-07-10 10:51:40,989    INFO scripts.py:835 --   ray stop
2024-07-10T18:51:41.153521858+08:00 stdout F 2024-07-10 10:51:40,989    INFO scripts.py:838 -- To view the status of the cluster, use
2024-07-10T18:51:41.153524081+08:00 stdout F 2024-07-10 10:51:40,989    INFO scripts.py:839 --   ray status
2024-07-10T18:51:41.153526177+08:00 stdout F 
2024-07-10T18:51:41.1535295+08:00 stdout F 2024-07-10 10:51:41,152|p169|INFO|secretflow|entry.py:start_ray:81| Succeeded to start ray head node at jaf4vv5bhka06ugr-0-global.p169.svc.
2024-07-10T18:51:41.153531965+08:00 stdout F 2024-07-10 10:51:41,152|p169|INFO|secretflow|entry.py:main:510| datasource.access_directly True
2024-07-10T18:51:41.153534623+08:00 stdout F sf_node_eval_param  {
2024-07-10T18:51:41.153538305+08:00 stdout F   "domain": "preprocessing",
2024-07-10T18:51:41.153540611+08:00 stdout F   "name": "onehot_encode",
2024-07-10T18:51:41.153542732+08:00 stdout F   "version": "0.0.3",
2024-07-10T18:51:41.153544997+08:00 stdout F   "attrPaths": [
2024-07-10T18:51:41.153548005+08:00 stdout F     "input/input_data/feature_selects",
2024-07-10T18:51:41.153550284+08:00 stdout F     "drop",
2024-07-10T18:51:41.153552543+08:00 stdout F     "min_frequency",
2024-07-10T18:51:41.153554718+08:00 stdout F     "report_rules"
2024-07-10T18:51:41.153556895+08:00 stdout F   ],
2024-07-10T18:51:41.153559177+08:00 stdout F   "attrs": [
2024-07-10T18:51:41.153561378+08:00 stdout F     {
2024-07-10T18:51:41.153563605+08:00 stdout F       "ss": [
2024-07-10T18:51:41.153574194+08:00 stdout F         "kasieg_11",
2024-07-10T18:51:41.153576697+08:00 stdout F         "kasieg_12",
2024-07-10T18:51:41.153579226+08:00 stdout F         "kasieg_13",
2024-07-10T18:51:41.153581407+08:00 stdout F         "kasieg_14",
2024-07-10T18:51:41.153583572+08:00 stdout F         "kasieg_15",
2024-07-10T18:51:41.153585931+08:00 stdout F         "kasieg_16",
2024-07-10T18:51:41.153588175+08:00 stdout F         "kasieg_17",
2024-07-10T18:51:41.153590369+08:00 stdout F         "kasieg_18",
2024-07-10T18:51:41.153592505+08:00 stdout F         "kasieg_19",
2024-07-10T18:51:41.153594693+08:00 stdout F         "kasieg_20",
2024-07-10T18:51:41.15359693+08:00 stdout F         "kasieg_1",
2024-07-10T18:51:41.153599102+08:00 stdout F         "kasieg_2",
2024-07-10T18:51:41.153601586+08:00 stdout F         "kasieg_3",
2024-07-10T18:51:41.153603755+08:00 stdout F         "kasieg_4",
2024-07-10T18:51:41.15360596+08:00 stdout F         "kasieg_5",
2024-07-10T18:51:41.153608194+08:00 stdout F         "kasieg_6",
2024-07-10T18:51:41.15361041+08:00 stdout F         "kasieg_7",
2024-07-10T18:51:41.153612577+08:00 stdout F         "kasieg_8",
2024-07-10T18:51:41.153614839+08:00 stdout F         "kasieg_9",
2024-07-10T18:51:41.153617046+08:00 stdout F         "kasieg_10"
2024-07-10T18:51:41.15361919+08:00 stdout F       ]
2024-07-10T18:51:41.153621487+08:00 stdout F     },
2024-07-10T18:51:41.153829208+08:00 stdout F     {
2024-07-10T18:51:41.153833217+08:00 stdout F       "s": "no_drop"
2024-07-10T18:51:41.153835534+08:00 stdout F     },
2024-07-10T18:51:41.153837923+08:00 stdout F     {},
2024-07-10T18:51:41.153840178+08:00 stdout F     {
2024-07-10T18:51:41.153842462+08:00 stdout F       "b": true
2024-07-10T18:51:41.153844749+08:00 stdout F     }
2024-07-10T18:51:41.153847004+08:00 stdout F   ]
2024-07-10T18:51:41.153849383+08:00 stdout F } 
2024-07-10T18:51:41.17003918+08:00 stdout F 2024-07-10 10:51:41,169|p169|INFO|secretflow|entry.py:domaindata_id_to_dist_data:160| domaindata_id e1449345-psi-dataset to 
2024-07-10T18:51:41.170070859+08:00 stdout F ...........
2024-07-10T18:51:41.170077362+08:00 stdout F name: "jobs/202407101638466494640/e1449345-psi-dataset"
2024-07-10T18:51:41.170082447+08:00 stdout F type: "sf.table.vertical_table"
2024-07-10T18:51:41.170086295+08:00 stdout F system_info {
2024-07-10T18:51:41.17009023+08:00 stdout F }
2024-07-10T18:51:41.170094095+08:00 stdout F meta {
2024-07-10T18:51:41.170099545+08:00 stdout F   type_url: "type.googleapis.com/secretflow.spec.v1.VerticalTable"
2024-07-10T18:51:41.170104605+08:00 stdout F   value: "\n\310\001\n\003id2\022\tkasieg_11\022\tkasieg_12\022\tkasieg_13\022\tkasieg_14\022\tkasieg_15\022\tkasieg_16\022\tkasieg_17\022\tkasieg_18\022\tkasieg_19\022\tkasieg_20\022\001y\"\003int*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float\n\265\001\n\003id1\022\010kasieg_1\022\010kasieg_2\022\010kasieg_3\022\010kasieg_4\022\010kasieg_5\022\010kasieg_6\022\010kasieg_7\022\010kasieg_8\022\010kasieg_9\022\tkasieg_10\"\003int*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float\020\350\007"
2024-07-10T18:51:41.170108688+08:00 stdout F }
2024-07-10T18:51:41.170112475+08:00 stdout F data_refs {
2024-07-10T18:51:41.170116408+08:00 stdout F   uri: "jobs/202407101638466494640/e1449345-psi-dataset"
2024-07-10T18:51:41.170120444+08:00 stdout F   party: "p169"
2024-07-10T18:51:41.170124245+08:00 stdout F   format: "csv"
2024-07-10T18:51:41.170127931+08:00 stdout F }
2024-07-10T18:51:41.170131918+08:00 stdout F data_refs {
2024-07-10T18:51:41.170135657+08:00 stdout F   uri: "jobs/202407101638466494640/e1449345-psi-dataset"
2024-07-10T18:51:41.17013939+08:00 stdout F   party: "p170"
2024-07-10T18:51:41.170143316+08:00 stdout F   format: "csv"
2024-07-10T18:51:41.170147011+08:00 stdout F }
2024-07-10T18:51:41.170150546+08:00 stdout F 
2024-07-10T18:51:41.170154319+08:00 stdout F ....
2024-07-10T18:51:41.177938203+08:00 stderr F 2024-07-10 10:51:41,171    INFO worker.py:1540 -- Connecting to existing Ray cluster at address: jaf4vv5bhka06ugr-0-global.p169.svc:31475...
2024-07-10T18:51:41.177981066+08:00 stdout F 2024-07-10 10:51:41,170|p169|WARNING|secretflow|entry.py:comp_eval:159| 
2024-07-10T18:51:41.177985316+08:00 stdout F --
2024-07-10T18:51:41.177988497+08:00 stdout F Secretflow 1.6.1b0
2024-07-10T18:51:41.177992137+08:00 stdout F Build time (May 27 2024, 04:48:06) with commit id: eac355f390d9d0d7276ee4cea8d1fe38417cabb6
2024-07-10T18:51:41.177994425+08:00 stdout F --
2024-07-10T18:51:41.177996533+08:00 stdout F 
2024-07-10T18:51:41.177998842+08:00 stdout F 2024-07-10 10:51:41,170|p169|WARNING|secretflow|entry.py:comp_eval:160| 
2024-07-10T18:51:41.178001479+08:00 stdout F --
2024-07-10T18:51:41.17800402+08:00 stdout F *param* 
2024-07-10T18:51:41.17800615+08:00 stdout F 
2024-07-10T18:51:41.178008439+08:00 stdout F domain: "preprocessing"
2024-07-10T18:51:41.178010676+08:00 stdout F name: "onehot_encode"
2024-07-10T18:51:41.178012965+08:00 stdout F version: "0.0.3"
2024-07-10T18:51:41.178016124+08:00 stdout F attr_paths: "input/input_data/feature_selects"
2024-07-10T18:51:41.178018376+08:00 stdout F attr_paths: "drop"
2024-07-10T18:51:41.178021519+08:00 stdout F attr_paths: "min_frequency"
2024-07-10T18:51:41.178023784+08:00 stdout F attr_paths: "report_rules"
2024-07-10T18:51:41.178026047+08:00 stdout F attrs {
2024-07-10T18:51:41.178028388+08:00 stdout F   ss: "kasieg_11"
2024-07-10T18:51:41.178030749+08:00 stdout F   ss: "kasieg_12"
2024-07-10T18:51:41.178033125+08:00 stdout F   ss: "kasieg_13"
2024-07-10T18:51:41.17803539+08:00 stdout F   ss: "kasieg_14"
2024-07-10T18:51:41.178037599+08:00 stdout F   ss: "kasieg_15"
2024-07-10T18:51:41.178039848+08:00 stdout F   ss: "kasieg_16"
2024-07-10T18:51:41.178042168+08:00 stdout F   ss: "kasieg_17"
2024-07-10T18:51:41.17804444+08:00 stdout F   ss: "kasieg_18"
2024-07-10T18:51:41.178047121+08:00 stdout F   ss: "kasieg_19"
2024-07-10T18:51:41.178049936+08:00 stdout F   ss: "kasieg_20"
2024-07-10T18:51:41.178052289+08:00 stdout F   ss: "kasieg_1"
2024-07-10T18:51:41.178054545+08:00 stdout F   ss: "kasieg_2"
2024-07-10T18:51:41.178056769+08:00 stdout F   ss: "kasieg_3"
2024-07-10T18:51:41.178058913+08:00 stdout F   ss: "kasieg_4"
2024-07-10T18:51:41.178061099+08:00 stdout F   ss: "kasieg_5"
2024-07-10T18:51:41.178063323+08:00 stdout F   ss: "kasieg_6"
2024-07-10T18:51:41.178065543+08:00 stdout F   ss: "kasieg_7"
2024-07-10T18:51:41.178067663+08:00 stdout F   ss: "kasieg_8"
2024-07-10T18:51:41.178069871+08:00 stdout F   ss: "kasieg_9"
2024-07-10T18:51:41.178072064+08:00 stdout F   ss: "kasieg_10"
2024-07-10T18:51:41.178074271+08:00 stdout F }
2024-07-10T18:51:41.178076477+08:00 stdout F attrs {
2024-07-10T18:51:41.178078679+08:00 stdout F   s: "no_drop"
2024-07-10T18:51:41.178080871+08:00 stdout F }
2024-07-10T18:51:41.178083097+08:00 stdout F attrs {
2024-07-10T18:51:41.178085266+08:00 stdout F }
2024-07-10T18:51:41.178087432+08:00 stdout F attrs {
2024-07-10T18:51:41.178089668+08:00 stdout F   b: true
2024-07-10T18:51:41.178091828+08:00 stdout F }
2024-07-10T18:51:41.17809401+08:00 stdout F inputs {
2024-07-10T18:51:41.178097125+08:00 stdout F   name: "jobs/202407101638466494640/e1449345-psi-dataset"
2024-07-10T18:51:41.178099477+08:00 stdout F   type: "sf.table.vertical_table"
2024-07-10T18:51:41.178101734+08:00 stdout F   system_info {
2024-07-10T18:51:41.178103919+08:00 stdout F   }
2024-07-10T18:51:41.178106085+08:00 stdout F   meta {
2024-07-10T18:51:41.178108341+08:00 stdout F     type_url: "type.googleapis.com/secretflow.spec.v1.VerticalTable"
2024-07-10T18:51:41.178111548+08:00 stdout F     value: "\n\310\001\n\003id2\022\tkasieg_11\022\tkasieg_12\022\tkasieg_13\022\tkasieg_14\022\tkasieg_15\022\tkasieg_16\022\tkasieg_17\022\tkasieg_18\022\tkasieg_19\022\tkasieg_20\022\001y\"\003int*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float\n\265\001\n\003id1\022\010kasieg_1\022\010kasieg_2\022\010kasieg_3\022\010kasieg_4\022\010kasieg_5\022\010kasieg_6\022\010kasieg_7\022\010kasieg_8\022\010kasieg_9\022\tkasieg_10\"\003int*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float\020\350\007"
2024-07-10T18:51:41.178116342+08:00 stdout F   }
2024-07-10T18:51:41.178118701+08:00 stdout F   data_refs {
2024-07-10T18:51:41.178121025+08:00 stdout F     uri: "jobs/202407101638466494640/e1449345-psi-dataset"
2024-07-10T18:51:41.178123334+08:00 stdout F     party: "p169"
2024-07-10T18:51:41.178125586+08:00 stdout F     format: "csv"
2024-07-10T18:51:41.178127763+08:00 stdout F   }
2024-07-10T18:51:41.178130003+08:00 stdout F   data_refs {
2024-07-10T18:51:41.178132267+08:00 stdout F     uri: "jobs/202407101638466494640/e1449345-psi-dataset"
2024-07-10T18:51:41.178134486+08:00 stdout F     party: "p170"
2024-07-10T18:51:41.178136794+08:00 stdout F     format: "csv"
2024-07-10T18:51:41.178138971+08:00 stdout F   }
2024-07-10T18:51:41.178141188+08:00 stdout F }
2024-07-10T18:51:41.178143466+08:00 stdout F output_uris: "jobs/202407101638466494640/95bd2be9-output_dataset"
2024-07-10T18:51:41.178145726+08:00 stdout F output_uris: "jobs/202407101638466494640/95bd2be9-onehot_rules"
2024-07-10T18:51:41.178147956+08:00 stdout F output_uris: "jobs/202407101638466494640/95bd2be9-report"
2024-07-10T18:51:41.178149978+08:00 stdout F 
2024-07-10T18:51:41.178152211+08:00 stdout F --
2024-07-10T18:51:41.178154257+08:00 stdout F 
2024-07-10T18:51:41.178156509+08:00 stdout F 2024-07-10 10:51:41,170|p169|WARNING|secretflow|entry.py:comp_eval:161| 
2024-07-10T18:51:41.178158743+08:00 stdout F --
2024-07-10T18:51:41.178161007+08:00 stdout F *storage_config* 
2024-07-10T18:51:41.178163041+08:00 stdout F 
2024-07-10T18:51:41.178165195+08:00 stdout F type: "local_fs"
2024-07-10T18:51:41.178167411+08:00 stdout F local_fs {
2024-07-10T18:51:41.178169655+08:00 stdout F   wd: "/home/kuscia/var/storage/data"
2024-07-10T18:51:41.17817184+08:00 stdout F }
2024-07-10T18:51:41.17817391+08:00 stdout F 
2024-07-10T18:51:41.178176129+08:00 stdout F --
2024-07-10T18:51:41.178178187+08:00 stdout F 
2024-07-10T18:51:41.178180446+08:00 stdout F 2024-07-10 10:51:41,170|p169|WARNING|secretflow|entry.py:comp_eval:162| 
2024-07-10T18:51:41.178182627+08:00 stdout F --
2024-07-10T18:51:41.178184807+08:00 stdout F *cluster_config* 
2024-07-10T18:51:41.178186822+08:00 stdout F 
2024-07-10T18:51:41.178189002+08:00 stdout F desc {
2024-07-10T18:51:41.178191204+08:00 stdout F   parties: "p169"
2024-07-10T18:51:41.17819347+08:00 stdout F   parties: "p170"
2024-07-10T18:51:41.17819613+08:00 stdout F   devices {
2024-07-10T18:51:41.178198353+08:00 stdout F     name: "spu"
2024-07-10T18:51:41.178200588+08:00 stdout F     type: "spu"
2024-07-10T18:51:41.178202789+08:00 stdout F     parties: "p169"
2024-07-10T18:51:41.178205068+08:00 stdout F     parties: "p170"
2024-07-10T18:51:41.178208426+08:00 stdout F     config: "{\"runtime_config\":{\"protocol\":\"REF2K\",\"field\":\"FM64\"},\"link_desc\":{\"connect_retry_times\":60,\"connect_retry_interval_ms\":1000,\"brpc_channel_protocol\":\"http\",\"brpc_channel_connection_type\":\"pooled\",\"recv_timeout_ms\":1200000,\"http_timeout_ms\":1200000}}"
2024-07-10T18:51:41.178210682+08:00 stdout F   }
2024-07-10T18:51:41.178212975+08:00 stdout F   devices {
2024-07-10T18:51:41.178215198+08:00 stdout F     name: "heu"
2024-07-10T18:51:41.178217381+08:00 stdout F     type: "heu"
2024-07-10T18:51:41.178219952+08:00 stdout F     parties: "p169"
2024-07-10T18:51:41.178222116+08:00 stdout F     parties: "p170"
2024-07-10T18:51:41.17822434+08:00 stdout F     config: "{\"mode\": \"PHEU\", \"schema\": \"paillier\", \"key_size\": 2048}"
2024-07-10T18:51:41.178226574+08:00 stdout F   }
2024-07-10T18:51:41.178228823+08:00 stdout F   ray_fed_config {
2024-07-10T18:51:41.178231104+08:00 stdout F     cross_silo_comm_backend: "brpc_link"
2024-07-10T18:51:41.178233298+08:00 stdout F   }
2024-07-10T18:51:41.178235463+08:00 stdout F }
2024-07-10T18:51:41.178239047+08:00 stdout F public_config {
2024-07-10T18:51:41.178241239+08:00 stdout F   ray_fed_config {
2024-07-10T18:51:41.178245492+08:00 stdout F     parties: "p169"
2024-07-10T18:51:41.178247787+08:00 stdout F     parties: "p170"
2024-07-10T18:51:41.178250007+08:00 stdout F     addresses: "0.0.0.0:31474"
2024-07-10T18:51:41.17825229+08:00 stdout F     addresses: "jaf4vv5bhka06ugr-0-fed.p170.svc:80"
2024-07-10T18:51:41.178254504+08:00 stdout F   }
2024-07-10T18:51:41.178256682+08:00 stdout F   spu_configs {
2024-07-10T18:51:41.178258967+08:00 stdout F     name: "spu"
2024-07-10T18:51:41.178261153+08:00 stdout F     parties: "p169"
2024-07-10T18:51:41.178263379+08:00 stdout F     parties: "p170"
2024-07-10T18:51:41.178265609+08:00 stdout F     addresses: "0.0.0.0:31473"
2024-07-10T18:51:41.178267854+08:00 stdout F     addresses: "http://jaf4vv5bhka06ugr-0-spu.p170.svc:80"
2024-07-10T18:51:41.178270083+08:00 stdout F   }
2024-07-10T18:51:41.178272532+08:00 stdout F }
2024-07-10T18:51:41.178274775+08:00 stdout F private_config {
2024-07-10T18:51:41.178276915+08:00 stdout F   self_party: "p169"
2024-07-10T18:51:41.178279139+08:00 stdout F   ray_head_addr: "jaf4vv5bhka06ugr-0-global.p169.svc:31475"
2024-07-10T18:51:41.178281387+08:00 stdout F }
2024-07-10T18:51:41.178283439+08:00 stdout F 
2024-07-10T18:51:41.178285559+08:00 stdout F --
2024-07-10T18:51:41.17828765+08:00 stdout F 
2024-07-10T18:51:41.17829104+08:00 stdout F 2024-07-10 10:51:41,170|p169|WARNING|secretflow|driver.py:init:442| When connecting to an existing cluster, num_cpus must not be provided. Num_cpus is neglected at this moment.
2024-07-10T18:51:41.186607468+08:00 stdout F 2024-07-10 10:51:41,186|p169|DEBUG|secretflow|_api.py:acquire:294| Attempting to acquire lock 139746979755920 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/node_ip_address.json.lock
2024-07-10T18:51:41.187862675+08:00 stdout F 2024-07-10 10:51:41,186|p169|DEBUG|secretflow|_api.py:acquire:297| Lock 139746979755920 acquired on /tmp/ray/session_2024-07-10_10-51-39_042013_30/node_ip_address.json.lock
2024-07-10T18:51:41.187876463+08:00 stdout F 2024-07-10 10:51:41,187|p169|DEBUG|secretflow|_api.py:release:327| Attempting to release lock 139746979755920 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/node_ip_address.json.lock
2024-07-10T18:51:41.187884371+08:00 stdout F 2024-07-10 10:51:41,187|p169|DEBUG|secretflow|_api.py:release:330| Lock 139746979755920 released on /tmp/ray/session_2024-07-10_10-51-39_042013_30/node_ip_address.json.lock
2024-07-10T18:51:41.195553843+08:00 stdout F 2024-07-10 10:51:41,192|p169|DEBUG|secretflow|_api.py:acquire:294| Attempting to acquire lock 139746979755968 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195573688+08:00 stdout F 2024-07-10 10:51:41,192|p169|DEBUG|secretflow|_api.py:acquire:297| Lock 139746979755968 acquired on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195581728+08:00 stdout F 2024-07-10 10:51:41,192|p169|DEBUG|secretflow|_api.py:release:327| Attempting to release lock 139746979755968 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195584401+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:release:330| Lock 139746979755968 released on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195586743+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:acquire:294| Attempting to acquire lock 139746979755872 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195589549+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:acquire:297| Lock 139746979755872 acquired on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195591929+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:release:327| Attempting to release lock 139746979755872 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195594945+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:release:330| Lock 139746979755872 released on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195604959+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:acquire:294| Attempting to acquire lock 139746979756064 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195607665+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:acquire:297| Lock 139746979756064 acquired on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195610159+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:release:327| Attempting to release lock 139746979756064 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195612545+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:release:330| Lock 139746979756064 released on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195614879+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:acquire:294| Attempting to acquire lock 139746979755920 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195617116+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:acquire:297| Lock 139746979755920 acquired on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195619436+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:release:327| Attempting to release lock 139746979755920 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195621757+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:release:330| Lock 139746979755920 released on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195558636+08:00 stderr F 2024-07-10 10:51:41,193    INFO worker.py:1724 -- Connected to Ray cluster.
2024-07-10T18:51:41.87762114+08:00 stderr F 2024-07-10 10:51:41.877 INFO api.py:233 [p169] -- [Anonymous_job] Started rayfed with {'CLUSTER_ADDRESSES': {'p169': '0.0.0.0:31474', 'p170': 'http://jaf4vv5bhka06ugr-0-fed.p170.svc:80'}, 'CURRENT_PARTY_NAME': 'p169', 'TLS_CONFIG': {}}
2024-07-10T18:51:42.464577392+08:00 stderr F (raylet) [2024-07-10 10:51:42,374 I 322 322] logging.cc:230: Set ray log level from environment variable RAY_BACKEND_LOG_LEVEL to -1
2024-07-10T18:51:43.072568636+08:00 stderr F (SenderReceiverProxyActor pid=322) 2024-07-10 10:51:42.971 INFO link.py:38 [p169] -- [Anonymous_job] brpc options: {'proxy_max_restarts': 3, 'timeout_in_ms': 300000, 'recv_timeout_ms': 604800000, 'connect_retry_times': 3600, 'connect_retry_interval_ms': 1000, 'brpc_channel_protocol': 'http', 'brpc_channel_connection_type': 'pooled', 'exit_on_sending_failure': True}
2024-07-10T18:51:43.07260019+08:00 stderr F (SenderReceiverProxyActor pid=322) I0710 10:51:42.983831   322 external/com_github_brpc_brpc/src/brpc/server.cpp:1181] Server[yacl::link::transport::internal::ReceiverServiceImpl] is serving on port=31474.
2024-07-10T18:51:43.072604097+08:00 stderr F (SenderReceiverProxyActor pid=322) W0710 10:51:42.983860   322 external/com_github_brpc_brpc/src/brpc/server.cpp:1187] Builtin services are disabled according to ServerOptions.has_builtin_services
2024-07-10T18:51:44.058144081+08:00 stderr F 2024-07-10 10:51:44.057 INFO barriers.py:465 [p169] -- [Anonymous_job] Succeeded to create receiver proxy actor.
2024-07-10T18:51:44.058182269+08:00 stderr F 2024-07-10 10:51:44.058 INFO barriers.py:520 [p169] -- [Anonymous_job] Try ping ['p170'] at 0 attemp, up to 3600 attemps.
2024-07-10T18:51:44.067187907+08:00 stderr F 2024-07-10 10:51:44.066 INFO data_utils.py:391 [p169] -- [Anonymous_job] try load VDataFrame, file uri {'p169': DistdataInfo(uri='jobs/202407101638466494640/e1449345-psi-dataset', format='csv'), 'p170': DistdataInfo(uri='jobs/202407101638466494640/e1449345-psi-dataset', format='csv')}, file meta {}
2024-07-10T18:51:44.06809435+08:00 stderr F 2024-07-10 10:51:44.067 ERROR component.py:1129 [p169] -- [Anonymous_job] eval on domain: "preprocessing"
2024-07-10T18:51:44.068115884+08:00 stderr F name: "onehot_encode"
2024-07-10T18:51:44.068121081+08:00 stderr F version: "0.0.3"
2024-07-10T18:51:44.068125458+08:00 stderr F attr_paths: "input/input_data/feature_selects"
2024-07-10T18:51:44.068129318+08:00 stderr F attr_paths: "drop"
2024-07-10T18:51:44.068133575+08:00 stderr F attr_paths: "min_frequency"
2024-07-10T18:51:44.068144438+08:00 stderr F attr_paths: "report_rules"
2024-07-10T18:51:44.06814902+08:00 stderr F attrs {
2024-07-10T18:51:44.068153054+08:00 stderr F   ss: "kasieg_11"
2024-07-10T18:51:44.068156406+08:00 stderr F   ss: "kasieg_12"
2024-07-10T18:51:44.068159057+08:00 stderr F   ss: "kasieg_13"
2024-07-10T18:51:44.068161799+08:00 stderr F   ss: "kasieg_14"
2024-07-10T18:51:44.068164483+08:00 stderr F   ss: "kasieg_15"
2024-07-10T18:51:44.068167084+08:00 stderr F   ss: "kasieg_16"
2024-07-10T18:51:44.06816972+08:00 stderr F   ss: "kasieg_17"
2024-07-10T18:51:44.068172482+08:00 stderr F   ss: "kasieg_18"
2024-07-10T18:51:44.06817514+08:00 stderr F   ss: "kasieg_19"
2024-07-10T18:51:44.068177768+08:00 stderr F   ss: "kasieg_20"
2024-07-10T18:51:44.06818072+08:00 stderr F   ss: "kasieg_1"
2024-07-10T18:51:44.068184605+08:00 stderr F   ss: "kasieg_2"
2024-07-10T18:51:44.068188327+08:00 stderr F   ss: "kasieg_3"
2024-07-10T18:51:44.0681923+08:00 stderr F   ss: "kasieg_4"
2024-07-10T18:51:44.06819607+08:00 stderr F   ss: "kasieg_5"
2024-07-10T18:51:44.068199888+08:00 stderr F   ss: "kasieg_6"
2024-07-10T18:51:44.068203383+08:00 stderr F   ss: "kasieg_7"
2024-07-10T18:51:44.068206815+08:00 stderr F   ss: "kasieg_8"
2024-07-10T18:51:44.068210343+08:00 stderr F   ss: "kasieg_9"
2024-07-10T18:51:44.068214068+08:00 stderr F   ss: "kasieg_10"
2024-07-10T18:51:44.068217837+08:00 stderr F }
2024-07-10T18:51:44.068221929+08:00 stderr F attrs {
2024-07-10T18:51:44.068225718+08:00 stderr F   s: "no_drop"
2024-07-10T18:51:44.068228453+08:00 stderr F }
2024-07-10T18:51:44.068231129+08:00 stderr F attrs {
2024-07-10T18:51:44.0682338+08:00 stderr F }
2024-07-10T18:51:44.068236545+08:00 stderr F attrs {
2024-07-10T18:51:44.068239386+08:00 stderr F   b: true
2024-07-10T18:51:44.068242011+08:00 stderr F }
2024-07-10T18:51:44.068244731+08:00 stderr F inputs {
2024-07-10T18:51:44.068247831+08:00 stderr F   name: "jobs/202407101638466494640/e1449345-psi-dataset"
2024-07-10T18:51:44.068250895+08:00 stderr F   type: "sf.table.vertical_table"
2024-07-10T18:51:44.068253654+08:00 stderr F   system_info {
2024-07-10T18:51:44.068256373+08:00 stderr F   }
2024-07-10T18:51:44.068259189+08:00 stderr F   meta {
2024-07-10T18:51:44.068262228+08:00 stderr F     type_url: "type.googleapis.com/secretflow.spec.v1.VerticalTable"
2024-07-10T18:51:44.06826548+08:00 stderr F     value: "\n\310\001\n\003id2\022\tkasieg_11\022\tkasieg_12\022\tkasieg_13\022\tkasieg_14\022\tkasieg_15\022\tkasieg_16\022\tkasieg_17\022\tkasieg_18\022\tkasieg_19\022\tkasieg_20\022\001y\"\003int*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float\n\265\001\n\003id1\022\010kasieg_1\022\010kasieg_2\022\010kasieg_3\022\010kasieg_4\022\010kasieg_5\022\010kasieg_6\022\010kasieg_7\022\010kasieg_8\022\010kasieg_9\022\tkasieg_10\"\003int*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float\020\350\007"
2024-07-10T18:51:44.068268713+08:00 stderr F   }
2024-07-10T18:51:44.068271474+08:00 stderr F   data_refs {
2024-07-10T18:51:44.068274285+08:00 stderr F     uri: "jobs/202407101638466494640/e1449345-psi-dataset"
2024-07-10T18:51:44.068277201+08:00 stderr F     party: "p169"
2024-07-10T18:51:44.068279926+08:00 stderr F     format: "csv"
2024-07-10T18:51:44.068282763+08:00 stderr F   }
2024-07-10T18:51:44.068285577+08:00 stderr F   data_refs {
2024-07-10T18:51:44.068288291+08:00 stderr F     uri: "jobs/202407101638466494640/e1449345-psi-dataset"
2024-07-10T18:51:44.068291017+08:00 stderr F     party: "p170"
2024-07-10T18:51:44.068293783+08:00 stderr F     format: "csv"
2024-07-10T18:51:44.06830028+08:00 stderr F   }
2024-07-10T18:51:44.068303329+08:00 stderr F }
2024-07-10T18:51:44.068306107+08:00 stderr F output_uris: "jobs/202407101638466494640/95bd2be9-output_dataset"
2024-07-10T18:51:44.06830891+08:00 stderr F output_uris: "jobs/202407101638466494640/95bd2be9-onehot_rules"
2024-07-10T18:51:44.068311652+08:00 stderr F output_uris: "jobs/202407101638466494640/95bd2be9-report"
2024-07-10T18:51:44.068314456+08:00 stderr F  failed, error <Partitions in the VDataFrame is None or empty.>
2024-07-10T18:51:44.06836261+08:00 stderr F 2024-07-10 10:51:44.068 INFO api.py:342 [p169] -- [Anonymous_job] Shutdowning rayfed intendedly...
2024-07-10T18:51:44.068369073+08:00 stderr F 2024-07-10 10:51:44.068 INFO api.py:356 [p169] -- [Anonymous_job] No wait for data sending.
2024-07-10T18:51:44.070183536+08:00 stderr F 2024-07-10 10:51:44.070 INFO message_queue.py:72 [p169] -- [Anonymous_job] Notify message polling thread[DataSendingQueueThread] to exit.
2024-07-10T18:51:44.070231381+08:00 stderr F 2024-07-10 10:51:44.070 INFO message_queue.py:72 [p169] -- [Anonymous_job] Notify message polling thread[ErrorSendingQueueThread] to exit.
2024-07-10T18:51:44.070270261+08:00 stderr F 2024-07-10 10:51:44.070 INFO api.py:384 [p169] -- [Anonymous_job] Shutdowned rayfed.
2024-07-10T18:51:44.08478203+08:00 stderr F (SenderReceiverProxyActor pid=322) I0710 10:51:44.016073   366 external/com_github_brpc_brpc/src/brpc/span.cpp:506] Opened ./rpc_data/rpcz/20240710.105144.322/id.db and ./rpc_data/rpcz/20240710.105144.322/time.db
2024-07-10T18:51:44.736633935+08:00 stderr F Traceback (most recent call last):
2024-07-10T18:51:44.736657866+08:00 stderr F   File "/usr/local/lib/python3.10/runpy.py", line 196, in _run_module_as_main
2024-07-10T18:51:44.736661583+08:00 stderr F     return _run_code(code, main_globals, None,
2024-07-10T18:51:44.736664108+08:00 stderr F   File "/usr/local/lib/python3.10/runpy.py", line 86, in _run_code
2024-07-10T18:51:44.736667094+08:00 stderr F     exec(code, run_globals)
2024-07-10T18:51:44.736669754+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/kuscia/entry.py", line 547, in <module>
2024-07-10T18:51:44.736672472+08:00 stderr F     main()
2024-07-10T18:51:44.736675145+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
2024-07-10T18:51:44.736677753+08:00 stderr F     return self.main(*args, **kwargs)
2024-07-10T18:51:44.736680107+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1078, in main
2024-07-10T18:51:44.736682456+08:00 stderr F     rv = self.invoke(ctx)
2024-07-10T18:51:44.736684755+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
2024-07-10T18:51:44.736687172+08:00 stderr F     return ctx.invoke(self.callback, **ctx.params)
2024-07-10T18:51:44.736689455+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/click/core.py", line 783, in invoke
2024-07-10T18:51:44.736691726+08:00 stderr F     return __callback(*args, **kwargs)
2024-07-10T18:51:44.736693941+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/kuscia/entry.py", line 527, in main
2024-07-10T18:51:44.736696245+08:00 stderr F     res = comp_eval(sf_node_eval_param, storage_config, sf_cluster_config)
2024-07-10T18:51:44.736698758+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/component/entry.py", line 166, in comp_eval
2024-07-10T18:51:44.736701413+08:00 stderr F     res = comp.eval(
2024-07-10T18:51:44.736703705+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/component/component.py", line 1131, in eval
2024-07-10T18:51:44.736706245+08:00 stderr F     raise e from None
2024-07-10T18:51:44.736708653+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/component/component.py", line 1126, in eval
2024-07-10T18:51:44.736710949+08:00 stderr F     ret = self.__eval_callback(ctx=ctx, **kwargs)
2024-07-10T18:51:44.736713836+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/component/preprocessing/unified_single_party_ops/onehot_encode.py", line 224, in onehot_encode_eval_fn
2024-07-10T18:51:44.736723863+08:00 stderr F     (output_dd, model_dd, dist_rules_obj) = v_preprocessing_transform(
2024-07-10T18:51:44.736726692+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/component/preprocessing/core/table_utils.py", line 60, in v_preprocessing_transform
2024-07-10T18:51:44.736729162+08:00 stderr F     trans, remains = load_table_select_and_exclude_pair(
2024-07-10T18:51:44.736731414+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/component/data_utils.py", line 418, in load_table_select_and_exclude_pair
2024-07-10T18:51:44.736733605+08:00 stderr F     trans_x = load_table(
2024-07-10T18:51:44.736735979+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/component/data_utils.py", line 396, in load_table
2024-07-10T18:51:44.736738245+08:00 stderr F     shape = vdf.shape
2024-07-10T18:51:44.736740478+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/data/vertical/dataframe.py", line 217, in shape
2024-07-10T18:51:44.736742757+08:00 stderr F     self._check_parts()
2024-07-10T18:51:44.736744981+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/data/vertical/dataframe.py", line 86, in _check_parts
2024-07-10T18:51:44.736747322+08:00 stderr F     assert self.partitions, 'Partitions in the VDataFrame is None or empty.'
2024-07-10T18:51:44.736749563+08:00 stderr F AssertionError: Partitions in the VDataFrame is None or empty.
zimu-yuxi commented 4 months ago

双方数据源可以提供下吗，我们看一下

T-ze-yu commented 4 months ago

p169dt.txt p170dt.txt

github-actions[bot] commented 3 months ago

Stale issue message. Please comment to remove stale tag. Otherwise this issue will be closed soon.

zimu-yuxi commented 2 weeks ago

用户升级版本后解决