T-ze-yu
commented
8 months ago 可以稳定复现该问题，这是新跑任务的日志： 50w-split.log
Open T-ze-yu opened 8 months ago
T-ze-yu
commented
8 months ago 可以稳定复现该问题，这是新跑任务的日志： 50w-split.log
YanZhuangz
commented
8 months ago 日志中简单来看的话是 OOM。具体的需要看提供下以下几点的内容：
T-ze-yu
commented
8 months ago 机器资源：
secretflow 版本：
算法就是psi后做train_test_split，具体参数日志中有的吧
Chrisdehe
commented
8 months ago secretflow的日志辛苦通过文本上传一下，目前应该是挂了，点开后为空。
T-ze-yu
commented
8 months ago 2024-03-12T14:50:07.143788417+08:00 stderr F WARNING:root:Since the GPL-licensed package unidecode is not installed, using Python's unicodedata package which yields worse results.
2024-03-12T14:50:07.874351144+08:00 stdout F 2024-03-12 06:50:07,874|p206|INFO|secretflow|entry.py:start_ray:59| ray_conf: RayConfig(ray_node_ip_address='xnxqwak96f8hdz1n-0-global.p206.svc', ray_node_manager_port=0, ray_object_manager_port=0, ray_client_server_port=0, ray_worker_ports=[], ray_gcs_port=8081)
2024-03-12T14:50:07.874388349+08:00 stdout F 2024-03-12 06:50:07,874|p206|INFO|secretflow|entry.py:start_ray:63| Trying to start ray head node at xnxqwak96f8hdz1n-0-global.p206.svc, start command: RAY_BACKEND_LOG_LEVEL=debug RAY_grpc_enable_http_proxy=true OMP_NUM_THREADS=40 ray start --head --include-dashboard=false --disable-usage-stats --num-cpus=32 --node-ip-address=xnxqwak96f8hdz1n-0-global.p206.svc --port=8081
2024-03-12T14:50:11.647780224+08:00 stdout F 2024-03-12 06:50:11,647|p206|INFO|secretflow|entry.py:start_ray:80| 2024-03-12 06:50:08,463 INFO usage_lib.py:423 -- Usage stats collection is disabled.
2024-03-12T14:50:11.647806855+08:00 stdout F 2024-03-12 06:50:08,463 INFO scripts.py:744 -- Local node IP: xnxqwak96f8hdz1n-0-global.p206.svc
2024-03-12T14:50:11.64781655+08:00 stdout F 2024-03-12 06:50:11,486 SUCC scripts.py:781 -- --------------------
2024-03-12T14:50:11.647824064+08:00 stdout F 2024-03-12 06:50:11,486 SUCC scripts.py:782 -- Ray runtime started.
2024-03-12T14:50:11.64783093+08:00 stdout F 2024-03-12 06:50:11,486 SUCC scripts.py:783 -- --------------------
2024-03-12T14:50:11.647838092+08:00 stdout F 2024-03-12 06:50:11,486 INFO scripts.py:785 -- Next steps
2024-03-12T14:50:11.647845895+08:00 stdout F 2024-03-12 06:50:11,486 INFO scripts.py:788 -- To add another node to this Ray cluster, run
2024-03-12T14:50:11.647853321+08:00 stdout F 2024-03-12 06:50:11,486 INFO scripts.py:791 -- ray start --address='xnxqwak96f8hdz1n-0-global.p206.svc:8081'
2024-03-12T14:50:11.647860072+08:00 stdout F 2024-03-12 06:50:11,486 INFO scripts.py:800 -- To connect to this Ray cluster:
2024-03-12T14:50:11.647866678+08:00 stdout F 2024-03-12 06:50:11,486 INFO scripts.py:802 -- import ray
2024-03-12T14:50:11.647873419+08:00 stdout F 2024-03-12 06:50:11,486 INFO scripts.py:803 -- ray.init(_node_ip_address='xnxqwak96f8hdz1n-0-global.p206.svc')
2024-03-12T14:50:11.647880204+08:00 stdout F 2024-03-12 06:50:11,487 INFO scripts.py:834 -- To terminate the Ray runtime, run
2024-03-12T14:50:11.647886855+08:00 stdout F 2024-03-12 06:50:11,487 INFO scripts.py:835 -- ray stop
2024-03-12T14:50:11.647893595+08:00 stdout F 2024-03-12 06:50:11,487 INFO scripts.py:838 -- To view the status of the cluster, use
2024-03-12T14:50:11.647900485+08:00 stdout F 2024-03-12 06:50:11,487 INFO scripts.py:839 -- ray status
2024-03-12T14:50:11.647906987+08:00 stdout F
2024-03-12T14:50:11.647930725+08:00 stdout F 2024-03-12 06:50:11,647|p206|INFO|secretflow|entry.py:start_ray:81| Succeeded to start ray head node at xnxqwak96f8hdz1n-0-global.p206.svc.
2024-03-12T14:50:11.648563009+08:00 stdout F 2024-03-12 06:50:11,648|p206|INFO|secretflow|entry.py:main:510| datasource.access_directly True
2024-03-12T14:50:11.648578224+08:00 stdout F sf_node_eval_param {
2024-03-12T14:50:11.648581968+08:00 stdout F "domain": "data_prep",
2024-03-12T14:50:11.648585704+08:00 stdout F "name": "train_test_split",
2024-03-12T14:50:11.648588969+08:00 stdout F "version": "0.0.1",
2024-03-12T14:50:11.648592114+08:00 stdout F "attrPaths": [
2024-03-12T14:50:11.648595385+08:00 stdout F "train_size",
2024-03-12T14:50:11.648598538+08:00 stdout F "test_size",
2024-03-12T14:50:11.648601659+08:00 stdout F "random_state",
2024-03-12T14:50:11.648604828+08:00 stdout F "shuffle"
2024-03-12T14:50:11.648607931+08:00 stdout F ],
2024-03-12T14:50:11.648611141+08:00 stdout F "attrs": [
2024-03-12T14:50:11.648614688+08:00 stdout F {
2024-03-12T14:50:11.648617901+08:00 stdout F "f": 0.8
2024-03-12T14:50:11.6486211+08:00 stdout F },
2024-03-12T14:50:11.648624677+08:00 stdout F {
2024-03-12T14:50:11.648638132+08:00 stdout F "f": 0.2
2024-03-12T14:50:11.648641605+08:00 stdout F },
2024-03-12T14:50:11.648644781+08:00 stdout F {
2024-03-12T14:50:11.648647978+08:00 stdout F "i64": "64"
2024-03-12T14:50:11.648651188+08:00 stdout F },
2024-03-12T14:50:11.648654328+08:00 stdout F {
2024-03-12T14:50:11.648657537+08:00 stdout F "b": true
2024-03-12T14:50:11.648660969+08:00 stdout F }
2024-03-12T14:50:11.648664095+08:00 stdout F ]
2024-03-12T14:50:11.648667291+08:00 stdout F }
2024-03-12T14:50:11.670872068+08:00 stdout F 2024-03-12 06:50:11,670|p206|INFO|secretflow|entry.py:domaindata_id_to_dist_data:160| domaindata_id 6a3fba1d-intersection-output to
2024-03-12T14:50:11.670888577+08:00 stdout F ...........
2024-03-12T14:50:11.670894733+08:00 stdout F name: "jobs/202403081720114425390/6a3fba1d-intersection-output"
2024-03-12T14:50:11.670900871+08:00 stdout F type: "sf.table.vertical_table"
2024-03-12T14:50:11.670906691+08:00 stdout F system_info {
2024-03-12T14:50:11.670912522+08:00 stdout F }
2024-03-12T14:50:11.670918457+08:00 stdout F meta {
2024-03-12T14:50:11.670924517+08:00 stdout F type_url: "type.googleapis.com/secretflow.spec.v1.VerticalTable"
2024-03-12T14:50:11.670994725+08:00 stdout P value: "\n\254\n\003ID2\022\003450\022\003451\022\003452\022\003453\022\003454\022\003455\022\003456\022\003457\022\003458\022\003459\022\003460\022\003461\022\003462\022\003463\022\003464\022\003465\022\003466\022\003467\022\003468\022\003469\022\003470\022\003471\022\003472\022\003473\022\003474\022\003475\022\003476\022\003477\022\003478\022\003479\022\003480\022\003481\022\003482\022\003483\022\003484\022\003485\022\003486\022\003487\022\003488\022\003489\022\003490\022\003491\022\003492\022\003493\022\003494\022\003495\022\003496\022\003497\022\003498\022\003499\022\003500\022\003501\022\003502\022\003503\022\003504\022\003505\022\003506\022\003507\022\003508\022\003509\022\003510\022\003511\022\003512\022\003513\022\003514\022\003515\022\003516\022\003517\022\003518\022\003519\022\003520\022\003521\022\003522\022\003523\022\003524\022\003525\022\003526\022\003527\022\003528\022\003529\022\003530\022\003531\022\003532\022\003533\022\003534\022\003535\022\003536\022\003537\022\003538\022\003539\022\003540\022\003541\022\003542\022\003543\022\003544\022\003545\022\003546\022\003547\022\003548\022\003549\022\003550\022\003551\022\003552\022\003553\022\003554\022\003555\022\003556\022\003557\022\003558\022\003559\022\003560\022\003561\022\003562\022\003563\022\003564\022\003565\022\003566\022\003567\022\003568\022\003569\022\003570\022\003571\022\003572\022\003573\022\003574\022\003575\022\003576\022\003577\022\003578\022\003579\022\003580\022\003581\022\003582\022\003583\022\003584\022\003585\022\003586\022\003587\022\003588\022\003589\022\003590\022\003591\022\003592\022\003593\022\003594\022\003595\022\003596\022\003597\022\003598\022\003599\022\003600\022\003601\022\003602\022\003603\022\003604\022\003605\022\003606\022\003607\022\003608\022\003609\022\003610\022\003611\022\003612\022\003613\022\003614\022\003615\022\003616\022\003617\022\003618\022\003619\022\003620\022\003621\022\003622\022\003623\022\003624\022\003625\022\003626\022\003627\022\003628\022\003629\022\003630\022\003631\022\003632\022\003633\022\003634\022\003635\022\003636\022\003637\022\003638\022\003639\022\003640\022\003641\022\003642\022\003643\022\003644\022\003645\022\003646\022\003647\022\003648\022\003649\022\003650\022\003651\022\003652\022\003653\022\003654\022\003655\022\003656\022\003657\022\003658\022\003659\022\003660\022\003661\022\003662\022\003663\022\003664\022\003665\022\003666\022\003667\022\003668\022\003669\022\003670\022\003671\022\003672\022\003673\022\003674\022\003675\022\003676\022\003677\022\003678\022\003679\022\003680\022\003681\022\003682\022\003683\022\003684\022\003685\022\003686\022\003687\022\003688\022\003689\022\003690\022\003691\022\003692\022\003693\022\003694\022\003695\022\003696\022\003697\022\003698\022\003699\022\003700\022\003701\022\003702\022\003703\022\003704\022\003705\022\003706\022\003707\022\003708\022\003709\022\003710\022\003711\022\003712\022\003713\022\003714\022\003715\022\003716\022\003717\022\003718\022\003719\022\003720\022\003721\022\003722\022\003723\022\003724\022\003725\022\003726\022\003727\022\003728\022\003729\022\003730\022\003731\022\003732\022\003733\022\003734\022\003735\022\003736\022\003737\022\003738\022\003739\022\003740\022\003741\022\003742\022\003743\022\003744\022\003745\022\003746\022\003747\022\003748\022\003749\022\003750\022\003751\022\003752\022\003753\022\003754\022\003755\022\003756\022\003757\022\003758\022\003759\022\003760\022\003761\022\003762\022\003763\022\003764\022\003765\022\003766\022\003767\022\003768\022\003769\022\003770\022\003771\022\003772\022\003773\022\003774\022\003775\022\003776\022\003777\022\003778\022\003779\022\003780\022\003781\022\003782\022\003783\022\003784\022\003785\022\003786\022\003787\022\003788\022\003789\022\003790\022\003791\022\003792\022\003793\022\003794\022\003795\022\003796\022\003797\022\003798\022\003799\022\003800\022\003801\022\003802\022\003803\022\003804\022\003805\022\003806\022\003807\022\003808\022\003809\022\003810\022\003811\022\003812\022\003813\022\003814\022\003815\022\003816\022\003817\022\003818\022\003819\022\003820\022\003821\022\003822\022\003823\022\003824\022\003825\022\003826\022\003827\022\003828\022\003829\022\003830\022\003831\022\003832\022\003833\022\003834\022\003835\022\003836\022\003837\022\003838\022\003839\022\003840\022\003841\022\003842\022\003843\022\003844\022\003845\022\003846\022\003847\022\003848\022\003849\022\003850\022\003851\022\003852\022\003853\022\003854\022\003855\022\003856\022\003857\022\003858\022\003859\022\003860\022\003861\022\003862\022\003863\022\003864\022\003865\022\003866\022\003867\022\003868\022\003869\022\003870\022\003871\022\003872\022\003873\022\003874\022\003875\022\003876\022\003877\022\003878\022\003879\022\003880\022\003881\022\003882\022\003883\022\003884\022\003885\022\003886\022\003887\022\003888\022\003889\022\003890\022\003891\022\003892\022\003893\022\003894\022\003895\022\003896\022\003897\022\003898\022\003899\022\003900\"\003int\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\003int\n\264)\n\003ID1\022\0010\022\0011\022\0012\022\0013\022\0014\022\0015\022\0016\022\0017\022\0018\022\0019\022\00210\022\00211\022\00212\022\00213\022\00214\022\00215\022\00216\022\00217\022\00218\022\00219\022\00220\022\00221\022\00222\022\00223\022\00224\022\00225\022\00226\022\00227\022\00228\022\00229\022\00230\022\00231\022\00232\022\00233\022\00234\022\00235\022\00236\022\00237\022\00238\022\00239\022\00240\022\00241\022\00242\022\00243\022\00244\022\00245\022\00246\022\00247\022\00248\022\00249\022\00250\022\00251\022\00252\022\00253\022\00254\022\00255\022\00256\022\00257\022\00258\022\00259\022\00260\022\00261\022\00262\022\00263\022\00264\022\00265\022\00266\022\00267\022\00268\022\00269\022\00270\022\00271\022\00272\022\00273\022\00274\022\00275\022\00276\022\00277\022\00278\022\00279\022\00280\022\00281\022\00282\022\00283\022\00284\022\00285\022\00286\022\00287\022\00288\022\00289\022\00290\022\00291\022\00292\022\00293\022\00294\022\00295\022\00296\022\00297\022\00298\022\00299\022\003100\022\003101\022\003102\022\003103\022\003104\022\003105\022\003106\022\003107\022\003108\022\003109\022\003110\022\003111\022\003112\022\003113\022\003114\022\003115\022\003116\022\003117\022\003118\022\003119\022\003120\022\003121\022\003122\022\003123\022\003124\022\003125\022\003126\022\003127\022\003128\022\003129\022\003130\022\003131\022\003132\022\003133\022\003134\022\003135\022\003136\022\003137\022\003138\022\003139\022\003140\022\003141\022\003142\022\003143\022\003144\022\003145\022\003146\022\003147\022\003148\022\003149\022\003150\022\003151\022\003152\022\003153\022\003154\022\003155\022\003156\022\003157\022\003158\022\003159\022\003160\022\003161\022\003162\022\003163\022\003164\022\003165\022\003166\022\003167\022\003168\022\003169\022\003170\022\003171\022\003172\022\003173\022\003174\022\003175\022\003176\022\003177\022\003178\022\003179\022\003180\022\003181\022\003182\022\003183\022\003184\022\003185\022\003186\022\003187\022\003188\022\003189\022\003190\022\003191\022\003192\022\003193\022\003194\022\003195\022\003196\022\003197\022\003198\022\003199\022\003200\022\003201\022\003202\022\003203\022\003204\022\003205\022\003206\022\003207\022\003208\022\003209\022\003210\022\003211\022\003212\022\003213\022\003214\022\003215\022\003216\022\003217\022\003218\022\003219\022\003220\022\003221\022\003222\022\003223\022\003224\022\003225\022\003226\022\003227\022\003228\022\003229\022\003230\022\003231\022\003232\022\003233\022\003234\022\003235\022\003236\022\003237\022\003238\022\003239\022\003240\022\003241\022\003242\022\003243\022\003244\022\003245\022\003246\022\003247\022\003248\022\003249\022\003250\022\003251\022\003252\022\003253\022\003254\022\003255\022\003256\022\003257\022\003258\022\003259\022\003260\022\003261\022\003262\022\003263\022\003264\022\003265\022\003266\022\003267\022\003268\022\003269\022\003270\022\003271\022\003272\022\003273\022\003274\022\003275\022\003276\022\003277\022\003278\022\003279\022\003280\022\003281\022\003282\022\003283\022\003284\022\003285\022\003286\022\003287\022\003288\022\003289\022\003290\022\003291\022\003292\022\003293\022\003294\022\003295\022\003296\022\003297\022\003298\022\003299\022\003300\022\003301\022\003302\022\003303\022\003304\022\003305\022\003306\022\003307\022\003308\022\003309\022\003310\022\003311\022\003312\022\003313\022\003314\022\003315\022\003316\022\003317\022\003318\022\003319\022\003320\022\003321\022\003322\022\003323\022\003324\022\003325\022\003326\022\003327\022\003328\022\003329\022\003330\022\003331\022\003332\022\003333\022\003334\022\003335\022\003336\022\003337\022\003338\022\003339\022\003340\022\003341\022\003342\022\003343\022\003344\022\003345\022\003346\022\003347\022\003348\022\003349\022\003350\022\003351\022\003352\022\003353\022\003354\022\003355\022\003356\022\003357\022\003358\022\003359\022\003360\022\003361\022\003362\022\003363\022\003364\022\003365\022\003366\022\003367\022\003368\022\003369\022\003370\022\003371\022\003372\022\003373\022\003374\022\003375\022\003376\022\003377\022\003378\022\003379\022\003380\022\003381\022\003382\022\003383\022\003384\022\003385\022\003386\022\003387\022\003388\022\003389\022\003390\022\003391\022\003392\022\003393\022\003394\022\003395\022\003396\022\003397\022\003398\022\003399\022\003400\022\003401\022\003402\022\003403\022\003404\022\003405\022\003406\022\003407\022\003408\022\003409\022\003410\022\003411\022\003412\022\003413\022\003414\022\003415\022\003416\022\003417\022\003418\022\003419\022\003420\022\003421\022\003422\022\003423\022\003424\022\003425\022\003426\022\003427\022\003428\022\003429\022\003430\022\003431\022\003432\022\003433\022\003434\022\003435\022\003436\022\003437\022\003438\022\003439\022\003440\022\003441\022\003442\022\003443\022\003444\022\003445\022\003446\022\003447\022\003448\022\003449\"\003int\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005
2024-03-12T14:50:11.671055324+08:00 stdout F float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\020\240\302\036"
2024-03-12T14:50:11.671059678+08:00 stdout F }
2024-03-12T14:50:11.671062963+08:00 stdout F data_refs {
2024-03-12T14:50:11.671066645+08:00 stdout F uri: "jobs/202403081720114425390/6a3fba1d-intersection-output"
2024-03-12T14:50:11.671069819+08:00 stdout F party: "p206"
2024-03-12T14:50:11.671075322+08:00 stdout F format: "csv"
2024-03-12T14:50:11.671078545+08:00 stdout F }
2024-03-12T14:50:11.671081745+08:00 stdout F data_refs {
2024-03-12T14:50:11.671084997+08:00 stdout F uri: "jobs/202403081720114425390/6a3fba1d-intersection-output"
2024-03-12T14:50:11.671088151+08:00 stdout F party: "p142"
2024-03-12T14:50:11.67109138+08:00 stdout F format: "csv"
2024-03-12T14:50:11.67109468+08:00 stdout F }
2024-03-12T14:50:11.67109773+08:00 stdout F
2024-03-12T14:50:11.671100871+08:00 stdout F ....
2024-03-12T14:50:11.671439091+08:00 stdout F 2024-03-12 06:50:11,671|p206|WARNING|secretflow|entry.py:comp_eval:157|
2024-03-12T14:50:11.671448051+08:00 stdout F --
2024-03-12T14:50:11.671454171+08:00 stdout F Secretflow 1.5.0.dev20240304
2024-03-12T14:50:11.671460485+08:00 stdout F Build time (Mar 04 2024, 10:38:53) with commit id: d0932545b5dfd84be459b4cfac1b4f2784114ba9
2024-03-12T14:50:11.671466502+08:00 stdout F --
2024-03-12T14:50:11.671472089+08:00 stdout F
2024-03-12T14:50:11.671662927+08:00 stdout F 2024-03-12 06:50:11,671|p206|WARNING|secretflow|entry.py:comp_eval:158|
2024-03-12T14:50:11.67166837+08:00 stdout F --
2024-03-12T14:50:11.67167159+08:00 stdout F param
2024-03-12T14:50:11.671674692+08:00 stdout F
2024-03-12T14:50:11.671678185+08:00 stdout F domain: "data_prep"
2024-03-12T14:50:11.671681328+08:00 stdout F name: "train_test_split"
2024-03-12T14:50:11.671684452+08:00 stdout F version: "0.0.1"
2024-03-12T14:50:11.671687581+08:00 stdout F attr_paths: "train_size"
2024-03-12T14:50:11.671690744+08:00 stdout F attr_paths: "test_size"
2024-03-12T14:50:11.671694156+08:00 stdout F attr_paths: "random_state"
2024-03-12T14:50:11.671697237+08:00 stdout F attr_paths: "shuffle"
2024-03-12T14:50:11.671700406+08:00 stdout F attrs {
2024-03-12T14:50:11.671703597+08:00 stdout F f: 0.800000011920929
2024-03-12T14:50:11.671706648+08:00 stdout F }
2024-03-12T14:50:11.671709786+08:00 stdout F attrs {
2024-03-12T14:50:11.671712937+08:00 stdout F f: 0.20000000298023224
2024-03-12T14:50:11.671716017+08:00 stdout F }
2024-03-12T14:50:11.671719232+08:00 stdout F attrs {
2024-03-12T14:50:11.671722396+08:00 stdout F i64: 64
2024-03-12T14:50:11.671725498+08:00 stdout F }
2024-03-12T14:50:11.671728622+08:00 stdout F attrs {
2024-03-12T14:50:11.671731933+08:00 stdout F b: true
2024-03-12T14:50:11.671735404+08:00 stdout F }
2024-03-12T14:50:11.671738487+08:00 stdout F inputs {
2024-03-12T14:50:11.67174168+08:00 stdout F name: "jobs/202403081720114425390/6a3fba1d-intersection-output"
2024-03-12T14:50:11.671745084+08:00 stdout F type: "sf.table.vertical_table"
2024-03-12T14:50:11.671748293+08:00 stdout F system_info {
2024-03-12T14:50:11.671751549+08:00 stdout F }
2024-03-12T14:50:11.671754656+08:00 stdout F meta {
2024-03-12T14:50:11.671757835+08:00 stdout F type_url: "type.googleapis.com/secretflow.spec.v1.VerticalTable"
2024-03-12T14:50:11.671839323+08:00 stdout P value: "\n\254\n\003ID2\022\003450\022\003451\022\003452\022\003453\022\003454\022\003455\022\003456\022\003457\022\003458\022\003459\022\003460\022\003461\022\003462\022\003463\022\003464\022\003465\022\003466\022\003467\022\003468\022\003469\022\003470\022\003471\022\003472\022\003473\022\003474\022\003475\022\003476\022\003477\022\003478\022\003479\022\003480\022\003481\022\003482\022\003483\022\003484\022\003485\022\003486\022\003487\022\003488\022\003489\022\003490\022\003491\022\003492\022\003493\022\003494\022\003495\022\003496\022\003497\022\003498\022\003499\022\003500\022\003501\022\003502\022\003503\022\003504\022\003505\022\003506\022\003507\022\003508\022\003509\022\003510\022\003511\022\003512\022\003513\022\003514\022\003515\022\003516\022\003517\022\003518\022\003519\022\003520\022\003521\022\003522\022\003523\022\003524\022\003525\022\003526\022\003527\022\003528\022\003529\022\003530\022\003531\022\003532\022\003533\022\003534\022\003535\022\003536\022\003537\022\003538\022\003539\022\003540\022\003541\022\003542\022\003543\022\003544\022\003545\022\003546\022\003547\022\003548\022\003549\022\003550\022\003551\022\003552\022\003553\022\003554\022\003555\022\003556\022\003557\022\003558\022\003559\022\003560\022\003561\022\003562\022\003563\022\003564\022\003565\022\003566\022\003567\022\003568\022\003569\022\003570\022\003571\022\003572\022\003573\022\003574\022\003575\022\003576\022\003577\022\003578\022\003579\022\003580\022\003581\022\003582\022\003583\022\003584\022\003585\022\003586\022\003587\022\003588\022\003589\022\003590\022\003591\022\003592\022\003593\022\003594\022\003595\022\003596\022\003597\022\003598\022\003599\022\003600\022\003601\022\003602\022\003603\022\003604\022\003605\022\003606\022\003607\022\003608\022\003609\022\003610\022\003611\022\003612\022\003613\022\003614\022\003615\022\003616\022\003617\022\003618\022\003619\022\003620\022\003621\022\003622\022\003623\022\003624\022\003625\022\003626\022\003627\022\003628\022\003629\022\003630\022\003631\022\003632\022\003633\022\003634\022\003635\022\003636\022\003637\022\003638\022\003639\022\003640\022\003641\022\003642\022\003643\022\003644\022\003645\022\003646\022\003647\022\003648\022\003649\022\003650\022\003651\022\003652\022\003653\022\003654\022\003655\022\003656\022\003657\022\003658\022\003659\022\003660\022\003661\022\003662\022\003663\022\003664\022\003665\022\003666\022\003667\022\003668\022\003669\022\003670\022\003671\022\003672\022\003673\022\003674\022\003675\022\003676\022\003677\022\003678\022\003679\022\003680\022\003681\022\003682\022\003683\022\003684\022\003685\022\003686\022\003687\022\003688\022\003689\022\003690\022\003691\022\003692\022\003693\022\003694\022\003695\022\003696\022\003697\022\003698\022\003699\022\003700\022\003701\022\003702\022\003703\022\003704\022\003705\022\003706\022\003707\022\003708\022\003709\022\003710\022\003711\022\003712\022\003713\022\003714\022\003715\022\003716\022\003717\022\003718\022\003719\022\003720\022\003721\022\003722\022\003723\022\003724\022\003725\022\003726\022\003727\022\003728\022\003729\022\003730\022\003731\022\003732\022\003733\022\003734\022\003735\022\003736\022\003737\022\003738\022\003739\022\003740\022\003741\022\003742\022\003743\022\003744\022\003745\022\003746\022\003747\022\003748\022\003749\022\003750\022\003751\022\003752\022\003753\022\003754\022\003755\022\003756\022\003757\022\003758\022\003759\022\003760\022\003761\022\003762\022\003763\022\003764\022\003765\022\003766\022\003767\022\003768\022\003769\022\003770\022\003771\022\003772\022\003773\022\003774\022\003775\022\003776\022\003777\022\003778\022\003779\022\003780\022\003781\022\003782\022\003783\022\003784\022\003785\022\003786\022\003787\022\003788\022\003789\022\003790\022\003791\022\003792\022\003793\022\003794\022\003795\022\003796\022\003797\022\003798\022\003799\022\003800\022\003801\022\003802\022\003803\022\003804\022\003805\022\003806\022\003807\022\003808\022\003809\022\003810\022\003811\022\003812\022\003813\022\003814\022\003815\022\003816\022\003817\022\003818\022\003819\022\003820\022\003821\022\003822\022\003823\022\003824\022\003825\022\003826\022\003827\022\003828\022\003829\022\003830\022\003831\022\003832\022\003833\022\003834\022\003835\022\003836\022\003837\022\003838\022\003839\022\003840\022\003841\022\003842\022\003843\022\003844\022\003845\022\003846\022\003847\022\003848\022\003849\022\003850\022\003851\022\003852\022\003853\022\003854\022\003855\022\003856\022\003857\022\003858\022\003859\022\003860\022\003861\022\003862\022\003863\022\003864\022\003865\022\003866\022\003867\022\003868\022\003869\022\003870\022\003871\022\003872\022\003873\022\003874\022\003875\022\003876\022\003877\022\003878\022\003879\022\003880\022\003881\022\003882\022\003883\022\003884\022\003885\022\003886\022\003887\022\003888\022\003889\022\003890\022\003891\022\003892\022\003893\022\003894\022\003895\022\003896\022\003897\022\003898\022\003899\022\003900\"\003int\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\003int\n\264)\n\003ID1\022\0010\022\0011\022\0012\022\0013\022\0014\022\0015\022\0016\022\0017\022\0018\022\0019\022\00210\022\00211\022\00212\022\00213\022\00214\022\00215\022\00216\022\00217\022\00218\022\00219\022\00220\022\00221\022\00222\022\00223\022\00224\022\00225\022\00226\022\00227\022\00228\022\00229\022\00230\022\00231\022\00232\022\00233\022\00234\022\00235\022\00236\022\00237\022\00238\022\00239\022\00240\022\00241\022\00242\022\00243\022\00244\022\00245\022\00246\022\00247\022\00248\022\00249\022\00250\022\00251\022\00252\022\00253\022\00254\022\00255\022\00256\022\00257\022\00258\022\00259\022\00260\022\00261\022\00262\022\00263\022\00264\022\00265\022\00266\022\00267\022\00268\022\00269\022\00270\022\00271\022\00272\022\00273\022\00274\022\00275\022\00276\022\00277\022\00278\022\00279\022\00280\022\00281\022\00282\022\00283\022\00284\022\00285\022\00286\022\00287\022\00288\022\00289\022\00290\022\00291\022\00292\022\00293\022\00294\022\00295\022\00296\022\00297\022\00298\022\00299\022\003100\022\003101\022\003102\022\003103\022\003104\022\003105\022\003106\022\003107\022\003108\022\003109\022\003110\022\003111\022\003112\022\003113\022\003114\022\003115\022\003116\022\003117\022\003118\022\003119\022\003120\022\003121\022\003122\022\003123\022\003124\022\003125\022\003126\022\003127\022\003128\022\003129\022\003130\022\003131\022\003132\022\003133\022\003134\022\003135\022\003136\022\003137\022\003138\022\003139\022\003140\022\003141\022\003142\022\003143\022\003144\022\003145\022\003146\022\003147\022\003148\022\003149\022\003150\022\003151\022\003152\022\003153\022\003154\022\003155\022\003156\022\003157\022\003158\022\003159\022\003160\022\003161\022\003162\022\003163\022\003164\022\003165\022\003166\022\003167\022\003168\022\003169\022\003170\022\003171\022\003172\022\003173\022\003174\022\003175\022\003176\022\003177\022\003178\022\003179\022\003180\022\003181\022\003182\022\003183\022\003184\022\003185\022\003186\022\003187\022\003188\022\003189\022\003190\022\003191\022\003192\022\003193\022\003194\022\003195\022\003196\022\003197\022\003198\022\003199\022\003200\022\003201\022\003202\022\003203\022\003204\022\003205\022\003206\022\003207\022\003208\022\003209\022\003210\022\003211\022\003212\022\003213\022\003214\022\003215\022\003216\022\003217\022\003218\022\003219\022\003220\022\003221\022\003222\022\003223\022\003224\022\003225\022\003226\022\003227\022\003228\022\003229\022\003230\022\003231\022\003232\022\003233\022\003234\022\003235\022\003236\022\003237\022\003238\022\003239\022\003240\022\003241\022\003242\022\003243\022\003244\022\003245\022\003246\022\003247\022\003248\022\003249\022\003250\022\003251\022\003252\022\003253\022\003254\022\003255\022\003256\022\003257\022\003258\022\003259\022\003260\022\003261\022\003262\022\003263\022\003264\022\003265\022\003266\022\003267\022\003268\022\003269\022\003270\022\003271\022\003272\022\003273\022\003274\022\003275\022\003276\022\003277\022\003278\022\003279\022\003280\022\003281\022\003282\022\003283\022\003284\022\003285\022\003286\022\003287\022\003288\022\003289\022\003290\022\003291\022\003292\022\003293\022\003294\022\003295\022\003296\022\003297\022\003298\022\003299\022\003300\022\003301\022\003302\022\003303\022\003304\022\003305\022\003306\022\003307\022\003308\022\003309\022\003310\022\003311\022\003312\022\003313\022\003314\022\003315\022\003316\022\003317\022\003318\022\003319\022\003320\022\003321\022\003322\022\003323\022\003324\022\003325\022\003326\022\003327\022\003328\022\003329\022\003330\022\003331\022\003332\022\003333\022\003334\022\003335\022\003336\022\003337\022\003338\022\003339\022\003340\022\003341\022\003342\022\003343\022\003344\022\003345\022\003346\022\003347\022\003348\022\003349\022\003350\022\003351\022\003352\022\003353\022\003354\022\003355\022\003356\022\003357\022\003358\022\003359\022\003360\022\003361\022\003362\022\003363\022\003364\022\003365\022\003366\022\003367\022\003368\022\003369\022\003370\022\003371\022\003372\022\003373\022\003374\022\003375\022\003376\022\003377\022\003378\022\003379\022\003380\022\003381\022\003382\022\003383\022\003384\022\003385\022\003386\022\003387\022\003388\022\003389\022\003390\022\003391\022\003392\022\003393\022\003394\022\003395\022\003396\022\003397\022\003398\022\003399\022\003400\022\003401\022\003402\022\003403\022\003404\022\003405\022\003406\022\003407\022\003408\022\003409\022\003410\022\003411\022\003412\022\003413\022\003414\022\003415\022\003416\022\003417\022\003418\022\003419\022\003420\022\003421\022\003422\022\003423\022\003424\022\003425\022\003426\022\003427\022\003428\022\003429\022\003430\022\003431\022\003432\022\003433\022\003434\022\003435\022\003436\022\003437\022\003438\022\003439\022\003440\022\003441\022\003442\022\003443\022\003444\022\003445\022\003446\022\003447\022\003448\022\003449\"\003int\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\0
2024-03-12T14:50:11.671876447+08:00 stdout F 05float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\020\240\302\036"
2024-03-12T14:50:11.671888201+08:00 stdout F }
2024-03-12T14:50:11.67189496+08:00 stdout F data_refs {
2024-03-12T14:50:11.671901586+08:00 stdout F uri: "jobs/202403081720114425390/6a3fba1d-intersection-output"
2024-03-12T14:50:11.67190752+08:00 stdout F party: "p206"
2024-03-12T14:50:11.671913355+08:00 stdout F format: "csv"
2024-03-12T14:50:11.671919186+08:00 stdout F }
2024-03-12T14:50:11.671924971+08:00 stdout F data_refs {
2024-03-12T14:50:11.671930715+08:00 stdout F uri: "jobs/202403081720114425390/6a3fba1d-intersection-output"
2024-03-12T14:50:11.671936415+08:00 stdout F party: "p142"
2024-03-12T14:50:11.671942014+08:00 stdout F format: "csv"
2024-03-12T14:50:11.671947746+08:00 stdout F }
2024-03-12T14:50:11.671953546+08:00 stdout F }
2024-03-12T14:50:11.67195951+08:00 stdout F output_uris: "jobs/202403081720114425390/2b70c219-train-dataset"
2024-03-12T14:50:11.671965535+08:00 stdout F output_uris: "jobs/202403081720114425390/2b70c219-test-dataset"
2024-03-12T14:50:11.671970982+08:00 stdout F
2024-03-12T14:50:11.671976685+08:00 stdout F --
2024-03-12T14:50:11.671982111+08:00 stdout F
2024-03-12T14:50:11.671987846+08:00 stdout F 2024-03-12 06:50:11,671|p206|WARNING|secretflow|entry.py:comp_eval:159|
2024-03-12T14:50:11.671993633+08:00 stdout F --
2024-03-12T14:50:11.671999428+08:00 stdout F storage_config
2024-03-12T14:50:11.672004828+08:00 stdout F
2024-03-12T14:50:11.672010597+08:00 stdout F type: "local_fs"
2024-03-12T14:50:11.672016393+08:00 stdout F local_fs {
2024-03-12T14:50:11.672022739+08:00 stdout F wd: "/home/kuscia/var/storage/data"
2024-03-12T14:50:11.672028947+08:00 stdout F }
2024-03-12T14:50:11.672034472+08:00 stdout F
2024-03-12T14:50:11.672040132+08:00 stdout F --
2024-03-12T14:50:11.672045525+08:00 stdout F
2024-03-12T14:50:11.672060556+08:00 stdout F 2024-03-12 06:50:11,671|p206|WARNING|secretflow|entry.py:comp_eval:160|
2024-03-12T14:50:11.6720669+08:00 stdout F --
2024-03-12T14:50:11.672072827+08:00 stdout F cluster_config
2024-03-12T14:50:11.672078192+08:00 stdout F
2024-03-12T14:50:11.672083869+08:00 stdout F desc {
2024-03-12T14:50:11.672089578+08:00 stdout F parties: "p206"
2024-03-12T14:50:11.672095278+08:00 stdout F parties: "p142"
2024-03-12T14:50:11.672100972+08:00 stdout F devices {
2024-03-12T14:50:11.672117215+08:00 stdout F name: "spu"
2024-03-12T14:50:11.672123175+08:00 stdout F type: "spu"
2024-03-12T14:50:11.67212884+08:00 stdout F parties: "p206"
2024-03-12T14:50:11.672134535+08:00 stdout F parties: "p142"
2024-03-12T14:50:11.672140713+08:00 stdout F config: "{\"runtime_config\":{\"protocol\":\"REF2K\",\"field\":\"FM64\"},\"link_desc\":{\"connect_retry_times\":60,\"connect_retry_interval_ms\":1000,\"brpc_channel_protocol\":\"http\",\"brpc_channel_connection_type\":\"pooled\",\"recv_timeout_ms\":1200000,\"http_timeout_ms\":1200000}}"
2024-03-12T14:50:11.672150435+08:00 stdout F }
2024-03-12T14:50:11.672156542+08:00 stdout F devices {
2024-03-12T14:50:11.672162433+08:00 stdout F name: "heu"
2024-03-12T14:50:11.67216815+08:00 stdout F type: "heu"
2024-03-12T14:50:11.672173862+08:00 stdout F parties: "p206"
2024-03-12T14:50:11.672179526+08:00 stdout F parties: "p142"
2024-03-12T14:50:11.672185315+08:00 stdout F config: "{\"mode\": \"PHEU\", \"schema\": \"paillier\", \"key_size\": 2048}"
2024-03-12T14:50:11.672190996+08:00 stdout F }
2024-03-12T14:50:11.672196684+08:00 stdout F ray_fed_config {
2024-03-12T14:50:11.672202559+08:00 stdout F cross_silo_comm_backend: "brpc_link"
2024-03-12T14:50:11.672208298+08:00 stdout F }
2024-03-12T14:50:11.672213973+08:00 stdout F }
2024-03-12T14:50:11.672219621+08:00 stdout F public_config {
2024-03-12T14:50:11.672225221+08:00 stdout F ray_fed_config {
2024-03-12T14:50:11.672230878+08:00 stdout F parties: "p206"
2024-03-12T14:50:11.672236436+08:00 stdout F parties: "p142"
2024-03-12T14:50:11.672242429+08:00 stdout F addresses: "0.0.0.0:8080"
2024-03-12T14:50:11.672248092+08:00 stdout F addresses: "xnxqwak96f8hdz1n-0-fed.p142.svc:80"
2024-03-12T14:50:11.672253978+08:00 stdout F }
2024-03-12T14:50:11.672259701+08:00 stdout F spu_configs {
2024-03-12T14:50:11.67226543+08:00 stdout F name: "spu"
2024-03-12T14:50:11.672271414+08:00 stdout F parties: "p206"
2024-03-12T14:50:11.672277216+08:00 stdout F parties: "p142"
2024-03-12T14:50:11.672282776+08:00 stdout F addresses: "0.0.0.0:54509"
2024-03-12T14:50:11.672288511+08:00 stdout F addresses: "http://xnxqwak96f8hdz1n-0-spu.p142.svc:80"
2024-03-12T14:50:11.672294212+08:00 stdout F }
2024-03-12T14:50:11.672300029+08:00 stdout F }
2024-03-12T14:50:11.67230574+08:00 stdout F private_config {
2024-03-12T14:50:11.672311389+08:00 stdout F self_party: "p206"
2024-03-12T14:50:11.672317103+08:00 stdout F ray_head_addr: "xnxqwak96f8hdz1n-0-global.p206.svc:8081"
2024-03-12T14:50:11.672329814+08:00 stdout F }
2024-03-12T14:50:11.67233546+08:00 stdout F
2024-03-12T14:50:11.672341185+08:00 stdout F --
2024-03-12T14:50:11.672346602+08:00 stdout F
2024-03-12T14:50:11.672799048+08:00 stdout F 2024-03-12 06:50:11,672|p206|WARNING|secretflow|driver.py:init:442| When connecting to an existing cluster, num_cpus must not be provided. Num_cpus is neglected at this moment.
2024-03-12T14:50:11.673543218+08:00 stderr F 2024-03-12 06:50:11,673 INFO worker.py:1540 -- Connecting to existing Ray cluster at address: xnxqwak96f8hdz1n-0-global.p206.svc:8081...
2024-03-12T14:50:11.682919724+08:00 stdout F 2024-03-12 06:50:11,682|p206|DEBUG|secretflow|_api.py:acquire:254| Attempting to acquire lock 140100392184144 on /tmp/ray/session_2024-03-12_06-50-08_464287_114/node_ip_address.json.lock
2024-03-12T14:50:11.683023207+08:00 stdout F 2024-03-12 06:50:11,682|p206|DEBUG|secretflow|_api.py:acquire:257| Lock 140100392184144 acquired on /tmp/ray/session_2024-03-12_06-50-08_464287_114/node_ip_address.json.lock
2024-03-12T14:50:11.683207677+08:00 stdout F 2024-03-12 06:50:11,683|p206|DEBUG|secretflow|_api.py:release:286| Attempting to release lock 140100392184144 on /tmp/ray/session_2024-03-12_06-50-08_464287_114/node_ip_address.json.lock
2024-03-12T14:50:11.683225855+08:00 stdout F 2024-03-12 06:50:11,683|p206|DEBUG|secretflow|_api.py:release:289| Lock 140100392184144 released on /tmp/ray/session_2024-03-12_06-50-08_464287_114/node_ip_address.json.lock
2024-03-12T14:50:11.686017169+08:00 stdout F 2024-03-12 06:50:11,685|p206|DEBUG|secretflow|_api.py:acquire:254| Attempting to acquire lock 140100392184048 on /tmp/ray/session_2024-03-12_06-50-08_464287_114/ports_by_node.json.lock
2024-03-12T14:50:11.686251582+08:00 stdout F 2024-03-12 06:50:11,686|p206|DEBUG|secretflow|_api.py:acquire:257| Lock 140100392184048 acquired on /tmp/ray/session_2024-03-12_06-50-08_464287_114/ports_by_node.json.lock
2024-03-12T14:50:11.68646654+08:00 stdout F 2024-03-12 06:50:11,686|p206|DEBUG|secretflow|_api.py:release:286| Attempting to release lock 140100392184048 on /tmp/ray/session_2024-03-12_06-50-08_464287_114/ports_by_node.json.lock
2024-03-12T14:50:11.686518903+08:00 stdout F 2024-03-12 06:50:11,686|p206|DEBUG|secretflow|_api.py:release:289| Lock 140100392184048 released on /tmp/ray/session_2024-03-12_06-50-08_464287_114/ports_by_node.json.lock
2024-03-12T14:50:11.686635222+08:00 stdout F 2024-03-12 06:50:11,686|p206|DEBUG|secretflow|_api.py:acquire:254| Attempting to acquire lock 140100392184384 on /tmp/ray/session_2024-03-12_06-50-08_464287_114/ports_by_node.json.lock
2024-03-12T14:50:11.686810281+08:00 stdout F 2024-03-12 06:50:11,686|p206|DEBUG|secretflow|_api.py:acquire:257| Lock 140100392184384 acquired on /tmp/ray/session_2024-03-12_06-50-08_464287_114/ports_by_node.json.lock
2024-03-12T14:50:11.686989597+08:00 stdout F 2024-03-12 06:50:11,686|p206|DEBUG|secretflow|_api.py:release:286| Attempting to release lock 140100392184384 on /tmp/ray/session_2024-03-12_06-50-08_464287_114/ports_by_node.json.lock
2024-03-12T14:50:11.687036962+08:00 stdout F 2024-03-12 06:50:11,686|p206|DEBUG|secretflow|_api.py:release:289| Lock 140100392184384 released on /tmp/ray/session_2024-03-12_06-50-08_464287_114/ports_by_node.json.lock
2024-03-12T14:50:11.687135158+08:00 stdout F 2024-03-12 06:50:11,687|p206|DEBUG|secretflow|_api.py:acquire:254| Attempting to acquire lock 140100392184336 on /tmp/ray/session_2024-03-12_06-50-08_464287_114/ports_by_node.json.lock
2024-03-12T14:50:11.687310276+08:00 stdout F 2024-03-12 06:50:11,687|p206|DEBUG|secretflow|_api.py:acquire:257| Lock 140100392184336 acquired on /tmp/ray/session_2024-03-12_06-50-08_464287_114/ports_by_node.json.lock
2024-03-12T14:50:11.687467717+08:00 stdout F 2024-03-12 06:50:11,687|p206|DEBUG|secretflow|_api.py:release:286| Attempting to release lock 140100392184336 on /tmp/ray/session_2024-03-12_06-50-08_464287_114/ports_by_node.json.lock
2024-03-12T14:50:11.687519596+08:00 stdout F 2024-03-12 06:50:11,687|p206|DEBUG|secretflow|_api.py:release:289| Lock 140100392184336 released on /tmp/ray/session_2024-03-12_06-50-08_464287_114/ports_by_node.json.lock
2024-03-12T14:50:11.687619051+08:00 stdout F 2024-03-12 06:50:11,687|p206|DEBUG|secretflow|_api.py:acquire:254| Attempting to acquire lock 140100392184048 on /tmp/ray/session_2024-03-12_06-50-08_464287_114/ports_by_node.json.lock
2024-03-12T14:50:11.687771607+08:00 stdout F 2024-03-12 06:50:11,687|p206|DEBUG|secretflow|_api.py:acquire:257| Lock 140100392184048 acquired on /tmp/ray/session_2024-03-12_06-50-08_464287_114/ports_by_node.json.lock
2024-03-12T14:50:11.687922058+08:00 stdout F 2024-03-12 06:50:11,687|p206|DEBUG|secretflow|_api.py:release:286| Attempting to release lock 140100392184048 on /tmp/ray/session_2024-03-12_06-50-08_464287_114/ports_by_node.json.lock
2024-03-12T14:50:11.687973865+08:00 stdout F 2024-03-12 06:50:11,687|p206|DEBUG|secretflow|_api.py:release:289| Lock 140100392184048 released on /tmp/ray/session_2024-03-12_06-50-08_464287_114/ports_by_node.json.lock
2024-03-12T14:50:11.688150801+08:00 stderr F 2024-03-12 06:50:11,688 INFO worker.py:1724 -- Connected to Ray cluster.
2024-03-12T14:50:12.879076558+08:00 stderr F 2024-03-12 06:50:12.878 INFO api.py:233 [p206] -- [Anonymous_job] Started rayfed with {'CLUSTER_ADDRESSES': {'p206': '0.0.0.0:8080', 'p142': 'http://xnxqwak96f8hdz1n-0-fed.p142.svc:80'}, 'CURRENT_PARTY_NAME': 'p206', 'TLS_CONFIG': {}}
2024-03-12T14:50:12.879160565+08:00 stderr F 2024-03-12 06:50:12.879 DEBUG message_queue.py:56 [p206] -- [Anonymous_job] Starting new thread[DataSendingQueueThread] for message polling.
2024-03-12T14:50:12.879386413+08:00 stderr F 2024-03-12 06:50:12.879 DEBUG cleanup.py:67 [p206] -- [Anonymous_job] Start check sending thread.
2024-03-12T14:50:12.879418662+08:00 stderr F 2024-03-12 06:50:12.879 DEBUG message_queue.py:56 [p206] -- [Anonymous_job] Starting new thread[ErrorSendingQueueThread] for message polling.
2024-03-12T14:50:12.879565062+08:00 stderr F 2024-03-12 06:50:12.879 DEBUG cleanup.py:69 [p206] -- [Anonymous_job] Start check error sending thread.
2024-03-12T14:50:12.879667437+08:00 stderr F 2024-03-12 06:50:12.879 DEBUG barriers.py:445 [p206] -- [Anonymous_job] Starting ReceiverProxyActor with options: {'max_concurrency': 1, 'max_task_retries': 3, 'max_restarts': 1, 'name': 'SenderReceiverProxyActor'}
2024-03-12T14:50:12.895469995+08:00 stderr F [33m(raylet)[0m [2024-03-12 06:50:12,807 I 890 890] logging.cc:230: Set ray log level from environment variable RAY_BACKEND_LOG_LEVEL to -1
2024-03-12T14:50:14.131918738+08:00 stderr F [36m(SenderReceiverProxyActor pid=2112)[0m 2024-03-12 06:50:14.126 INFO link.py:38 [p206] -- [Anonymous_job] brpc options: {'proxy_max_restarts': 3, 'timeout_in_ms': 300000, 'recv_timeout_ms': 604800000, 'connect_retry_times': 3600, 'connect_retry_interval_ms': 1000, 'brpc_channel_protocol': 'http', 'brpc_channel_connection_type': 'pooled', 'exit_on_sending_failure': True}
2024-03-12T14:50:14.238176106+08:00 stderr F [36m(SenderReceiverProxyActor pid=2112)[0m I0312 06:50:14.146009 2112 external/com_github_brpc_brpc/src/brpc/server.cpp:1158] Server[yacl::link::transport::internal::ReceiverServiceImpl] is serving on port=8080.
2024-03-12T14:50:14.238197905+08:00 stderr F [36m(SenderReceiverProxyActor pid=2112)[0m W0312 06:50:14.146037 2112 external/com_github_brpc_brpc/src/brpc/server.cpp:1164] Builtin services are disabled according to ServerOptions.has_builtin_services
2024-03-12T14:50:24.545254255+08:00 stderr F 2024-03-12 06:50:24.544 INFO barriers.py:465 [p206] -- [Anonymous_job] Succeeded to create receiver proxy actor.
2024-03-12T14:50:24.545320847+08:00 stderr F 2024-03-12 06:50:24.545 INFO barriers.py:520 [p206] -- [Anonymous_job] Try ping ['p142'] at 0 attemp, up to 3600 attemps.
2024-03-12T14:50:24.554569435+08:00 stderr F 2024-03-12 06:50:24.554 DEBUG pyu.py:105 [p206] -- [Anonymous_job] PYU remote function: <function load_table.unidecode is not installed, using Python's unicodedata package which yields worse results.
2024-03-12T14:50:27.049464281+08:00 stderr F 2024-03-12 06:50:27.049 INFO data_utils.py:368 [p206] -- [Anonymous_job] try load VDataFrame, file uri {'p206': DistdataInfo(uri='jobs/202403081720114425390/6a3fba1d-intersection-output', format='csv'), 'p142': DistdataInfo(uri='jobs/202403081720114425390/6a3fba1d-intersection-output', format='csv')}, file meta {PYURuntime(p142): {'ctime': 1710151665.3172581, 'mtime': 1710151632.2292585, 'size': 4259321735, 'inode': 85329290}, PYURuntime(p206): {'ctime': 1710151494.4723928, 'mtime': 1710151494.4713926, 'size': 4263323398, 'inode': 142487325}}
2024-03-12T14:50:27.049704982+08:00 stderr F 2024-03-12 06:50:27.049 INFO proxy.py:180 [p206] -- [Anonymous_job] Create proxy actor <class 'secretflow.data.core.agent.PartitionAgent'> with party p206.
2024-03-12T14:50:27.115902341+08:00 stderr F [36m(SenderReceiverProxyActor pid=2112)[0m 2024-03-12 06:50:27.047 DEBUG link.py:114 [p206] -- [Anonymous_job] Received data for 3 from 2#0.
2024-03-12T14:50:27.120965123+08:00 stderr F [36m(SenderReceiverProxyActor pid=2112)[0m 2024-03-12 06:50:27.047 DEBUG link.py:120 [p206] -- [Anonymous_job] Getted data for 3 from 2#0 of p142.
2024-03-12T14:50:27.120975656+08:00 stderr F [36m(SenderReceiverProxyActor pid=2112)[0m 2024-03-12 06:50:27.049 DEBUG barriers.py:397 [p206] -- [Anonymous_job] Sending send data to seq_id 3 of p142 from 1#0 without credentials.
2024-03-12T14:50:27.121021674+08:00 stderr F [36m(SenderReceiverProxyActor pid=2112)[0m 2024-03-12 06:50:27.049 DEBUG barriers.py:408 [p206] -- [Anonymous_job] Succeeded to send data to seq_id 3 of p142 from 1#0. Response is True
2024-03-12T14:50:27.200959456+08:00 stderr F 2024-03-12 06:50:27.200 DEBUG proxy.py:45 [p206] -- [Anonymous_job] Run method append_data of actor <class 'secretflow.data.core.agent.PartitionAgent'>, num_returns=1, args len: 2, kwargs len: 8.
2024-03-12T14:50:27.201520265+08:00 stderr F 2024-03-12 06:50:27.201 DEBUG fed_actor.py:104 [p206] -- [Anonymous_job] Actor method call: append_data, num_returns: 1
2024-03-12T14:50:27.203952825+08:00 stderr F 2024-03-12 06:50:27.203 INFO proxy.py:180 [p206] -- [Anonymous_job] Create proxy actor <class 'secretflow.data.core.agent.PartitionAgent'> with party p142.
2024-03-12T14:50:27.204581253+08:00 stderr F 2024-03-12 06:50:27.204 DEBUG proxy.py:45 [p206] -- [Anonymous_job] Run method append_data of actor <class 'secretflow.data.core.agent.PartitionAgent'>, num_returns=1, args len: 2, kwargs len: 8.
2024-03-12T14:50:27.204871206+08:00 stderr F 2024-03-12 06:50:27.204 DEBUG proxy.py:45 [p206] -- [Anonymous_job] Run method len of actor <class 'secretflow.data.core.agent.PartitionAgent'>, num_returns=1, args len: 1, kwargs len: 0.
2024-03-12T14:50:27.204944358+08:00 stderr F 2024-03-12 06:50:27.204 DEBUG utils.py:63 [p206] -- [Anonymous_job] Insert fed object, arg.party=p206
2024-03-12T14:50:27.204990085+08:00 stderr F 2024-03-12 06:50:27.204 DEBUG fed_actor.py:104 [p206] -- [Anonymous_job] Actor method call: len, num_returns: 1
2024-03-12T15:42:07.288318173+08:00 stderr F 2024-03-12 07:42:07.113 DEBUG proxy.py:45 [p206] -- [Anonymous_job] Run method len of actor <class 'secretflow.data.core.agent.PartitionAgent'>, num_returns=1, args len: 1, kwargs len: 0.
2024-03-12T15:42:09.544897483+08:00 stderr F 2024-03-12 07:42:09.544 DEBUG proxy.py:45 [p206] -- [Anonymous_job] Run method columns of actor <class 'secretflow.data.core.agent.PartitionAgent'>, num_returns=1, args len: 1, kwargs len: 0.
2024-03-12T15:42:09.557964549+08:00 stderr F 2024-03-12 07:42:09.557 DEBUG utils.py:63 [p206] -- [Anonymous_job] Insert fed object, arg.party=p206
2024-03-12T15:42:09.604776096+08:00 stderr F 2024-03-12 07:42:09.557 DEBUG fed_actor.py:104 [p206] -- [Anonymous_job] Actor method call: columns, num_returns: 1
2024-03-12T15:42:09.890581195+08:00 stderr F 2024-03-12 07:42:09.890 DEBUG proxy.py:45 [p206] -- [Anonymous_job] Run method columns of actor <class 'secretflow.data.core.agent.PartitionAgent'>, num_returns=1, args len: 1, kwargs len: 0.
2024-03-12T15:42:10.275935839+08:00 stderr F 2024-03-12 07:42:10.238 DEBUG proxy.py:45 [p206] -- [Anonymous_job] Run method shape of actor <class 'secretflow.data.core.agent.PartitionAgent'>, num_returns=1, args len: 1, kwargs len: 0.
2024-03-12T15:42:10.276023216+08:00 stderr F 2024-03-12 07:42:10.238 DEBUG utils.py:63 [p206] -- [Anonymous_job] Insert fed object, arg.party=p206
2024-03-12T15:42:10.292953805+08:00 stderr F 2024-03-12 07:42:10.239 DEBUG fed_actor.py:104 [p206] -- [Anonymous_job] Actor method call: shape, num_returns: 1
2024-03-12T15:42:10.493181787+08:00 stderr F 2024-03-12 07:42:10.420 DEBUG proxy.py:45 [p206] -- [Anonymous_job] Run method shape of actor <class 'secretflow.data.core.agent.PartitionAgent'>, num_returns=1, args len: 1, kwargs len: 0.
2024-03-12T15:42:10.509972551+08:00 stderr F 2024-03-12 07:42:10.454 INFO data_utils.py:374 [p206] -- [Anonymous_job] loaded VDataFrame, shape (500000, 903)
2024-03-12T15:42:10.535850685+08:00 stderr F 2024-03-12 07:42:10.500 INFO split.py:82 [p206] -- [Anonymous_job] Neither train_size nor test_size is empty, Here use train_size for split
2024-03-12T15:42:10.535923672+08:00 stderr F 2024-03-12 07:42:10.500 DEBUG proxy.py:45 [p206] -- [Anonymous_job] Run method apply_func of actor <class 'secretflow.data.core.agent.PartitionAgent'>, num_returns=1, args len: 2, kwargs len: 5.
2024-03-12T15:42:10.535943042+08:00 stderr F 2024-03-12 07:42:10.501 DEBUG utils.py:63 [p206] -- [Anonymous_job] Insert fed object, arg.party=p206
2024-03-12T15:42:10.535956755+08:00 stderr F 2024-03-12 07:42:10.501 DEBUG fed_actor.py:104 [p206] -- [Anonymous_job] Actor method call: apply_func, num_returns: 1
2024-03-12T15:52:45.368909798+08:00 stderr F 2024-03-12 07:52:45.179 ERROR component.py:1089 [p206] -- [Anonymous_job] eval on domain: "data_prep"
2024-03-12T15:52:45.836052963+08:00 stderr F name: "train_test_split"
2024-03-12T15:52:45.836076113+08:00 stderr F version: "0.0.1"
2024-03-12T15:52:45.83608213+08:00 stderr F attr_paths: "train_size"
2024-03-12T15:52:45.836087566+08:00 stderr F attr_paths: "test_size"
2024-03-12T15:52:45.836092823+08:00 stderr F attr_paths: "random_state"
2024-03-12T15:52:45.836097881+08:00 stderr F attr_paths: "shuffle"
2024-03-12T15:52:45.836115034+08:00 stderr F attrs {
2024-03-12T15:52:45.836120313+08:00 stderr F f: 0.800000011920929
2024-03-12T15:52:45.83612615+08:00 stderr F }
2024-03-12T15:52:45.836130734+08:00 stderr F attrs {
2024-03-12T15:52:45.836135525+08:00 stderr F f: 0.20000000298023224
2024-03-12T15:52:45.836140274+08:00 stderr F }
2024-03-12T15:52:45.836144846+08:00 stderr F attrs {
2024-03-12T15:52:45.836149926+08:00 stderr F i64: 64
2024-03-12T15:52:45.836154591+08:00 stderr F }
2024-03-12T15:52:45.836159678+08:00 stderr F attrs {
2024-03-12T15:52:45.836164384+08:00 stderr F b: true
2024-03-12T15:52:45.836169072+08:00 stderr F }
2024-03-12T15:52:45.836173926+08:00 stderr F inputs {
2024-03-12T15:52:45.836179351+08:00 stderr F name: "jobs/202403081720114425390/6a3fba1d-intersection-output"
2024-03-12T15:52:45.836184641+08:00 stderr F type: "sf.table.vertical_table"
2024-03-12T15:52:45.836189508+08:00 stderr F system_info {
2024-03-12T15:52:45.836194147+08:00 stderr F }
2024-03-12T15:52:45.836199268+08:00 stderr F meta {
2024-03-12T15:52:45.836204117+08:00 stderr F type_url: "type.googleapis.com/secretflow.spec.v1.VerticalTable"
2024-03-12T15:52:45.962768175+08:00 stderr P value: "\n\254\n\003ID2\022\003450\022\003451\022\003452\022\003453\022\003454\022\003455\022\003456\022\003457\022\003458\022\003459\022\003460\022\003461\022\003462\022\003463\022\003464\022\003465\022\003466\022\003467\022\003468\022\003469\022\003470\022\003471\022\003472\022\003473\022\003474\022\003475\022\003476\022\003477\022\003478\022\003479\022\003480\022\003481\022\003482\022\003483\022\003484\022\003485\022\003486\022\003487\022\003488\022\003489\022\003490\022\003491\022\003492\022\003493\022\003494\022\003495\022\003496\022\003497\022\003498\022\003499\022\003500\022\003501\022\003502\022\003503\022\003504\022\003505\022\003506\022\003507\022\003508\022\003509\022\003510\022\003511\022\003512\022\003513\022\003514\022\003515\022\003516\022\003517\022\003518\022\003519\022\003520\022\003521\022\003522\022\003523\022\003524\022\003525\022\003526\022\003527\022\003528\022\003529\022\003530\022\003531\022\003532\022\003533\022\003534\022\003535\022\003536\022\003537\022\003538\022\003539\022\003540\022\003541\022\003542\022\003543\022\003544\022\003545\022\003546\022\003547\022\003548\022\003549\022\003550\022\003551\022\003552\022\003553\022\003554\022\003555\022\003556\022\003557\022\003558\022\003559\022\003560\022\003561\022\003562\022\003563\022\003564\022\003565\022\003566\022\003567\022\003568\022\003569\022\003570\022\003571\022\003572\022\003573\022\003574\022\003575\022\003576\022\003577\022\003578\022\003579\022\003580\022\003581\022\003582\022\003583\022\003584\022\003585\022\003586\022\003587\022\003588\022\003589\022\003590\022\003591\022\003592\022\003593\022\003594\022\003595\022\003596\022\003597\022\003598\022\003599\022\003600\022\003601\022\003602\022\003603\022\003604\022\003605\022\003606\022\003607\022\003608\022\003609\022\003610\022\003611\022\003612\022\003613\022\003614\022\003615\022\003616\022\003617\022\003618\022\003619\022\003620\022\003621\022\003622\022\003623\022\003624\022\003625\022\003626\022\003627\022\003628\022\003629\022\003630\022\003631\022\003632\022\003633\022\003634\022\003635\022\003636\022\003637\022\003638\022\003639\022\003640\022\003641\022\003642\022\003643\022\003644\022\003645\022\003646\022\003647\022\003648\022\003649\022\003650\022\003651\022\003652\022\003653\022\003654\022\003655\022\003656\022\003657\022\003658\022\003659\022\003660\022\003661\022\003662\022\003663\022\003664\022\003665\022\003666\022\003667\022\003668\022\003669\022\003670\022\003671\022\003672\022\003673\022\003674\022\003675\022\003676\022\003677\022\003678\022\003679\022\003680\022\003681\022\003682\022\003683\022\003684\022\003685\022\003686\022\003687\022\003688\022\003689\022\003690\022\003691\022\003692\022\003693\022\003694\022\003695\022\003696\022\003697\022\003698\022\003699\022\003700\022\003701\022\003702\022\003703\022\003704\022\003705\022\003706\022\003707\022\003708\022\003709\022\003710\022\003711\022\003712\022\003713\022\003714\022\003715\022\003716\022\003717\022\003718\022\003719\022\003720\022\003721\022\003722\022\003723\022\003724\022\003725\022\003726\022\003727\022\003728\022\003729\022\003730\022\003731\022\003732\022\003733\022\003734\022\003735\022\003736\022\003737\022\003738\022\003739\022\003740\022\003741\022\003742\022\003743\022\003744\022\003745\022\003746\022\003747\022\003748\022\003749\022\003750\022\003751\022\003752\022\003753\022\003754\022\003755\022\003756\022\003757\022\003758\022\003759\022\003760\022\003761\022\003762\022\003763\022\003764\022\003765\022\003766\022\003767\022\003768\022\003769\022\003770\022\003771\022\003772\022\003773\022\003774\022\003775\022\003776\022\003777\022\003778\022\003779\022\003780\022\003781\022\003782\022\003783\022\003784\022\003785\022\003786\022\003787\022\003788\022\003789\022\003790\022\003791\022\003792\022\003793\022\003794\022\003795\022\003796\022\003797\022\003798\022\003799\022\003800\022\003801\022\003802\022\003803\022\003804\022\003805\022\003806\022\003807\022\003808\022\003809\022\003810\022\003811\022\003812\022\003813\022\003814\022\003815\022\003816\022\003817\022\003818\022\003819\022\003820\022\003821\022\003822\022\003823\022\003824\022\003825\022\003826\022\003827\022\003828\022\003829\022\003830\022\003831\022\003832\022\003833\022\003834\022\003835\022\003836\022\003837\022\003838\022\003839\022\003840\022\003841\022\003842\022\003843\022\003844\022\003845\022\003846\022\003847\022\003848\022\003849\022\003850\022\003851\022\003852\022\003853\022\003854\022\003855\022\003856\022\003857\022\003858\022\003859\022\003860\022\003861\022\003862\022\003863\022\003864\022\003865\022\003866\022\003867\022\003868\022\003869\022\003870\022\003871\022\003872\022\003873\022\003874\022\003875\022\003876\022\003877\022\003878\022\003879\022\003880\022\003881\022\003882\022\003883\022\003884\022\003885\022\003886\022\003887\022\003888\022\003889\022\003890\022\003891\022\003892\022\003893\022\003894\022\003895\022\003896\022\003897\022\003898\022\003899\022\003900\"\003int\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\003int\n\264)\n\003ID1\022\0010\022\0011\022\0012\022\0013\022\0014\022\0015\022\0016\022\0017\022\0018\022\0019\022\00210\022\00211\022\00212\022\00213\022\00214\022\00215\022\00216\022\00217\022\00218\022\00219\022\00220\022\00221\022\00222\022\00223\022\00224\022\00225\022\00226\022\00227\022\00228\022\00229\022\00230\022\00231\022\00232\022\00233\022\00234\022\00235\022\00236\022\00237\022\00238\022\00239\022\00240\022\00241\022\00242\022\00243\022\00244\022\00245\022\00246\022\00247\022\00248\022\00249\022\00250\022\00251\022\00252\022\00253\022\00254\022\00255\022\00256\022\00257\022\00258\022\00259\022\00260\022\00261\022\00262\022\00263\022\00264\022\00265\022\00266\022\00267\022\00268\022\00269\022\00270\022\00271\022\00272\022\00273\022\00274\022\00275\022\00276\022\00277\022\00278\022\00279\022\00280\022\00281\022\00282\022\00283\022\00284\022\00285\022\00286\022\00287\022\00288\022\00289\022\00290\022\00291\022\00292\022\00293\022\00294\022\00295\022\00296\022\00297\022\00298\022\00299\022\003100\022\003101\022\003102\022\003103\022\003104\022\003105\022\003106\022\003107\022\003108\022\003109\022\003110\022\003111\022\003112\022\003113\022\003114\022\003115\022\003116\022\003117\022\003118\022\003119\022\003120\022\003121\022\003122\022\003123\022\003124\022\003125\022\003126\022\003127\022\003128\022\003129\022\003130\022\003131\022\003132\022\003133\022\003134\022\003135\022\003136\022\003137\022\003138\022\003139\022\003140\022\003141\022\003142\022\003143\022\003144\022\003145\022\003146\022\003147\022\003148\022\003149\022\003150\022\003151\022\003152\022\003153\022\003154\022\003155\022\003156\022\003157\022\003158\022\003159\022\003160\022\003161\022\003162\022\003163\022\003164\022\003165\022\003166\022\003167\022\003168\022\003169\022\003170\022\003171\022\003172\022\003173\022\003174\022\003175\022\003176\022\003177\022\003178\022\003179\022\003180\022\003181\022\003182\022\003183\022\003184\022\003185\022\003186\022\003187\022\003188\022\003189\022\003190\022\003191\022\003192\022\003193\022\003194\022\003195\022\003196\022\003197\022\003198\022\003199\022\003200\022\003201\022\003202\022\003203\022\003204\022\003205\022\003206\022\003207\022\003208\022\003209\022\003210\022\003211\022\003212\022\003213\022\003214\022\003215\022\003216\022\003217\022\003218\022\003219\022\003220\022\003221\022\003222\022\003223\022\003224\022\003225\022\003226\022\003227\022\003228\022\003229\022\003230\022\003231\022\003232\022\003233\022\003234\022\003235\022\003236\022\003237\022\003238\022\003239\022\003240\022\003241\022\003242\022\003243\022\003244\022\003245\022\003246\022\003247\022\003248\022\003249\022\003250\022\003251\022\003252\022\003253\022\003254\022\003255\022\003256\022\003257\022\003258\022\003259\022\003260\022\003261\022\003262\022\003263\022\003264\022\003265\022\003266\022\003267\022\003268\022\003269\022\003270\022\003271\022\003272\022\003273\022\003274\022\003275\022\003276\022\003277\022\003278\022\003279\022\003280\022\003281\022\003282\022\003283\022\003284\022\003285\022\003286\022\003287\022\003288\022\003289\022\003290\022\003291\022\003292\022\003293\022\003294\022\003295\022\003296\022\003297\022\003298\022\003299\022\003300\022\003301\022\003302\022\003303\022\003304\022\003305\022\003306\022\003307\022\003308\022\003309\022\003310\022\003311\022\003312\022\003313\022\003314\022\003315\022\003316\022\003317\022\003318\022\003319\022\003320\022\003321\022\003322\022\003323\022\003324\022\003325\022\003326\022\003327\022\003328\022\003329\022\003330\022\003331\022\003332\022\003333\022\003334\022\003335\022\003336\022\003337\022\003338\022\003339\022\003340\022\003341\022\003342\022\003343\022\003344\022\003345\022\003346\022\003347\022\003348\022\003349\022\003350\022\003351\022\003352\022\003353\022\003354\022\003355\022\003356\022\003357\022\003358\022\003359\022\003360\022\003361\022\003362\022\003363\022\003364\022\003365\022\003366\022\003367\022\003368\022\003369\022\003370\022\003371\022\003372\022\003373\022\003374\022\003375\022\003376\022\003377\022\003378\022\003379\022\003380\022\003381\022\003382\022\003383\022\003384\022\003385\022\003386\022\003387\022\003388\022\003389\022\003390\022\003391\022\003392\022\003393\022\003394\022\003395\022\003396\022\003397\022\003398\022\003399\022\003400\022\003401\022\003402\022\003403\022\003404\022\003405\022\003406\022\003407\022\003408\022\003409\022\003410\022\003411\022\003412\022\003413\022\003414\022\003415\022\003416\022\003417\022\003418\022\003419\022\003420\022\003421\022\003422\022\003423\022\003424\022\003425\022\003426\022\003427\022\003428\022\003429\022\003430\022\003431\022\003432\022\003433\022\003434\022\003435\022\003436\022\003437\022\003438\022\003439\022\003440\022\003441\022\003442\022\003443\022\003444\022\003445\022\003446\022\003447\022\003448\022\003449\"\003int\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\0
2024-03-12T15:52:45.980585582+08:00 stderr F 05float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\005float\020\240\302\036"
2024-03-12T15:52:45.980595931+08:00 stderr F }
2024-03-12T15:52:45.980599687+08:00 stderr F data_refs {
2024-03-12T15:52:45.980611216+08:00 stderr F uri: "jobs/202403081720114425390/6a3fba1d-intersection-output"
2024-03-12T15:52:45.980615288+08:00 stderr F party: "p206"
2024-03-12T15:52:45.980618603+08:00 stderr F format: "csv"
2024-03-12T15:52:45.980621756+08:00 stderr F }
2024-03-12T15:52:45.980625098+08:00 stderr F data_refs {
2024-03-12T15:52:45.980628562+08:00 stderr F uri: "jobs/202403081720114425390/6a3fba1d-intersection-output"
2024-03-12T15:52:45.980631712+08:00 stderr F party: "p142"
2024-03-12T15:52:45.980634835+08:00 stderr F format: "csv"
2024-03-12T15:52:45.980638149+08:00 stderr F }
2024-03-12T15:52:45.980641301+08:00 stderr F }
2024-03-12T15:52:45.980644948+08:00 stderr F output_uris: "jobs/202403081720114425390/2b70c219-train-dataset"
2024-03-12T15:52:45.980648203+08:00 stderr F output_uris: "jobs/202403081720114425390/2b70c219-test-dataset"
2024-03-12T15:52:45.980651455+08:00 stderr F failed, error <The actor died unexpectedly before finishing this task.
2024-03-12T15:52:45.980654609+08:00 stderr F class_name:
2024-03-12T15:52:45.980658268+08:00 stderr F actor_id: 2893d845e68489717f48702501000000
2024-03-12T15:52:45.980661356+08:00 stderr F >
2024-03-12T15:52:45.980665026+08:00 stderr F 2024-03-12 07:52:45.180 INFO api.py:323 [p206] -- [Anonymous_job] Shutdowning rayfed intendedly...
2024-03-12T15:52:45.98069057+08:00 stderr F 2024-03-12 07:52:45.224 INFO api.py:337 [p206] -- [Anonymous_job] Wait for data sending.
2024-03-12T15:52:46.119616966+08:00 stderr F 2024-03-12 07:52:46.119 WARNING cleanup.py:154 [p206] -- [Anonymous_job] Failed to send ObjectRef(1e360ffa862f8fe38785f295bdc692c3a41f42960100000001000000) to p142, error: [36mray::SenderReceiverProxyActor.send()[39m (pid=2112, ip=xnxqwak96f8hdz1n-0-global.p206.svc, actor_id=8785f295bdc692c3a41f429601000000, repr=<fed.proxy.barriers.SenderReceiverProxyActor object at 0x7fa9543dc5e0>)
2024-03-12T15:52:46.119636093+08:00 stderr F At least one of the input arguments for this task could not be computed:
2024-03-12T15:52:46.119643025+08:00 stderr F ray.exceptions.RayActorError: The actor died unexpectedly before finishing this task.
2024-03-12T15:52:46.11965436+08:00 stderr F class_name:
2024-03-12T15:52:46.119660498+08:00 stderr F actor_id: 2893d845e68489717f48702501000000,upstream_seq_id: 22#0, downstream_seq_id: 23.
2024-03-12T15:52:46.158953838+08:00 stderr F 2024-03-12 07:52:46.119 INFO cleanup.py:161 [p206] -- [Anonymous_job] Sending error The actor died unexpectedly before finishing this task.
2024-03-12T15:52:46.15896979+08:00 stderr F class_name:
2024-03-12T15:52:46.158979164+08:00 stderr F actor_id: 2893d845e68489717f48702501000000
2024-03-12T15:52:46.158982875+08:00 stderr F to p142.
2024-03-12T15:52:46.222469775+08:00 stderr F 2024-03-12 07:52:46.222 DEBUG message_queue.py:96 [p206] -- [Anonymous_job] Killing thread[DataSendingQueueThread].
2024-03-12T15:52:46.222765741+08:00 stderr F 2024-03-12 07:52:46.222 INFO message_queue.py:70 [p206] -- [Anonymous_job] Notify message polling thread[DataSendingQueueThread] to exit.
2024-03-12T15:52:46.222953024+08:00 stderr F 2024-03-12 07:52:46.222 INFO message_queue.py:100 [p206] -- [Anonymous_job] The message polling thread[DataSendingQueueThread] was exited.
2024-03-12T15:52:46.223028977+08:00 stderr F 2024-03-12 07:52:46.222 DEBUG message_queue.py:96 [p206] -- [Anonymous_job] Killing thread[ErrorSendingQueueThread].
2024-03-12T15:52:46.22313566+08:00 stderr F 2024-03-12 07:52:46.223 INFO message_queue.py:70 [p206] -- [Anonymous_job] Notify message polling thread[ErrorSendingQueueThread] to exit.
2024-03-12T15:52:46.443652834+08:00 stderr F 2024-03-12 07:52:46.443 DEBUG cleanup.py:190 [p206] -- [Anonymous_job] Sending error got response: True.
2024-03-12T15:52:46.443827276+08:00 stderr F 2024-03-12 07:52:46.443 INFO message_queue.py:100 [p206] -- [Anonymous_job] The message polling thread[ErrorSendingQueueThread] was exited.
2024-03-12T15:52:46.44389583+08:00 stderr F 2024-03-12 07:52:46.443 INFO barriers.py:469 [p206] -- [Anonymous_job] Stop sender proxy actor...
2024-03-12T15:52:47.662372672+08:00 stderr F 2024-03-12 07:52:47.662 INFO barriers.py:473 [p206] -- [Anonymous_job] Sender proxy actor stoped.
2024-03-12T15:52:47.662405387+08:00 stderr F 2024-03-12 07:52:47.662 INFO api.py:365 [p206] -- [Anonymous_job] Shutdowned rayfed.
2024-03-12T15:52:47.663856384+08:00 stderr F [33m(raylet)[0m [2024-03-12 06:50:27,635 I 2392 2392] logging.cc:230: Set ray log level from environment variable RAY_BACKEND_LOG_LEVEL to -1
2024-03-12T15:52:47.83858855+08:00 stderr F [36m(PartitionAgent pid=2392)[0m WARNING:root:Since the GPL-licensed package unidecode is not installed, using Python's unicodedata package which yields worse results.
2024-03-12T15:52:56.527350589+08:00 stderr F Traceback (most recent call last):
2024-03-12T15:52:56.52738+08:00 stderr F File "/usr/local/lib/python3.10/runpy.py", line 196, in _run_module_as_main
2024-03-12T15:52:56.815824136+08:00 stderr F return _run_code(code, main_globals, None,
2024-03-12T15:52:56.815845927+08:00 stderr F File "/usr/local/lib/python3.10/runpy.py", line 86, in _run_code
2024-03-12T15:52:56.81590097+08:00 stderr F exec(code, run_globals)
2024-03-12T15:52:56.815906631+08:00 stderr F File "/usr/local/lib/python3.10/site-packages/secretflow/kuscia/entry.py", line 547, in
Chrisdehe
commented
8 months ago
请按照这个版本对应关系检查一下版本间是否对应
T-ze-yu
commented
8 months ago 应该不是版本的问题，小数据量是都可以跑通的
Chrisdehe
commented
8 months ago 目前错误只有Ray抛出的异常，位置是在分割这里，但不能认定为分割错误，可能是PSI过程有问题，之前你的PSI问题也是小数据了可以跑通，我在想是否存在关联，可以先检查一下PSI的输出结果是否正常吧
T-ze-yu
commented
8 months ago 求交结果没有问题的，后又做了200维特征的，求交日志也是在同样的地方卡了一段时间，只不过没450维的长。但后续做随机分割任务是成功了的
T-ze-yu
commented
8 months ago 求交结果没有问题的，后又做了200维特征的，求交日志也是在同样的地方卡了一段时间，只不过没450维的长。但后续做随机分割任务是成功了的
fy222fy
commented
8 months ago 求交结果没有问题的，后又做了200维特征的，求交日志也是在同样的地方卡了一段时间，只不过没450维的长。但后续做随机分割任务是成功了的
少特征没问题，随机分割成功，但是多特征有问题是吧？那考虑下是不是内存溢出oom了，运行过程中观察过内存用量吗？
fy222fy
commented
8 months ago grep "Out of memory" /var/log/messages
查看下oom的日志有没有
T-ze-yu
commented
8 months ago 观察过基本都有较多的内存剩余，是不是在容器中资源初始化或分配存在问题；请确认一下，我没有找到这个文件：/var/log/messages
T-ze-yu
commented
8 months ago
请按照这个版本对应关系检查一下版本间是否对应
能否告知一下kuscia和sf的版本号具体怎么查看，我只能看到都是latest
T-ze-yu
commented
8 months ago
能否告知一下这个的版本号具体怎么查看，我只能看到都是latest
T-ze-yu
commented
8 months ago 感谢，确实是版本的问题，在更换为版本1.4.0.dev24011601后，可以顺利运行了
T-ze-yu
commented
8 months ago 方便问下这个版本间的对应关系在相关文档中有提到吗？有的话请给个链接，谢谢！
Chrisdehe
commented
7 months ago 目前这个文档正在更新到官网中，等更新后我同步
T-ze-yu
commented
7 months ago [Uploading ss.log…]()
我在新的版本组合中又遇到一样的报错
还是在相同的俩台机器，资源仍然有较多剩余，在进行ss-xgb-train的任务时的报错日志上传到了文件。
[Uploading ss.log…]()
T-ze-yu
commented
7 months ago 024-04-11T17:42:33.671940642+08:00 stderr F [36m(SenderReceiverProxyActor pid=2087)[0m 2024-04-11 09:42:33.596 DEBUG barriers.py:408 [p207] -- [Anonymous_job] Succeeded to send data to seq_id 3516 of p208 from 3514#1. Response is True 2024-04-11T17:42:33.671942+08:00 stderr F [36m(SenderReceiverProxyActor pid=2087)[0m 2024-04-11 09:42:33.596 DEBUG barriers.py:397 [p207] -- [Anonymous_job] Sending send data to seq_id 3516 of p208 from 3514#0 without credentials. 2024-04-11T17:42:33.671943443+08:00 stderr F [36m(SenderReceiverProxyActor pid=2087)[0m 2024-04-11 09:42:33.596 DEBUG barriers.py:408 [p207] -- [Anonymous_job] Succeeded to send data to seq_id 3516 of p208 from 3514#0. Response is True 2024-04-11T17:42:33.671955725+08:00 stderr F [36m(SenderReceiverProxyActor pid=2087)[0m 2024-04-11 09:42:33.607 DEBUG barriers.py:397 [p207] -- [Anonymous_job] Sending send data to seq_id 3523 of p208 from 3521#1 without credentials. 2024-04-11T17:42:33.671959206+08:00 stderr F [36m(SenderReceiverProxyActor pid=2087)[0m 2024-04-11 09:42:33.607 DEBUG barriers.py:408 [p207] -- [Anonymous_job] Succeeded to send data to seq_id 3523 of p208 from 3521#1. Response is True 2024-04-11T17:42:33.684709924+08:00 stderr F 2024-04-11 09:42:33.684 DEBUG cleanup.py:190 [p207] -- [Anonymous_job] Sending error got response: True. 2024-04-11T17:42:33.684922579+08:00 stderr F 2024-04-11 09:42:33.684 INFO message_queue.py:100 [p207] -- [Anonymous_job] The message polling thread[ErrorSendingQueueThread] was exited. 2024-04-11T17:42:33.685173919+08:00 stderr F 2024-04-11 09:42:33.685 INFO barriers.py:469 [p207] -- [Anonymous_job] Stop sender proxy actor... 2024-04-11T17:43:43.009289553+08:00 stderr F SIGTERM received at time=1712828623 on cpu 15 2024-04-11T17:43:43.010577526+08:00 stderr F PC: @ 0x7fe299e0e79a (unknown) pthread_cond_timedwait@@GLIBC_2.3.2 2024-04-11T17:43:43.010592165+08:00 stderr F @ 0x7fe299e12ce0 (unknown) (unknown) 2024-04-11T17:43:43.010608288+08:00 stderr F [2024-04-11 09:43:43,010 E 7 7] logging.cc:361: SIGTERM received at time=1712828623 on cpu 15 2024-04-11T17:43:43.010620494+08:00 stderr F [2024-04-11 09:43:43,010 E 7 7] logging.cc:361: PC: @ 0x7fe299e0e79a (unknown) pthread_cond_timedwait@@GLIBC_2.3.2 2024-04-11T17:43:43.010641961+08:00 stderr F [2024-04-11 09:43:43,010 E 7 7] logging.cc:361: @ 0x7fe299e12ce0 (unknown) (unknown) 2024-04-11T17:43:44.699523631+08:00 stdout F [36m(_run pid=455)[0m [2024-04-11 09:38:04.964] [info] [thread_pool.cc:30] Create a fixed thread pool with size 31 2024-04-11T17:43:44.700006371+08:00 stdout F [33m(raylet)[0m A worker died or was killed while executing a task by an unexpected system error. To troubleshoot the problem, check the logs for the dead worker. RayTask ID: ffffffffffffffff9048b3f64869ca41a66c751c01000000 Worker ID: df5cd600ba86537848e15c2b006c4b05dd8811565362fc776e0108fd Node ID: 1b604bcd2ab010c2dc2011db82b2ce2e68e1350903c9b9a4a0b66760 Worker IP address: w7xpgmsbzx3d8vgm-0-global.p207.svc Worker port: 10036 Worker PID: 2217 Worker exit type: SYSTEM_ERROR Worker exit detail: Worker unexpectedly exits with a connection error code 2. End of file. There are some potential root causes. (1) The process is killed by SIGKILL by OOM killer due to high memory usage. (2) ray stop --force is called. (3) The worker is crashed unexpectedly due to SIGSEGV or other unexpected errors. 2024-04-11T17:43:44.700209889+08:00 stdout F [33m(raylet)[0m A worker died or was killed while executing a task by an unexpected system error. To troubleshoot the problem, check the logs for the dead worker. RayTask ID: fffffffffffffffff0216ee0d1a74906ddf77a3f01000000 Worker ID: df2bbc608db9f361a8e98fb43f493f42487344df71118b7a24a6272e Node ID: 1b604bcd2ab010c2dc2011db82b2ce2e68e1350903c9b9a4a0b66760 Worker IP address: w7xpgmsbzx3d8vgm-0-global.p207.svc Worker port: 10038 Worker PID: 2618 Worker exit type: SYSTEM_ERROR Worker exit detail: Worker unexpectedly exits with a connection error code 2. End of file. There are some potential root causes. (1) The process is killed by SIGKILL by OOM killer due to high memory usage. (2) ray stop --force is called. (3) The worker is crashed unexpectedly due to SIGSEGV or other unexpected errors.
Chrisdehe
commented
7 months ago @T-ze-yu 请参考secretpad版本对应关系表查看及其机器是否符合 https://github.com/secretflow/secretpad
T-ze-yu
commented
7 months ago 好的
T-ze-yu
commented
7 months ago
按照这个版本重新跑了一篇在进行ss-xgb-train的任务时还是报错了，下面是任务运行时机器资源的情况：
ian-huu
commented
7 months ago 能够提供一下另一个节点的日志吗，可能会有更多有用的信息
ian-huu
commented
7 months ago SS-XGB 内存占用比较高，50w 450维应该是内存不够（监控可能没捕捉到瞬时的内存占用），建议用 SGB 跑一下
T-ze-yu
commented
7 months ago 好的，我尝试一下
T-ze-yu
commented
7 months ago 确实，在换成 SGB后，跑了大概二十多分钟，成功结束了任务
T-ze-yu
commented
7 months ago 这个任务需要的内存也比较多吗？
da-niao-dan
commented
5 months ago hello, secure_device_type 用 heu 而不是spu 试一下吧。 数据维度较高，ss 方法可能内存消耗较大
T-ze-yu
commented
4 months ago T-ze-yu
commented
4 months ago 补充一下现在的程序版本信息和机器资源信息：
jaronnie
在进行50w*450维数据求交之后，继续做数据分割失败了，下面是任务日志 50w-split.log