search

EUDAT-B2SAFE / B2SAFE-core

B2SAFE service core code for EUDAT project
Other
14 stars 20 forks source link

testEUDATCheckReplicas.r fails.. #9

Closed cookie33 closed 10 years ago

cookie33 commented 10 years ago

after updating testEUDATCheckReplicas.r with a destination file it fails running. The destination does NOT exist. Before (pre 2.2) I could use checkreplica's to replicate to an other zone.

The execution of the rule:

14:40 irodstest2.storage.sara.nl:/home/rods rods$ time irule -F /opt/irods3.3/iRODS/modules/B2SAFE/rules/testEUDATCheckReplicas.r ERROR: readMsgHeader:header read- read 0 bytes, expect 4, status = -4115 ERROR: readAndProcApiReply: readMsgHeader error. status = -4115 status = -4115 SYS_HEADER_READ_LEN_ERR, Operation now in progress ERROR: rcExecMyRule error. status = -4115 SYS_HEADER_READ_LEN_ERR, Operation now in progress Client Caught broken pipe signal. Connection to server may be down ERROR: writeMsgHeader: wrote 0 bytes, expect 140, status = -5032

real 0m1.782s user 0m0.002s sys 0m0.001s

The logfile shows: Aug 12 14:41:16 pid:1910 NOTICE: Agent process 21552 exited with status 0 Aug 12 14:41:16 pid:1910 NOTICE: Agent process 21573 started for puser=rods and cuser=rods from 145.100.3.239 Aug 12 14:41:16 pid:21573 NOTICE: rsAuthCheck user rods#bob Aug 12 14:41:16 pid:21573 NOTICE: rsAuthResponse set proxy authFlag to 5, client authFlag to 5, user:rods#bob proxy:rods client:rods Aug 12 14:41:16 pid:21573 NOTICE: msiWriteToLog :: Check if 2 replicas have the same checksum. Source = /bob/home/rods/test.txt, destination = /alice/home/rods#bob/test.txt Aug 12 14:41:16 pid:21573 NOTICE: msiWriteToLog :: [EUDATCatchErrorChecksum] Check if 2 replicas have the same checksum. Source = /bob/home/rods/test.txt, destination = /alice/home/rods#bob/test.txt Aug 12 14:41:16 pid:21573 NOTICE: msiWriteToLog :: checksum0 = 5ba292bfdcb3f30a1412869844a536bc Aug 12 14:41:16 pid:1910 NOTICE: Agent process 21575 started for puser=rods and cuser=rods from 145.100.3.238 Aug 12 14:41:16 pid:21575 NOTICE: rsAuthCheck user rods#bob Aug 12 14:41:16 pid:21575 NOTICE: readAndProcClientMsg: received disconnect msg from client Aug 12 14:41:16 pid:21575 NOTICE: Agent exiting with status = 0 Aug 12 14:41:16 pid:21573 NOTICE: msiWriteToLog :: search pid for /bob/home/rods/test.txt Aug 12 14:41:16 pid:21573 NOTICE: msiWriteToLog :: checking authorization for rods#bob to perform: read /opt/irods/modules/B2SAFE/conf/SURFsara_credentials Aug 12 14:41:17 pid:21573 NOTICE: msiWriteToLog :: authorization granted Aug 12 14:41:17 pid:21573 NOTICE: msiWriteToLog :: EUDATePIDsearch -> search the PID with URL equal to irods://irodstest2.storage.sara.nl:1247/bob/home/rods/test.txt Aug 12 14:41:17 pid:21573 NOTICE: msiWriteToLog :: checking authorization for rods#bob to perform: read /opt/irods/modules/B2SAFE/conf/SURFsara_credentials Aug 12 14:41:17 pid:21573 NOTICE: msiWriteToLog :: authorization granted Aug 12 14:41:17 pid:21573 NOTICE: msiWriteToLog :: EUDATePIDsearch -> search handle response = 842/769fc154-2168-11e4-b968-5254007aa3c8 Aug 12 14:41:17 pid:21573 NOTICE: msiWriteToLog :: 5ba292bfdcb3f30a1412869844a536bc != , existing_pid = 842/769fc154-2168-11e4-b968-5254007aa3c8 Aug 12 14:41:17 pid:21573 NOTICE: msiWriteToLog :: [EUDATCatchErrorSize] Check if 2 replicas have the same size.Source = /bob/home/rods/test.txt, destination = /alice/home/rods#bob/test.txt Aug 12 14:41:17 pid:21573 NOTICE: msiWriteToLog :: Size /bob/home/rods/test.txt = 766 Aug 12 14:41:17 pid:21573 NOTICE: msiWriteToLog :: search pid for /bob/home/rods/test.txt Aug 12 14:41:17 pid:21573 NOTICE: msiWriteToLog :: checking authorization for rods#bob to perform: read /opt/irods/modules/B2SAFE/conf/SURFsara_credentials Aug 12 14:41:17 pid:21573 NOTICE: msiWriteToLog :: authorization granted Aug 12 14:41:17 pid:21573 NOTICE: msiWriteToLog :: EUDATePIDsearch -> search the PID with URL equal to irods://irodstest2.storage.sara.nl:1247/bob/home/rods/test.txt Aug 12 14:41:17 pid:21573 NOTICE: msiWriteToLog :: checking authorization for rods#bob to perform: read /opt/irods/modules/B2SAFE/conf/SURFsara_credentials Aug 12 14:41:17 pid:21573 NOTICE: msiWriteToLog :: authorization granted Aug 12 14:41:18 pid:21573 NOTICE: msiWriteToLog :: EUDATePIDsearch -> search handle response = 842/769fc154-2168-11e4-b968-5254007aa3c8 Aug 12 14:41:18 pid:21573 NOTICE: msiWriteToLog :: 766 != , existing_pid = 842/769fc154-2168-11e4-b968-5254007aa3c8 Aug 12 14:41:18 pid:21573 NOTICE: msiWriteToLog :: EUDATeiPIDeiChecksumMgmt -> Look if the PID is in the iCAT Aug 12 14:41:18 pid:21573 NOTICE: msiWriteToLog :: EUDATiFieldVALUEretrieve -> looking for PID of /bob/home/rods/test.txt Aug 12 14:41:18 pid:21573 NOTICE: msiWriteToLog :: EUDATeiPIDeiChecksumMgmt -> No PID registered in iCAT. Looking on the EPIC server. Aug 12 14:41:18 pid:21573 NOTICE: msiWriteToLog :: EUDATgetObjectTimeDiff -> Created at 1407768820 Aug 12 14:41:18 pid:21573 NOTICE: msiWriteToLog :: EUDATgetObjectTimeDiff -> Modified at 1407768820 Aug 12 14:41:18 pid:21573 NOTICE: msiWriteToLog :: EUDATgetObjectTimeDiff -> Difference in time: 0 seconds Aug 12 14:41:18 pid:21573 NOTICE: msiWriteToLog :: search pid for /bob/home/rods/test.txt Aug 12 14:41:18 pid:21573 NOTICE: msiWriteToLog :: checking authorization for rods#bob to perform: read /opt/irods/modules/B2SAFE/conf/SURFsara_credentials Aug 12 14:41:18 pid:21573 NOTICE: msiWriteToLog :: authorization granted Aug 12 14:41:18 pid:21573 NOTICE: msiWriteToLog :: EUDATePIDsearch -> search the PID with URL equal to irods://irodstest2.storage.sara.nl:1247/bob/home/rods/test.txt Aug 12 14:41:18 pid:21573 NOTICE: msiWriteToLog :: checking authorization for rods#bob to perform: read /opt/irods/modules/B2SAFE/conf/SURFsara_credentials Aug 12 14:41:18 pid:21573 NOTICE: msiWriteToLog :: authorization granted Aug 12 14:41:18 pid:21573 NOTICE: msiWriteToLog :: EUDATePIDsearch -> search handle response = 842/769fc154-2168-11e4-b968-5254007aa3c8 Aug 12 14:41:18 pid:21573 NOTICE: msiWriteToLog :: EUDATeiPIDeiChecksumMgmt -> Modifying the PID in epic server: 842/769fc154-2168-11e4-b968-5254007aa3c8 Aug 12 14:41:18 pid:21573 NOTICE: execRule: no more rules: EUDATeCHECKSUMupdate with status -1018000 Aug 12 14:41:18 pid:21573 NOTICE: execRule: applyRule Failed: EUDATeCHECKSUMupdate with status -1017000 Aug 12 14:41:18 pid:21573 ERROR: executeRuleAction Failed for EUDATeCHECKSUMupdate status = -1097000 NO_RULE_OR_MSI_FUNCTION_FOUND_ERR Aug 12 14:41:18 pid:21573 NOTICE: executeRuleBody: Micro-service or Action EUDATeCHECKSUMupdate Failed with status -1097000 Aug 12 14:41:18 pid:21573 ERROR: executeRuleAction Failed for if status = -1097000 NO_RULE_OR_MSI_FUNCTION_FOUND_ERR Aug 12 14:41:18 pid:21573 NOTICE: executeRuleBody: Micro-service or Action if Failed with status -1097000 Aug 12 14:41:18 pid:21573 ERROR: executeRuleAction Failed for if status = -1097000 NO_RULE_OR_MSI_FUNCTION_FOUND_ERR Aug 12 14:41:18 pid:21573 NOTICE: executeRuleBody: Micro-service or Action if Failed with status -1097000 Aug 12 14:41:18 pid:21573 NOTICE: execRuleNodeRes: applyRule Failed: EUDATeiPIDeiChecksumMgmt with status -1097000 Aug 12 14:41:18 pid:21573 NOTICE: execRule: no more rules: EUDATeiPIDeiChecksumMgmt with status -1018000 Aug 12 14:41:18 pid:21573 NOTICE: execRule: applyRule Failed: EUDATeiPIDeiChecksumMgmt with status -1097000 Aug 12 14:42:10 pid:1910 NOTICE: Agent process 21573 exited with status 11 Aug 12 14:42:10 pid:1910 NOTICE: Agent process 21575 exited with status 0 Aug 12 14:42:10 pid:1910 NOTICE: Agent process 21620 started for puser=rods and cuser=rods from 145.100.3.239

lphan commented 10 years ago

Hi Robert, I found the cause: line 285 in pid-service.re, it lacks one parameter, can you change it into EUDATeCHECKSUMupdate(PID, path); and test again ? , also lines 258 and 27 need to be updated.

Long

cookie33 commented 10 years ago

Hi,

This works better, But it stails fails.

Aug 12 15:24:51 pid:22644 NOTICE: msiWriteToLog :: EUDATiFieldVALUEretrieve -> looking for EUDAT/ROR of /bob/home/rods/test.txt Aug 12 15:24:51 pid:22644 NOTICE: msiWriteToLog :: checking authorization for rods#bob to perform: read /opt/irods/modules/B2SAFE/conf/SURFsara_credentials Aug 12 15:24:51 pid:22644 NOTICE: msiWriteToLog :: authorization granted Aug 12 15:24:51 pid:22644 NOTICE: msiWriteToLog :: EUDATiRORupdate -> modify ROR in iCAT related to to the path /bob/home/rods/test.txt Aug 12 15:24:51 pid:22644 NOTICE: msiWriteToLog :: EUDATiRORupdate -> NO ROR for 842/769fc154-2168-11e4-b968-5254007aa3c8 Aug 12 15:24:51 pid:22644 NOTICE: msiWriteToLog :: EUDATiRORupdate -> saved ROR None for PID 842/769fc154-2168-11e4-b968-5254007aa3c8 Aug 12 15:24:51 pid:22644 NOTICE: msiWriteToLog :: replication from /bob/home/rods/test.txt to /alice/home/rods#bob/test2.txt Aug 12 15:24:51 pid:22644 NOTICE: msiWriteToLog :: startReplication(/bob/replicate/_alice_home_rods#bob_test2.txt.replicate,842/769fc154-2168-11e4-b968-5254007aa3c8,/bob/home/rods/test.txt,/alice/home/rods#bob/test2.txt) Aug 12 15:24:51 pid:22644 NOTICE: msiWriteToLog :: get RoR from (842/769fc154-2168-11e4-b968-5254007aa3c8) Aug 12 15:24:51 pid:22644 NOTICE: msiWriteToLog :: checking authorization for rods#bob to perform: read /opt/irods/modules/B2SAFE/conf/SURFsara_credentials Aug 12 15:24:51 pid:22644 NOTICE: msiWriteToLog :: authorization granted Aug 12 15:24:52 pid:22644 NOTICE: msiWriteToLog :: getRorPID -> NO ROR for 842/769fc154-2168-11e4-b968-5254007aa3c8 Aug 12 15:24:52 pid:22644 NOTICE: msiWriteToLog :: checking authorization for rods#bob to perform: read /opt/irods/modules/B2SAFE/conf/SURFsara_credentials Aug 12 15:24:52 pid:22644 NOTICE: msiWriteToLog :: authorization granted Aug 12 15:24:52 pid:22644 NOTICE: execRule: no more rules: processReplicationCommandFile with status -1018000 Aug 12 15:24:52 pid:22644 NOTICE: execRule: applyRule Failed: processReplicationCommandFile with status -1017000 Aug 12 15:24:52 pid:22644 ERROR: executeRuleAction Failed for processReplicationCommandFile status = -1097000 NO_RULE_OR_MSI_FUNCTION_FOUND_ERR Aug 12 15:24:52 pid:22644 NOTICE: executeRuleBody: Micro-service or Action processReplicationCommandFile Failed with status -1097000 Aug 12 15:24:52 pid:22644 NOTICE: execRuleNodeRes: applyRule Failed: acPostProcForPut with status -1097000 Aug 12 15:24:52 pid:22644 NOTICE: readAndProcClientMsg: received disconnect msg from client Aug 12 15:24:52 pid:22644 NOTICE: Agent exiting with status = 0

Might this be that I need to rename processReplicationCommandFile and processPIDCommandFile to something else?

cookie33 commented 10 years ago

This last item was my problem when updating core.re with the correct sentance..

It was missing a $objPath.

Greetings,

Robert Verkerk

lphan commented 10 years ago

Does the test work after all ? I will then update the fix for function EUDATeCHECKSUMupdate(...).

Long

cookie33 commented 10 years ago

Hi Long,

After the updates it works. So the fix for EUDATeCHECKSUMupdate fixes it..

greetings,

Robert Verkerk

lphan commented 10 years ago

Hi Robert, I updated the fix, so we close this issue. Thanks for testing. Cheers,

Long