search

irods / irods_resource_plugin_rados

Cacheless Ceph/rados resource plugin for iRODS
BSD 3-Clause "New" or "Revised" License
7 stars 6 forks source link

Direct Access of Impostor Resource Error #3

Open kript opened 7 years ago

kript commented 7 years ago

Following the README, We setup an iCAT and an iRES, both pointing to the same ceph pool (we run Jewell, 10.2.3 if thats helpful) ;

irods@irods-ceph-test-ires:/tmp$ ilsresc
demoResc
irods-ceph-test-iresResource
rrirados:roundrobin
├── irods-ceph-test-ires-radosResc:irados
└── radosResc:irados

..

irods@irods-ceph-test-ires:/tmp$ iadmin lr radosResc
resc_id: 10005
resc_name: radosResc
zone_name: tempZone
resc_type_name: irados
resc_net: irods-ceph-test
resc_def_path: /
free_space: 
free_space_ts Never
resc_info: 
r_comment: 
resc_status: 
create_ts 2017-05-31.14:43:51
modify_ts 2017-05-31.15:51:01
resc_children: 
resc_context: ceph|test-irods|client.irods-test
resc_parent: rrirados
resc_objcount: 2

...

irods@irods-ceph-test-ires:/tmp$ iadmin lr irods-ceph-test-ires-radosResc
resc_id: 10010
resc_name: irods-ceph-test-ires-radosResc
zone_name: tempZone
resc_type_name: irados
resc_net: irods-ceph-test-ires
resc_def_path: /
free_space: 
free_space_ts Never
resc_info: 
r_comment: 
resc_status: 
create_ts 2017-05-31.15:37:40
modify_ts 2017-05-31.15:50:03
resc_children: 
resc_context: ceph|test-irods|client.irods-test
resc_parent: rrirados
resc_objcount: 0

Putting files in goes OK until we try and put a file in that is the same but with a different name;

irods@irods-ceph-test-ires:/tmp$ ils -L
/tempZone/home/rods:
  rods              0 rrirados;radosResc   2147483648 2017-05-31.15:51 & 2Gfile
    sha2:p8dEwTzBAe1mwp9nL5JFVUeInMWGzm1E/naugklY6lE=    generic    862c10b7-213c-4dfd-81ac-8cf1121aced4
  rods              0 rrirados;radosResc          476 2017-05-31.14:43 & VERSION.json
    sha2:bD30R9IqOq5fqrE/iw1KPbwICHd7QjZSxqCxVCLnF0A=    generic    e365021b-36ec-45f4-878c-354698c0656e

...

irods@irods-ceph-test-ires:/tmp$ time iput  -R rrirados /tmp/2Gfile_1 
ERROR: putUtil: put error for /tempZone/home/rods/2Gfile_1, status = -24000 status = -24000 SYS_INTERNAL_NULL_INPUT_ERR
NOTE :: Direct Access of Impostor Resource [irods-ceph-test-ires-radosResc] of Given Type [irados]

real    0m0.128s
user    0m0.010s
sys 0m0.000s

system log is;

Jun  1 08:29:04 pid:14302 ERROR: [-]    iRODS/server/api/src/rsFileCreate.cpp:220:_rsFileCreate :  status [INVALID_ACCESS_TO_IMPOSTOR_RESOURCE]  errno [] -- message [UNHANDLED fileCreate for [//home/rods/2Gfile_1]]
        [-]     iRODS/server/drivers/src/fileDriver.cpp:38:fileCreate :  status [INVALID_ACCESS_TO_IMPOSTOR_RESOURCE]  errno [] -- message [failed to call 'create']
                [-]     iRODS/server/core/src/irods_resource_plugin_impostor.cpp:525:report_error :  status [INVALID_ACCESS_TO_IMPOSTOR_RESOURCE]  errno [] -- message [NOTE :: Direct Access of Impostor Resource [irods-ceph-test-ires-radosResc] of Given Type [irados]]

Jun  1 08:29:04 pid:14302 NOTICE: dataCreate: l3Create of //home/rods/2Gfile_1 failed, status = -1818000
Jun  1 08:29:04 pid:14302 NOTICE: rsDataObjCreate: Internal error
Jun  1 08:29:04 pid:14302 NOTICE: readAndProcClientMsg: received disconnect msg from client
Jun  1 08:29:04 pid:14302 NOTICE: Agent exiting with status = 0

I found this irods-chat post

Both servers have this in their /etc/hosts;

172.27.85.133 irods-ceph-test
172.27.85.183 irods-ceph-test-ires

but those hosts are not present in DNS (this is a virtual environment - our openstack), so could this be a gethostbyname not checking /etc/hosts issue, or something else? I was looking into specifying the names in /etc/irods/hosts_config.json, but couldn't work out the format.

trel commented 6 years ago

Is this still a problem on master or 4-1-stable?

lyzenghq commented 6 years ago

I get the same error, and i build from master branch