search

DIRACGrid / DIRAC

DIRAC Grid
http://diracgrid.org
GNU General Public License v3.0
112 stars 174 forks source link

[v6r13] XRootStorageElement not working , TestXRoot not Working #2495

Closed andresailer closed 8 years ago

andresailer commented 9 years ago 
dirac-dms-add-file /ilc/user/s/sailer/testEOS.txt  thisFileContainsAlie CERN-EOS-TEST -ddd
[...]
2015-07-10 15:22:49 UTC dirac-dms-add-file/XROOTStorage[GBTo]  DEBUG: XROOTStorage.__putSingleFile: trying to upload thisFileContainsAlie to root://eospublic.cern.ch/eos/clicdp/gridtest/ilc/user/s/sailer/testEOS.txt 
2015-07-10 15:22:49 UTC dirac-dms-add-file/XROOTStorage[GBTo]  DEBUG: XROOTStorage.__singleExists: Determining whether root://eospublic.cern.ch/eos/clicdp/gridtest/ilc/user/s/sailer/testEOS.txt exists. 
2015-07-10 15:22:49 UTC dirac-dms-add-file/XROOTStorage[GBTo]  DEBUG: XROOTStorage.__singleExists: Path does not exists root://eospublic.cern.ch/eos/clicdp/gridtest/ilc/user/s/sailer/testEOS.txt
2015-07-10 15:22:49 UTC dirac-dms-add-file/XROOTStorage[GBTo]  ERROR: XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Opening relative path 'eos/clicdp/gridtest/ilc/user/s/sailer/testEOS.txt?oss.asize=15' is disallowed.
2015-07-10 15:22:49 UTC dirac-dms-add-file/XROOTStorage[GBTo]  ERROR:  3010
2015-07-10 15:22:49 UTC dirac-dms-add-file/XROOTStorage[GBTo]  DEBUG: XROOTStorage.__singleExists: Determining whether root://eospublic.cern.ch/eos/clicdp/gridtest/ilc/user/s/sailer/testEOS.txt exists. 
2015-07-10 15:22:49 UTC dirac-dms-add-file/XROOTStorage[GBTo]  DEBUG: XROOTStorage.__singleExists: Path does not exists root://eospublic.cern.ch/eos/clicdp/gridtest/ilc/user/s/sailer/testEOS.txt

BTW: None of the tests in TestXROOTStorage.py work any longer either

chaen commented 9 years ago

Hi,

this code was working at some point. What version do you use ? In any case, we never had this code run in production unfortunately (library distribution problem, lack of time, etc). But anyway we plan to get ride of this one as soon as the gfal2 plugins will be certified in v6r13 (August). In case you need it in v6r12, I'm afraid you will have to debug it yourself (here a slash is missing between the host name and the beginning of the path)

andresailer commented 9 years ago

It is working in v6r12, it is broken in v6r13.

chaen commented 9 years ago

Then this are the changes that we did when reshuffling the DMS, and mainly refactoring the calls to the StorageBase class. @atsareg did that, I don't know whether he ran the unit tests

andresailer commented 9 years ago

Ok. I see there are already GFAL2_ Storage Modules in Dirac. I guess those are not expected to work at the moment?

chaen commented 9 years ago

you're welcome to give them a try. We will certify it during august

andresailer commented 9 years ago

So they are supposed to work? With which lcg bundles or client externals?

chaen commented 9 years ago

@fibbo to comment on that. As for which version of the lcg bundles, I don't know when @closier included that, but 2015-06-26 for sure contains the necessary bits

andresailer commented 9 years ago

Ok, after installing with 2015-06-26 and dirac v6r13 and doing this:

sudo yum install davix-libs-0.4.1-3.el6.x86_64
export GFAL_PLUGIN_DIR=${DIRAC}/Linux_x86_64_glibc-2.12/lib/gfal2-plugins
export GFAL_CONFIG_DIR=${DIRAC}/Linux_x86_64_glibc-2.12/etc/gfal2.d

It actually worked with this

dirac-dms-add-file /ilc/user/s/sailer/testEOS6.stdhep ${PWD}/test20.stdhep CERN-EOS-TEST

Note, it needs full path of the local file. CERN-EOS-TEST is a GFAL2_XROOT SE

chaen commented 9 years ago

Very good news, thanks for the feedback ! Did you try also with ./test20.stdhep ?

@fibbo , can you fix this please ?

andresailer commented 9 years ago

Doesn't work either

dirac-dms-add-file /ilc/user/s/sailer/testEOS3.stdhep ./test20.stdhep CERN-EOS-TEST -o/DIRAC/Setup=ILC-Development -ddd
[...]
2015-07-13 12:10:27 UTC dirac-dms-add-file/DataManager[PbxK]  DEBUG: putAndRegister: Failed to put file to Storage Element. ./test20.stdhep: GFAL2_StorageBase.__putSingleFile: Failed to copy file ./test20.stdhep to destination url root://eospublic.cern.ch/eos/clicdp/gridtest/ilc/user/s/sailer/testEOS3.stdhep: [2] [gfalt_copy_file][perform_copy][perform_local_copy] Could not open source: [streamed_copy][gfal_plugin_openG][gfal_plugin_file_open] errno reported by local system call No such file or directory
fibbo commented 9 years ago

I'm on it!

andresailer commented 9 years ago

Is there any news on the gfal2 validation? I also had posted something in the forum https://groups.google.com/forum/?hl=en#!topic/diracgrid-forum/pMkjG1PLrLg Are these libraries going to be included in the new lcgbundles, and what about the environment variables? Thanks

chaen commented 9 years ago

currently being certified. No way to get a proper deployment yet (to answer your forum question). 2.9.1 is distributed on AFS, but segfault for the SRM plugin. Fighting for it. I let you know once we get to something Cheers

andresailer commented 9 years ago

Ok, thanks for the update.

andresailer commented 8 years ago

Any news on this for GFAL2?

chaen commented 8 years ago

Seems like Joel got it to work, but not with the python shipped by the externals I believe. Maybe @closier can give more details

chaen commented 8 years ago

XRootStorage works again, so this ticket can be closed. The last tests were okay for GFAL2, still needs certification....