dmwm / CRABServer

15 stars 38 forks source link

get-ouput fails with "Internal server error" when the stageout step has error #2895

Closed DMWMBot closed 12 years ago

DMWMBot commented 12 years ago

Client traceback:

{{{ bash-3.2$ crab -d output -t crab_20111124_192738 -r 1 Executing command: 'get-output' Contacting crabas.lnl.infn.it:8188 Retrieved client-server mapping Setting the destination directory to /afs/cern.ch/user/s/spiga/scratch0/CRAB3client/crab_20111124_192738/results Retrieving output for jobs 1 in task spiga_crab_20111124_192738_111124_192740 ERROR: Internal Server Error (500): 'Server Error' Command failed with URI: http://crabas.lnl.infn.it:8188/crabinterface/crab/data/spiga_crab_20111124_192738_111124_192740?jobRange=1 Input data: {} Request headers: {'Content-type': 'application/json', 'Accept': 'application/json', 'User-agent': 'CRABClient/v001'} }}}

Server traceback:

{{{ call to GET with args: ['data', 'spiga_crab_20111124_192738_111124_192740'] kwargs: {'jobRange': '1'} resulted in 'location'

                                          stack trace: Traceback (most recent call last):

File "/home/riahi/deploys/CRAB306/v01/sw/slc5_amd64_gcc461/cms/wmcore/0.8.17/lib/python2.6/site-packages/WMCore/WebTools/RESTApi.py", line 103, in _buildResponse args, kwargs) File "/home/riahi/deploys/CRAB306/v01/sw/slc5_amd64_gcc461/cms/wmcore/0.8.17/lib/python2.6/site-packages/WMCore/WebTools/RESTModel.py", line 117, in handler data = methodCall(_params, *_kwargs) File "/home/riahi/deploys/CRAB306/v01/sw/slc5_amd64_gcc461/cms/wmcore/0.8.17/lib/python2.6/site-packages/WMCore/WebTools/RESTModel.py", line 191, in wrapper return func(**input_data) File "/home/riahi/deploys/CRAB306/v01/sw.pre/slc5_amd64_gcc461/cms/crab-server3/3.0.6/lib/python2.6/site-packages/CRABServer/CRABInterface/CRABRESTModel.py", line 708, in getDataLocation result['data'].append({'request': singleWf, 'subOrder': wfCounter, 'output': self.extractLFNs(fwjrResults, jobRange, jobList)}) File "/home/riahi/deploys/CRAB306/v01/sw.pre/slc5_amd64_gcc461/cms/crab-server3/3.0.6/lib/python2.6/site-packages/CRABServer/CRABInterface/CRABRESTModel.py", line 807, in extractLFNs foundIt() File "/home/riahi/deploys/CRAB306/v01/sw.pre/slc5_amd64_gcc461/cms/crab-server3/3.0.6/lib/python2.6/site-packages/CRABServer/CRABInterface/CRABRESTModel.py", line 782, in foundIt msg = "Error converting lfn to pfn. LFN: %s, location: %s" % (f['value']['lfn'], f['value']['location']) KeyError: 'location' }}}

DMWMBot commented 12 years ago

mmascher: The problem is that the location key is missing in the fwjr. Opened #2896 for unit test implementation.

DMWMBot commented 12 years ago

mmascher: Please Review