dmwm / WMCore

Core workflow management components for CMS.
Apache License 2.0
46 stars 107 forks source link

WMComponent_t.PhEDExInjector_t.PhEDExInjectorPoller_t fails #2630

Closed PerilousApricot closed 12 years ago

PerilousApricot commented 13 years ago

Looks like we need some sort of authorization for this test, should it just be set as integration?

{{{

Traceback (most recent call last): File "/var/lib/jenkins/jobs/deploy-wmagent/workspace/install/sw/slc5_amd64_gcc461/external/python/2.6.4/lib/python2.6/unittest.py", line 279, in run testMethod() File "/var/lib/jenkins/jobs/WMCore-py2.6-mysql/workspace/test/python/WMComponent_t/PhEDExInjector_t/PhEDExInjectorPoller_t.py", line 236, in testPoller poller.algorithm(parameters = None) File "/var/lib/jenkins/jobs/WMCore-py2.6-mysql/workspace/install/lib/python2.6/site-packages/WMComponent/PhEDExInjector/PhEDExInjectorPoller.py", line 241, in algorithm self.injectFiles() File "/var/lib/jenkins/jobs/WMCore-py2.6-mysql/workspace/install/lib/python2.6/site-packages/WMComponent/PhEDExInjector/PhEDExInjectorPoller.py", line 152, in injectFiles injectRes = self.phedex.injectBlocks(location, xmlData, 0, 0) File "/var/lib/jenkins/jobs/WMCore-py2.6-mysql/workspace/install/lib/python2.6/site-packages/WMCore/Services/PhEDEx/PhEDEx.py", line 82, in injectBlocks return self._getResult(callname, args = args, verb="POST") File "/var/lib/jenkins/jobs/WMCore-py2.6-mysql/workspace/install/lib/python2.6/site-packages/WMCore/Services/PhEDEx/PhEDEx.py", line 51, in _getResult f = self.refreshCache(file, callname, args, verb = verb) File "/var/lib/jenkins/jobs/WMCore-py2.6-mysql/workspace/install/lib/python2.6/site-packages/WMCore/Services/Service.py", line 176, in refreshCache self.getData(cachefile, url, inputdata, {}, encoder, decoder, verb, contentType) File "/var/lib/jenkins/jobs/WMCore-py2.6-mysql/workspace/install/lib/python2.6/site-packages/WMCore/Services/Service.py", line 266, in getData raise he HTTPException: -------------------- >> begin captured logging << -------------------- root: DEBUG: Tables for WMComponent.DBS3Buffer created root: INFO: No certificate or key found, authentication may fail root: DEBUG: local variable 'cert' referenced before assignment PhEDEx: DEBUG: Service initialised ({'endpoint': 'https://cmsweb.cern.ch/phedex/datasvc/json/test/', 'maxcachereuse': 24.0, 'cachepath': '/tmp/tmpmwznFq/.wmcore_cache/.wmcore_cache_101/requests/cmsweb.cern.ch', 'inputdata': {}, 'timeout': 300, 'service_name': 'PhEDEx', 'requests': {'cacheduration': 0, 'host': 'https://cmsweb.cern.ch/phedex/datasvc/json/test/', 'accept_type': 'text/html', 'content_type': 'application/x-www-form-urlencoded', 'endpoint_components': ParseResult(scheme='https', netloc='cmsweb.cern.ch', path='/phedex/datasvc/json/test/', params='', query='', fragment=''), 'conn': <httplib2.Http object at 0x3d08890>, 'endpoint': 'https://cmsweb.cern.ch/phedex/datasvc/json/test/', 'cachepath': '/tmp/tmpmwznFq/.wmcore_cache/.wmcore_cache_101/requests/cmsweb.cern.ch', 'timeout': 300, 'req_cache_path': '/tmp/tmpmwznFq/.wmcore_cache/.wmcore_cache_101/requests/cmsweb.cern.ch/.cache', 'logger': <logging.Logger instance at 0x3b3af80>}, 'cacheduration': 0, 'method': None, 'logger': <logging.Logger instance at 0x3b3af80>}): host: cmsweb.cern.ch, basepath: https://cmsweb.cern.ch/phedex/datasvc/json/test/ (text/html) cache: /tmp/tmpmwznFq/.wmcore_cache/.wmcore_cache_101/requests/cmsweb.cern.ch (duration 0 hours, max reuse 24.0 hours) root: INFO: No certificate or key found, authentication may fail root: DEBUG: local variable 'cert' referenced before assignment PhEDEx: DEBUG: Service initialised ({'endpoint': 'https://cmsweb.cern.ch/phedex/datasvc/json/test/', 'maxcachereuse': 24.0, 'cachepath': '/tmp/tmpmwznFq/.wmcore_cache/.wmcore_cache_101/requests/cmsweb.cern.ch', 'inputdata': {}, 'timeout': 300, 'service_name': 'PhEDEx', 'requests': {'cacheduration': 0, 'host': 'https://cmsweb.cern.ch/phedex/datasvc/json/test/', 'accept_type': 'text/html', 'content_type': 'application/x-www-form-urlencoded', 'endpoint_components': ParseResult(scheme='https', netloc='cmsweb.cern.ch', path='/phedex/datasvc/json/test/', params='', query='', fragment=''), 'conn': <httplib2.Http object at 0x5e4b610>, 'endpoint': 'https://cmsweb.cern.ch/phedex/datasvc/json/test/', 'cachepath': '/tmp/tmpmwznFq/.wmcore_cache/.wmcore_cache_101/requests/cmsweb.cern.ch', 'timeout': 300, 'req_cache_path': '/tmp/tmpmwznFq/.wmcore_cache/.wmcore_cache_101/requests/cmsweb.cern.ch/.cache', 'logger': <logging.Logger instance at 0x3b3af80>}, 'cacheduration': 0, 'method': None, 'logger': <logging.Logger instance at 0x3b3af80>}): host: cmsweb.cern.ch, basepath: https://cmsweb.cern.ch/phedex/datasvc/json/test/ (text/html) cache: /tmp/tmpmwznFq/.wmcore_cache/.wmcore_cache_101/requests/cmsweb.cern.ch (duration 0 hours, max reuse 24.0 hours) root: DEBUG: Alerts messaging not enabled for 'PhEDExInjectorPoller' PhEDEx: DEBUG: /tmp/tmpmwznFq/.wmcore_cache/.wmcore_cache_101/requests/cmsweb.cern.ch/15744094587142094_POST_nodes expired, refreshing cache PhEDEx: DEBUG: getData: url: nodes data: {} root: INFO: Adding mapping osg-dcache.phys.utk.edu -> T3_US_UTENN root: INFO: Adding mapping storm-fe-cms.cr.cnaf.infn.it -> T1_IT_CNAF_Stage root: INFO: Adding mapping se.tier3.ucdavis.edu -> T3_US_UCD root: INFO: Adding mapping meson.fis.cinvestav.mx -> T3_MX_Cinvestav root: INFO: Adding mapping ndcms.crc.nd.edu -> T3_US_NotreDame root: INFO: Adding mapping srm-eoscms.cern.ch -> T2_CH_EOSTEST root: INFO: Adding mapping srm-cms-disk.gridpp.rl.ac.uk -> T1_UK_RAL_Disk root: INFO: Adding mapping srm01.ncg.ingrid.pt -> T2_PT_NCG_Lisbon root: INFO: Adding mapping docms12.cern.ch -> TX_CH_CERN_Rapolas root: INFO: Adding mapping se.saxon.hosted.ats.ucla.edu -> T3_US_UCLA root: INFO: Adding mapping gridsrm.ts.infn.it -> T3_IT_Trieste root: INFO: Adding mapping cmssw.princeton.edu -> T3_US_Princeton_ICSE root: INFO: Adding mapping grid002.fi.infn.it -> T3_IT_Firenze root: INFO: Adding mapping srm-test.pic.es -> T1_ES_PIC_Stage root: INFO: Adding mapping ccsrmt2.in2p3.fr -> T2_FR_CCIN2P3 root: INFO: Adding mapping ff-se.unl.edu -> T3_US_Omaha root: INFO: Adding mapping ccsrm.in2p3.fr -> T1_FR_CCIN2P3_Stage root: INFO: Adding mapping srm-cms.gridpp.rl.ac.uk -> T1_UK_RAL_Stage root: INFO: Adding mapping brux2.hep.brown.edu -> T3_US_Brown root: INFO: Adding mapping cms-se.hep.uprm.edu -> T3_US_PuertoRico root: INFO: Adding mapping sebo-t3-01.cr.cnaf.infn.it -> T3_IT_Bologna root: INFO: Adding mapping pcncp22.ncp.edu.pk -> T2_PK_NCP root: INFO: Adding mapping se.hep.fsu.edu -> T3_US_FSU root: INFO: Adding mapping srm2.grid.sinica.edu.tw -> T1_TW_ASGC_Stage root: INFO: Adding mapping hep.pha.jhu.edu -> T3_US_JHU root: INFO: Adding mapping cms-0.mps.ohio-state.edu -> T3_US_OSU root: INFO: Adding mapping dpm.cyf-kr.edu.pl -> T2_PL_Cracow root: INFO: Adding mapping osg-hep.phys.virginia.edu -> T3_US_UVA root: INFO: Adding mapping umiss005.hep.olemiss.edu -> T3_US_UMiss root: INFO: Adding mapping storm.mib.infn.it -> T3_IT_MIB root: INFO: Adding mapping glite-se.ceres.auckland.ac.nz -> T3_NZ_UOA root: INFO: Adding mapping mars.phys.ntu.edu.tw -> T3_TW_NTU_HEP root: INFO: Adding mapping se.grid.kiae.ru -> T2_RU_RRC_KI root: INFO: Adding mapping phedex.geol.uniovi.es -> T3_ES_Oviedo root: INFO: Adding mapping osgdcache01.cac.cornell.edu -> T3_US_Cornell root: INFO: Adding mapping None -> TX_Test_1 root: INFO: Adding mapping sigmorgh.hpcc.ttu.edu -> T3_US_TTU root: INFO: Adding mapping None -> TX_Wen_Buffer root: INFO: Adding mapping umiss001.hep.olemiss.edu -> T3_UMiss_Buffer root: INFO: Adding mapping cms-se0.kipt.kharkov.ua -> T2_UA_KIPT root: INFO: Adding mapping cmssrm-fzk.gridka.de -> T1_DE_KIT_Buffer root: INFO: Adding mapping uclasaxon.srm.edu -> T3_UCLASaxon_Buffer root: INFO: Adding mapping se1.accre.vanderbilt.edu -> T2_US_Vanderbilt root: INFO: Adding mapping grid02.phy.ncu.edu.tw -> T3_TW_NCU root: INFO: Adding mapping node12.datagrid.cea.fr -> T2_FR_GRIF_IRFU root: INFO: Adding mapping srm01.lip.pt -> T2_PT_LIP_Lisbon root: INFO: Adding mapping grid09.phy.pku.edu.cn -> T3_CN_PKU root: INFO: Adding mapping cmsdca2.fnal.gov -> T3_US_FNALLPC root: INFO: Adding mapping srm-cms.cern.ch -> T0_CH_CERN_Export root: INFO: Adding mapping srm-cms.cern.ch -> T0_CH_CERN_MSS root: INFO: Adding mapping srm2.grid.sinica.edu.tw -> T1_TW_ASGC_Buffer root: INFO: Adding mapping srm2.grid.sinica.edu.tw -> T1_TW_ASGC_MSS root: INFO: Adding mapping srm-cms.cern.ch -> T1_CH_CERN_Buffer root: INFO: Adding mapping srm-cms.cern.ch -> T1_CH_CERN_MSS root: INFO: Adding mapping storm-fe-cms.cr.cnaf.infn.it -> T1_IT_CNAF_Buffer root: INFO: Adding mapping storm-fe-cms.cr.cnaf.infn.it -> T1_IT_CNAF_MSS root: INFO: Adding mapping cmssrm.fnal.gov -> T1_US_FNAL_Buffer root: INFO: Adding mapping cmssrm.fnal.gov -> T1_US_FNAL_MSS root: INFO: Adding mapping ccsrm.in2p3.fr -> T1_FR_CCIN2P3_Buffer root: INFO: Adding mapping ccsrm.in2p3.fr -> T1_FR_CCIN2P3_MSS root: INFO: Adding mapping None -> T1_Import_A1 root: INFO: Adding mapping None -> T1_Import_A2 root: INFO: Adding mapping None -> T1_Import_A3 root: INFO: Adding mapping None -> T1_Import_A4 root: INFO: Adding mapping None -> T1_Import_A5 root: INFO: Adding mapping None -> T1_Import_A6 root: INFO: Adding mapping None -> T1_Import_A7 root: INFO: Adding mapping None -> T1_Import_B root: INFO: Adding mapping None -> T1_Import_C root: INFO: Adding mapping None -> T1_Import_D root: INFO: Adding mapping None -> T1_Import_E root: INFO: Adding mapping None -> T1_Import_F root: INFO: Adding mapping None -> T1_Import_G root: INFO: Adding mapping None -> T1_Import_H root: INFO: Adding mapping srm-test.pic.es -> T1_ES_PIC_Buffer root: INFO: Adding mapping srm-test.pic.es -> T1_ES_PIC_MSS root: INFO: Adding mapping srm-cms.gridpp.rl.ac.uk -> T1_UK_RAL_Buffer root: INFO: Adding mapping srm-cms.gridpp.rl.ac.uk -> T1_UK_RAL_MSS root: INFO: Adding mapping storm-se-01.ba.infn.it -> T2_IT_Bari root: INFO: Adding mapping srm.ihep.ac.cn -> T2_CN_Beijing root: INFO: Adding mapping maite.iihe.ac.be -> T2_BE_IIHE root: INFO: Adding mapping ingrid-se02.cism.ucl.ac.be -> T2_BE_UCL root: INFO: Adding mapping None -> T2_Bristol_Buffer root: INFO: Adding mapping grid143.kfki.hu -> T2_HU_Budapest root: INFO: Adding mapping storage01.lcg.cscs.ch -> T2_CH_CSCS root: INFO: Adding mapping cit-se.ultralight.org -> T2_US_Caltech root: INFO: Adding mapping dcache-se-cms.desy.de -> T2_DE_DESY root: INFO: Adding mapping None -> T3_GR_Demokritos root: INFO: Adding mapping ganymede.hep.kbfi.ee -> T2_EE_Estonia root: INFO: Adding mapping srm.ihepa.ufl.edu -> T2_US_Florida root: INFO: Adding mapping polgrid4.in2p3.fr -> T2_FR_GRIF_LLR root: INFO: Adding mapping se-dcache.hepgrid.uerj.br -> T2_BR_UERJ root: INFO: Adding mapping madhatter.csc.fi -> T2_FI_HIP root: INFO: Adding mapping se3.itep.ru -> T2_RU_ITEP root: INFO: Adding mapping lcgsedc01.jinr.ru -> T2_RU_JINR root: INFO: Adding mapping cluster142.knu.ac.kr -> T2_KR_KNU root: INFO: Adding mapping t2-srm-02.lnl.infn.it -> T2_IT_Legnaro root: INFO: Adding mapping dc2-grid-64.brunel.ac.uk -> T2_UK_London_Brunel root: INFO: Adding mapping gfe02.grid.hep.ph.ic.ac.uk -> T2_UK_London_IC root: INFO: Adding mapping se03.esc.qmul.ac.uk -> T3_UK_London_QMUL root: INFO: Adding mapping se2.ppgrid1.rhul.ac.uk -> T3_UK_London_RHUL root: INFO: Adding mapping se01.cmsaf.mit.edu -> T2_US_MIT root: INFO: Adding mapping srm.unl.edu -> T2_US_Nebraska root: INFO: Adding mapping cmsdcache.pi.infn.it -> T2_IT_Pisa root: INFO: Adding mapping srm-dcache.rcac.purdue.edu -> T2_US_Purdue root: INFO: Adding mapping grid-srm.physik.rwth-aachen.de -> T2_DE_RWTH root: INFO: Adding mapping cmsrm-se01.roma1.infn.it -> T2_IT_Rome root: INFO: Adding mapping grid128.sinp.msu.ru -> T2_RU_SINP root: INFO: Adding mapping osg-se.sprace.org.br -> T2_BR_SPRACE root: INFO: Adding mapping lcgse01.phy.bris.ac.uk -> T2_UK_SGrid_Bristol root: INFO: Adding mapping heplnx204.pp.rl.ac.uk -> T2_UK_SGrid_RALPP root: INFO: Adding mapping srm.ciemat.es -> T2_ES_CIEMAT root: INFO: Adding mapping f-dpm001.grid.sinica.edu.tw -> T2_TW_Taiwan root: INFO: Adding mapping bsrm-1.t2.ucsd.edu -> T2_US_UCSD root: INFO: Adding mapping hephyse.oeaw.ac.at -> T2_AT_Vienna root: INFO: Adding mapping se.polgrid.pl -> T2_PL_Warsaw root: INFO: Adding mapping cmssrm.hep.wisc.edu -> T2_US_Wisconsin root: INFO: Adding mapping None -> T3_US_Minnesota root: INFO: Adding mapping cmsse01.na.infn.it -> T3_IT_Napoli root: INFO: Adding mapping gridse3.pg.infn.it -> T3_IT_Perugia root: INFO: Adding mapping None -> T3_US_Princeton root: INFO: Adding mapping None -> T3_US_UIowa root: INFO: Adding mapping hepcms-0.umd.edu -> T3_US_UMD root: INFO: Adding mapping t2se01.physics.ox.ac.uk -> T3_UK_SGrid_Oxford root: INFO: Adding mapping osg-gate.rice.edu -> T3_US_Rice root: INFO: Adding mapping eymir.grid.metu.edu.tr -> T2_TR_METU root: INFO: Adding mapping lyogrid06.in2p3.fr -> T3_FR_IPNL root: INFO: Adding mapping storm.ifca.es -> T2_ES_IFCA root: INFO: Adding mapping dp0015.m45.ihep.su -> T2_RU_IHEP root: INFO: Adding mapping None -> TX_CH_LiangDongCERN root: INFO: Adding mapping kansas.none -> T3_US_Kansas root: INFO: Adding mapping se01.indiacms.res.in -> T2_IN_TIFR root: INFO: Adding mapping grid02.physics.uoi.gr -> T3_GR_Ioannina root: INFO: Adding mapping srm.glite.ecdf.ed.ac.uk -> T3_UK_ScotGrid_ECDF root: INFO: Adding mapping charm.ucr.edu -> T3_US_UCR root: INFO: Adding mapping None -> T3_UVA_Buffer root: INFO: Adding mapping cluster.pnpi.nw.ru -> T2_RU_PNPI root: INFO: Adding mapping ruhex-osgce.rutgers.edu -> T3_US_Rutgers root: INFO: Adding mapping moboro.uniandes.edu.co -> T3_CO_Uniandes root: INFO: Adding mapping caf.cern.ch -> T2_CH_CAF root: INFO: Adding mapping grse001.inr.troitsk.ru -> T2_RU_INR root: INFO: Adding mapping se01.marie.hellasgrid.gr -> T3_GR_IASA_HG root: INFO: Adding mapping gw-3.ccc.ucl.ac.uk -> T3_UK_London_UCL root: INFO: Adding mapping heposgse01.colorado.edu -> T3_US_Colorado root: INFO: Adding mapping sbgse1.in2p3.fr -> T2_FR_IPHC root: INFO: Adding mapping None -> TX_CH_NicoloCERN root: INFO: Adding mapping se02.marie.hellasgrid.gr -> T3_GR_IASA_GR root: INFO: Adding mapping t3se01.psi.ch -> T3_CH_PSI root: INFO: Adding mapping ekp-lcg-se.physik.uni-karlsruhe.de -> T3_DE_Karlsruhe root: INFO: Adding mapping None -> TX_Jose_Buffer root: INFO: Adding mapping svr018.gla.scotgrid.ac.uk -> T3_UK_ScotGrid_GLA root: INFO: Adding mapping uscms1-se.fltech-grid3.fit.edu -> T3_US_FIT root: INFO: Adding mapping cms-xen19.fnal.gov -> T3_US_FNALXEN root: INFO: Adding mapping cmssrm-fzk.gridka.de -> T1_DE_KIT_MSS root: INFO: Adding mapping hurr.tamu.edu -> T3_US_TAMU PhEDEx: DEBUG: /tmp/tmpmwznFq/.wmcore_cache/.wmcore_cache_101/requests/cmsweb.cern.ch/3714863155402033355_POST_inject expired, refreshing cache PhEDEx: DEBUG: getData: url: inject data: {'node': 'T1_CH_CERN_Buffer', 'strict': 0, 'data': '\n\t\n\t\t\n\t\t\t\n\t\t\t\t\n\t\t\t\t\n\t\t\t\t\n\t\t\t\n\t\t\n\t\t\n\t\t\t\n\t\t\t\t\n\t\t\t\t\n\t\t\t\n\t\t\n\t\n\n', 'verbose': 0} PhEDEx: WARNING: The cachefile /tmp/tmpmwznFq/.wmcore_cache/.wmcore_cache_101/requests/cmsweb.cern.ch/3714863155402033355_POST_inject does not exist and the service at inject is unavailable - it returned %s because %sThe cachefile /tmp/tmpmwznFq/.wmcore_cache/.wmcore_cache_101/requests/cmsweb.cern.ch/3714863155402033355_POST_inject does not exist and the service at inject is unavailable - it returned 401 because Authorization Required

}}}

sfoulkes commented 13 years ago

sfoulkes: Dave, review?

sfoulkes commented 13 years ago

sfoulkes: (In 12302f4f40b7a38d54c7da8ef0f1aad56f58bf6e) Mark the PhEDExInjector tests as integration. Fixes #2630.

From: Steve Foulkes sfoulkes@fnal.gov