#143: Test prod CRABClient using preprod REST instance and CMSSW_12_0_1 CMSSW release

cmsbuild commented 2 years ago

Tests started for following configuration:

Configuration:

CRABClient_version: prod
- REST_Instance: preprod
- CMSSW_release: CMSSW_12_0_1
- SCRAM_ARCH: slc7_amd64_gcc900

Tests started:

[ ] Client_Validation
[ ] Client_Configuration_Validation
[ ] Task_Submission_Status_Tracking

Started at: 2021-12-19 18:53:26 Link to the job

cmsbuild commented 2 years ago

Task submission for Task_Submission_Status_Tracking successfully ended.

211219_175701:cmsbot_crab_20211219_185659
211219_175704:cmsbot_crab_20211219_185702
211219_175706:cmsbot_crab_20211219_185704
211219_175709:cmsbot_crab_20211219_185707
211219_175712:cmsbot_crab_20211219_185710
211219_175729:cmsbot_crab_20211219_185713

Task submission for Client_Configuration_Validation successfully ended.

211219_175512:cmsbot_crab_transferOutputs
211219_175515:cmsbot_crab_transferLogs
211219_175518:cmsbot_crab_activity
211219_175521:cmsbot_crab_inputFiles
211219_175524:cmsbot_crab_disableAutomaticOutputCollection
211219_175526:cmsbot_crab_outputFiles
211219_175529:cmsbot_crab_allowUndistributedCMSSW
211219_175532:cmsbot_crab_maxMemoryMB
211219_175535:cmsbot_crab_maxJobRuntimeMin
211219_175538:cmsbot_crab_numCores
211219_175541:cmsbot_crab_scriptExe
211219_175543:cmsbot_crab_scriptArgs
211219_175546:cmsbot_crab_sendPythonFolder
211219_175549:cmsbot_crab_sendExternalFolder
211219_175551:cmsbot_crab_inputDBS
211219_175554:cmsbot_crab_useParent
211219_175557:cmsbot_crab_secondaryInputDataset
211219_175600:cmsbot_crab_lumiMaskFile
211219_175603:cmsbot_crab_lumiMaskUrl
211219_175633:cmsbot_crab_outLFNDirBase
211219_175636:cmsbot_crab_runRange
211219_175638:cmsbot_crab_ignoreLocality
211219_175641:cmsbot_crab_userInputFiles
211219_175644:cmsbot_crab_whitelist
211219_175647:cmsbot_crab_blacklist
211219_175650:cmsbot_crab_ignoreGlobalBlacklist
211219_175652:cmsbot_crab_scheddName
211219_175655:cmsbot_crab_collector
211219_175658:cmsbot_crab_extraJDL

Task submission for Client_Validation_Suite successfully ended.

211219_175509:cmsbot_crab_20211219_185503

Finished at: 2021-12-19 18:57:29 Find submission log here

cmsbuild commented 2 years ago

Test: Client validation Result: SUCCEEDED Finished at: 2021-12-19 19:20:49 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_ClientValidation/173/console All executed commands: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_ClientValidation/173//artifact/client-validation.log/*view*/ Message: All commands were executed successfully.

cmsbuild commented 2 years ago

Test: Client configuration validation Result: FULL-STATUS-UNKNOWN Attempt: 0 out of 4. Will run again. Finished at: 2021-12-19 19:22:48 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_ClientConfigurationValidation/100/console

RETRY TESTS:
outputFiles-check.sh 211219_175526:cmsbot_crab_outputFiles - 2
scriptExe-check.sh 211219_175541:cmsbot_crab_scriptExe - 2
scriptArgs-check.sh 211219_175543:cmsbot_crab_scriptArgs - 2
useParent-check.sh 211219_175554:cmsbot_crab_useParent - 2
lumiMaskUrl-check.sh 211219_175603:cmsbot_crab_lumiMaskUrl - 2
runRange-check.sh 211219_175636:cmsbot_crab_runRange - 2
whitelist-check.sh 211219_175644:cmsbot_crab_whitelist - 2
ignoreGlobalBlacklist-check.sh 211219_175650:cmsbot_crab_ignoreGlobalBlacklist - 2

SUCCESSFUL TESTS:
transferOutputs-check.sh 211219_175512:cmsbot_crab_transferOutputs - 0
transferLogs-check.sh 211219_175515:cmsbot_crab_transferLogs - 0
activity-check.sh 211219_175518:cmsbot_crab_activity - 0
inputFiles-check.sh 211219_175521:cmsbot_crab_inputFiles - 0
disableAutomaticOutputCollection-check.sh 211219_175524:cmsbot_crab_disableAutomaticOutputCollection - 0
allowUndistributedCMSSW-check.sh 211219_175529:cmsbot_crab_allowUndistributedCMSSW - 0
maxMemoryMB-check.sh 211219_175532:cmsbot_crab_maxMemoryMB - 0
maxJobRuntimeMin-check.sh 211219_175535:cmsbot_crab_maxJobRuntimeMin - 0
numCores-check.sh 211219_175538:cmsbot_crab_numCores - 0
sendPythonFolder-check.sh 211219_175546:cmsbot_crab_sendPythonFolder - 0
sendExternalFolder-check.sh 211219_175549:cmsbot_crab_sendExternalFolder - 0
inputDBS-check.sh 211219_175551:cmsbot_crab_inputDBS - 0
secondaryInputDataset-check.sh 211219_175557:cmsbot_crab_secondaryInputDataset - 0
lumiMaskFile-check.sh 211219_175600:cmsbot_crab_lumiMaskFile - 0
ignoreLocality-check.sh 211219_175638:cmsbot_crab_ignoreLocality - 0
userInputFiles-check.sh 211219_175641:cmsbot_crab_userInputFiles - 0
blacklist-check.sh 211219_175647:cmsbot_crab_blacklist - 0
scheddName-check.sh 211219_175652:cmsbot_crab_scheddName - 0
extraJDL-check.sh 211219_175658:cmsbot_crab_extraJDL - 0

FAILED TESTS:
outLFNDirBase-check.sh 211219_175633:cmsbot_crab_outLFNDirBase - 1
collector-check.sh 211219_175655:cmsbot_crab_collector - 1

cmsbuild commented 2 years ago

Test: Client configuration validation Result: FULL-STATUS-UNKNOWN Attempt: 1 out of 4. Will run again. Finished at: 2021-12-19 19:47:59 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_ClientConfigurationValidation/101/console

RETRY TESTS:
scriptExe-check.sh 211219_175541:cmsbot_crab_scriptExe - 2
useParent-check.sh 211219_175554:cmsbot_crab_useParent - 2
ignoreGlobalBlacklist-check.sh 211219_175650:cmsbot_crab_ignoreGlobalBlacklist - 2

SUCCESSFUL TESTS:
transferOutputs-check.sh 211219_175512:cmsbot_crab_transferOutputs - 0
transferLogs-check.sh 211219_175515:cmsbot_crab_transferLogs - 0
activity-check.sh 211219_175518:cmsbot_crab_activity - 0
inputFiles-check.sh 211219_175521:cmsbot_crab_inputFiles - 0
disableAutomaticOutputCollection-check.sh 211219_175524:cmsbot_crab_disableAutomaticOutputCollection - 0
outputFiles-check.sh 211219_175526:cmsbot_crab_outputFiles - 0
allowUndistributedCMSSW-check.sh 211219_175529:cmsbot_crab_allowUndistributedCMSSW - 0
maxMemoryMB-check.sh 211219_175532:cmsbot_crab_maxMemoryMB - 0
maxJobRuntimeMin-check.sh 211219_175535:cmsbot_crab_maxJobRuntimeMin - 0
numCores-check.sh 211219_175538:cmsbot_crab_numCores - 0
scriptArgs-check.sh 211219_175543:cmsbot_crab_scriptArgs - 0
sendPythonFolder-check.sh 211219_175546:cmsbot_crab_sendPythonFolder - 0
sendExternalFolder-check.sh 211219_175549:cmsbot_crab_sendExternalFolder - 0
inputDBS-check.sh 211219_175551:cmsbot_crab_inputDBS - 0
secondaryInputDataset-check.sh 211219_175557:cmsbot_crab_secondaryInputDataset - 0
lumiMaskFile-check.sh 211219_175600:cmsbot_crab_lumiMaskFile - 0
lumiMaskUrl-check.sh 211219_175603:cmsbot_crab_lumiMaskUrl - 0
runRange-check.sh 211219_175636:cmsbot_crab_runRange - 0
ignoreLocality-check.sh 211219_175638:cmsbot_crab_ignoreLocality - 0
userInputFiles-check.sh 211219_175641:cmsbot_crab_userInputFiles - 0
whitelist-check.sh 211219_175644:cmsbot_crab_whitelist - 0
blacklist-check.sh 211219_175647:cmsbot_crab_blacklist - 0
scheddName-check.sh 211219_175652:cmsbot_crab_scheddName - 0
extraJDL-check.sh 211219_175658:cmsbot_crab_extraJDL - 0

FAILED TESTS:
outLFNDirBase-check.sh 211219_175633:cmsbot_crab_outLFNDirBase - 1
collector-check.sh 211219_175655:cmsbot_crab_collector - 1

cmsbuild commented 2 years ago

Test: Client configuration validation Result: FULL-STATUS-UNKNOWN Attempt: 2 out of 4. Will run again. Finished at: 2021-12-19 20:13:01 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_ClientConfigurationValidation/102/console

RETRY TESTS:
scriptExe-check.sh 211219_175541:cmsbot_crab_scriptExe - 2
useParent-check.sh 211219_175554:cmsbot_crab_useParent - 2
ignoreGlobalBlacklist-check.sh 211219_175650:cmsbot_crab_ignoreGlobalBlacklist - 2

SUCCESSFUL TESTS:
transferOutputs-check.sh 211219_175512:cmsbot_crab_transferOutputs - 0
transferLogs-check.sh 211219_175515:cmsbot_crab_transferLogs - 0
activity-check.sh 211219_175518:cmsbot_crab_activity - 0
inputFiles-check.sh 211219_175521:cmsbot_crab_inputFiles - 0
disableAutomaticOutputCollection-check.sh 211219_175524:cmsbot_crab_disableAutomaticOutputCollection - 0
outputFiles-check.sh 211219_175526:cmsbot_crab_outputFiles - 0
allowUndistributedCMSSW-check.sh 211219_175529:cmsbot_crab_allowUndistributedCMSSW - 0
maxMemoryMB-check.sh 211219_175532:cmsbot_crab_maxMemoryMB - 0
maxJobRuntimeMin-check.sh 211219_175535:cmsbot_crab_maxJobRuntimeMin - 0
numCores-check.sh 211219_175538:cmsbot_crab_numCores - 0
scriptArgs-check.sh 211219_175543:cmsbot_crab_scriptArgs - 0
sendPythonFolder-check.sh 211219_175546:cmsbot_crab_sendPythonFolder - 0
sendExternalFolder-check.sh 211219_175549:cmsbot_crab_sendExternalFolder - 0
inputDBS-check.sh 211219_175551:cmsbot_crab_inputDBS - 0
secondaryInputDataset-check.sh 211219_175557:cmsbot_crab_secondaryInputDataset - 0
lumiMaskFile-check.sh 211219_175600:cmsbot_crab_lumiMaskFile - 0
lumiMaskUrl-check.sh 211219_175603:cmsbot_crab_lumiMaskUrl - 0
runRange-check.sh 211219_175636:cmsbot_crab_runRange - 0
ignoreLocality-check.sh 211219_175638:cmsbot_crab_ignoreLocality - 0
userInputFiles-check.sh 211219_175641:cmsbot_crab_userInputFiles - 0
whitelist-check.sh 211219_175644:cmsbot_crab_whitelist - 0
blacklist-check.sh 211219_175647:cmsbot_crab_blacklist - 0
scheddName-check.sh 211219_175652:cmsbot_crab_scheddName - 0
extraJDL-check.sh 211219_175658:cmsbot_crab_extraJDL - 0

FAILED TESTS:
outLFNDirBase-check.sh 211219_175633:cmsbot_crab_outLFNDirBase - 1
collector-check.sh 211219_175655:cmsbot_crab_collector - 1

cmsbuild commented 2 years ago

Test: Client configuration validation Result: FULL-STATUS-UNKNOWN Attempt: 3 out of 4. Will run again. Finished at: 2021-12-19 20:38:01 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_ClientConfigurationValidation/103/console

RETRY TESTS:
scriptExe-check.sh 211219_175541:cmsbot_crab_scriptExe - 2
useParent-check.sh 211219_175554:cmsbot_crab_useParent - 2
ignoreGlobalBlacklist-check.sh 211219_175650:cmsbot_crab_ignoreGlobalBlacklist - 2

SUCCESSFUL TESTS:
transferOutputs-check.sh 211219_175512:cmsbot_crab_transferOutputs - 0
transferLogs-check.sh 211219_175515:cmsbot_crab_transferLogs - 0
activity-check.sh 211219_175518:cmsbot_crab_activity - 0
inputFiles-check.sh 211219_175521:cmsbot_crab_inputFiles - 0
disableAutomaticOutputCollection-check.sh 211219_175524:cmsbot_crab_disableAutomaticOutputCollection - 0
outputFiles-check.sh 211219_175526:cmsbot_crab_outputFiles - 0
allowUndistributedCMSSW-check.sh 211219_175529:cmsbot_crab_allowUndistributedCMSSW - 0
maxMemoryMB-check.sh 211219_175532:cmsbot_crab_maxMemoryMB - 0
maxJobRuntimeMin-check.sh 211219_175535:cmsbot_crab_maxJobRuntimeMin - 0
numCores-check.sh 211219_175538:cmsbot_crab_numCores - 0
scriptArgs-check.sh 211219_175543:cmsbot_crab_scriptArgs - 0
sendPythonFolder-check.sh 211219_175546:cmsbot_crab_sendPythonFolder - 0
sendExternalFolder-check.sh 211219_175549:cmsbot_crab_sendExternalFolder - 0
inputDBS-check.sh 211219_175551:cmsbot_crab_inputDBS - 0
secondaryInputDataset-check.sh 211219_175557:cmsbot_crab_secondaryInputDataset - 0
lumiMaskFile-check.sh 211219_175600:cmsbot_crab_lumiMaskFile - 0
lumiMaskUrl-check.sh 211219_175603:cmsbot_crab_lumiMaskUrl - 0
runRange-check.sh 211219_175636:cmsbot_crab_runRange - 0
ignoreLocality-check.sh 211219_175638:cmsbot_crab_ignoreLocality - 0
userInputFiles-check.sh 211219_175641:cmsbot_crab_userInputFiles - 0
whitelist-check.sh 211219_175644:cmsbot_crab_whitelist - 0
blacklist-check.sh 211219_175647:cmsbot_crab_blacklist - 0
scheddName-check.sh 211219_175652:cmsbot_crab_scheddName - 0
extraJDL-check.sh 211219_175658:cmsbot_crab_extraJDL - 0

FAILED TESTS:
outLFNDirBase-check.sh 211219_175633:cmsbot_crab_outLFNDirBase - 1
collector-check.sh 211219_175655:cmsbot_crab_collector - 1

cmsbuild commented 2 years ago

Test: Client configuration validation Result: FAILED Attempt: 4 out of 4. Test failed. Investigate manually Finished at: 2021-12-19 21:03:10 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_ClientConfigurationValidation/104/console

RETRY TESTS:
 none

SUCCESSFUL TESTS:
transferOutputs-check.sh 211219_175512:cmsbot_crab_transferOutputs - 0
transferLogs-check.sh 211219_175515:cmsbot_crab_transferLogs - 0
activity-check.sh 211219_175518:cmsbot_crab_activity - 0
inputFiles-check.sh 211219_175521:cmsbot_crab_inputFiles - 0
disableAutomaticOutputCollection-check.sh 211219_175524:cmsbot_crab_disableAutomaticOutputCollection - 0
outputFiles-check.sh 211219_175526:cmsbot_crab_outputFiles - 0
allowUndistributedCMSSW-check.sh 211219_175529:cmsbot_crab_allowUndistributedCMSSW - 0
maxMemoryMB-check.sh 211219_175532:cmsbot_crab_maxMemoryMB - 0
maxJobRuntimeMin-check.sh 211219_175535:cmsbot_crab_maxJobRuntimeMin - 0
numCores-check.sh 211219_175538:cmsbot_crab_numCores - 0
scriptArgs-check.sh 211219_175543:cmsbot_crab_scriptArgs - 0
sendPythonFolder-check.sh 211219_175546:cmsbot_crab_sendPythonFolder - 0
sendExternalFolder-check.sh 211219_175549:cmsbot_crab_sendExternalFolder - 0
inputDBS-check.sh 211219_175551:cmsbot_crab_inputDBS - 0
secondaryInputDataset-check.sh 211219_175557:cmsbot_crab_secondaryInputDataset - 0
lumiMaskFile-check.sh 211219_175600:cmsbot_crab_lumiMaskFile - 0
lumiMaskUrl-check.sh 211219_175603:cmsbot_crab_lumiMaskUrl - 0
runRange-check.sh 211219_175636:cmsbot_crab_runRange - 0
ignoreLocality-check.sh 211219_175638:cmsbot_crab_ignoreLocality - 0
userInputFiles-check.sh 211219_175641:cmsbot_crab_userInputFiles - 0
whitelist-check.sh 211219_175644:cmsbot_crab_whitelist - 0
blacklist-check.sh 211219_175647:cmsbot_crab_blacklist - 0
scheddName-check.sh 211219_175652:cmsbot_crab_scheddName - 0
extraJDL-check.sh 211219_175658:cmsbot_crab_extraJDL - 0

FAILED TESTS:
scriptExe-check.sh 211219_175541:cmsbot_crab_scriptExe - 1
useParent-check.sh 211219_175554:cmsbot_crab_useParent - 1
outLFNDirBase-check.sh 211219_175633:cmsbot_crab_outLFNDirBase - 1
ignoreGlobalBlacklist-check.sh 211219_175650:cmsbot_crab_ignoreGlobalBlacklist - 1
collector-check.sh 211219_175655:cmsbot_crab_collector - 1

ddaina / variousStuff

#143: Test prod CRABClient using preprod REST instance and CMSSW_12_0_1 CMSSW release #98