#264: Test prod CRABClient using preprod REST instance and CMSSW_12_0_1 CMSSW release

cmsbuild commented 2 years ago

Tests started for following configuration:

Configuration:

CRABClient_version: prod
- REST_Instance: preprod
- CMSSW_release: CMSSW_12_0_1
- SCRAM_ARCH: slc7_amd64_gcc900

Tests started:

[x] Client_Validation
[x] Client_Configuration_Validation
[x] Task_Submission_Status_Tracking

Started at: 2022-06-16 15:50:37 Link to the job

cmsbuild commented 2 years ago

Task submission for Task_Submission_Status_Tracking successfully ended.

220616_135413:cmsbot_crab_20220616_155411
220616_135417:cmsbot_crab_20220616_155414
220616_135420:cmsbot_crab_20220616_155418
220616_135424:cmsbot_crab_20220616_155421
220616_135428:cmsbot_crab_20220616_155425
220616_135442:cmsbot_crab_20220616_155429

Task submission for Client_Configuration_Validation successfully ended.

220616_135221:cmsbot_crab_transferOutputs
220616_135224:cmsbot_crab_transferLogs
220616_135228:cmsbot_crab_activity
220616_135231:cmsbot_crab_inputFiles
220616_135235:cmsbot_crab_disableAutomaticOutputCollection
220616_135238:cmsbot_crab_outputFiles
220616_135242:cmsbot_crab_allowUndistributedCMSSW
220616_135245:cmsbot_crab_maxMemoryMB
220616_135248:cmsbot_crab_maxJobRuntimeMin
220616_135252:cmsbot_crab_numCores
220616_135255:cmsbot_crab_scriptExe
220616_135259:cmsbot_crab_scriptArgs
220616_135302:cmsbot_crab_sendPythonFolder
220616_135310:cmsbot_crab_sendExternalFolder
220616_135314:cmsbot_crab_inputDBS
220616_135317:cmsbot_crab_useParent
220616_135321:cmsbot_crab_secondaryInputDataset
220616_135324:cmsbot_crab_lumiMaskFile
220616_135327:cmsbot_crab_lumiMaskUrl
220616_135332:cmsbot_crab_outLFNDirBase
220616_135335:cmsbot_crab_runRange
220616_135338:cmsbot_crab_ignoreLocality
220616_135342:cmsbot_crab_userInputFiles
220616_135345:cmsbot_crab_whitelist
220616_135349:cmsbot_crab_blacklist
220616_135352:cmsbot_crab_ignoreGlobalBlacklist
220616_135355:cmsbot_crab_voRole
220616_135359:cmsbot_crab_voGroup
220616_135402:cmsbot_crab_scheddName
220616_135406:cmsbot_crab_collector
220616_135409:cmsbot_crab_extraJDL

Task submission for Client_Validation_Suite successfully ended.

220616_135217:cmsbot_crab_20220616_155212

Finished at: 2022-06-16 15:54:42 Find submission log here

cmsbuild commented 2 years ago

Test: Client validation Result: SUCCEEDED Finished at: 2022-06-16 16:18:21 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_ClientValidation/262/console All executed commands: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_ClientValidation/262//artifact/client-validation.log/*view*/ Message: All commands were executed successfully.

cmsbuild commented 2 years ago

Test: Client configuration validation Result: FULL-STATUS-UNKNOWN Attempt: 0 out of 4. Will run again. Finished at: 2022-06-16 16:23:00 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_ClientConfigurationValidation/381/console

RETRY TESTS:
activity-check.sh 220616_135228:cmsbot_crab_activity - 2
scriptArgs-check.sh 220616_135259:cmsbot_crab_scriptArgs - 2
secondaryInputDataset-check.sh 220616_135321:cmsbot_crab_secondaryInputDataset - 2
lumiMaskFile-check.sh 220616_135324:cmsbot_crab_lumiMaskFile - 2
lumiMaskUrl-check.sh 220616_135327:cmsbot_crab_lumiMaskUrl - 2
runRange-check.sh 220616_135335:cmsbot_crab_runRange - 2
whitelist-check.sh 220616_135345:cmsbot_crab_whitelist - 2

SUCCESSFUL TESTS:
transferOutputs-check.sh 220616_135221:cmsbot_crab_transferOutputs - 0
transferLogs-check.sh 220616_135224:cmsbot_crab_transferLogs - 0
inputFiles-check.sh 220616_135231:cmsbot_crab_inputFiles - 0
disableAutomaticOutputCollection-check.sh 220616_135235:cmsbot_crab_disableAutomaticOutputCollection - 0
outputFiles-check.sh 220616_135238:cmsbot_crab_outputFiles - 0
allowUndistributedCMSSW-check.sh 220616_135242:cmsbot_crab_allowUndistributedCMSSW - 0
maxMemoryMB-check.sh 220616_135245:cmsbot_crab_maxMemoryMB - 0
maxJobRuntimeMin-check.sh 220616_135248:cmsbot_crab_maxJobRuntimeMin - 0
numCores-check.sh 220616_135252:cmsbot_crab_numCores - 0
scriptExe-check.sh 220616_135255:cmsbot_crab_scriptExe - 0
sendPythonFolder-check.sh 220616_135302:cmsbot_crab_sendPythonFolder - 0
sendExternalFolder-check.sh 220616_135310:cmsbot_crab_sendExternalFolder - 0
inputDBS-check.sh 220616_135314:cmsbot_crab_inputDBS - 0
useParent-check.sh 220616_135317:cmsbot_crab_useParent - 0
outLFNDirBase-check.sh 220616_135332:cmsbot_crab_outLFNDirBase - 0
ignoreLocality-check.sh 220616_135338:cmsbot_crab_ignoreLocality - 0
userInputFiles-check.sh 220616_135342:cmsbot_crab_userInputFiles - 0
blacklist-check.sh 220616_135349:cmsbot_crab_blacklist - 0
ignoreGlobalBlacklist-check.sh 220616_135352:cmsbot_crab_ignoreGlobalBlacklist - 0
voRole-check.sh 220616_135355:cmsbot_crab_voRole - 0
voGroup-check.sh 220616_135359:cmsbot_crab_voGroup - 0
scheddName-check.sh 220616_135402:cmsbot_crab_scheddName - 0
collector-check.sh 220616_135406:cmsbot_crab_collector - 0
extraJDL-check.sh 220616_135409:cmsbot_crab_extraJDL - 0

FAILED TESTS:
 none

cmsbuild commented 2 years ago

Test: Client configuration validation Result: FULL-STATUS-UNKNOWN Attempt: 1 out of 4. Will run again. Finished at: 2022-06-16 16:49:36 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_ClientConfigurationValidation/382/console

RETRY TESTS:
secondaryInputDataset-check.sh 220616_135321:cmsbot_crab_secondaryInputDataset - 2

SUCCESSFUL TESTS:
transferOutputs-check.sh 220616_135221:cmsbot_crab_transferOutputs - 0
transferLogs-check.sh 220616_135224:cmsbot_crab_transferLogs - 0
activity-check.sh 220616_135228:cmsbot_crab_activity - 0
inputFiles-check.sh 220616_135231:cmsbot_crab_inputFiles - 0
disableAutomaticOutputCollection-check.sh 220616_135235:cmsbot_crab_disableAutomaticOutputCollection - 0
outputFiles-check.sh 220616_135238:cmsbot_crab_outputFiles - 0
allowUndistributedCMSSW-check.sh 220616_135242:cmsbot_crab_allowUndistributedCMSSW - 0
maxMemoryMB-check.sh 220616_135245:cmsbot_crab_maxMemoryMB - 0
maxJobRuntimeMin-check.sh 220616_135248:cmsbot_crab_maxJobRuntimeMin - 0
numCores-check.sh 220616_135252:cmsbot_crab_numCores - 0
scriptExe-check.sh 220616_135255:cmsbot_crab_scriptExe - 0
scriptArgs-check.sh 220616_135259:cmsbot_crab_scriptArgs - 0
sendPythonFolder-check.sh 220616_135302:cmsbot_crab_sendPythonFolder - 0
sendExternalFolder-check.sh 220616_135310:cmsbot_crab_sendExternalFolder - 0
inputDBS-check.sh 220616_135314:cmsbot_crab_inputDBS - 0
useParent-check.sh 220616_135317:cmsbot_crab_useParent - 0
lumiMaskFile-check.sh 220616_135324:cmsbot_crab_lumiMaskFile - 0
lumiMaskUrl-check.sh 220616_135327:cmsbot_crab_lumiMaskUrl - 0
outLFNDirBase-check.sh 220616_135332:cmsbot_crab_outLFNDirBase - 0
runRange-check.sh 220616_135335:cmsbot_crab_runRange - 0
ignoreLocality-check.sh 220616_135338:cmsbot_crab_ignoreLocality - 0
userInputFiles-check.sh 220616_135342:cmsbot_crab_userInputFiles - 0
whitelist-check.sh 220616_135345:cmsbot_crab_whitelist - 0
blacklist-check.sh 220616_135349:cmsbot_crab_blacklist - 0
ignoreGlobalBlacklist-check.sh 220616_135352:cmsbot_crab_ignoreGlobalBlacklist - 0
voRole-check.sh 220616_135355:cmsbot_crab_voRole - 0
voGroup-check.sh 220616_135359:cmsbot_crab_voGroup - 0
scheddName-check.sh 220616_135402:cmsbot_crab_scheddName - 0
collector-check.sh 220616_135406:cmsbot_crab_collector - 0
extraJDL-check.sh 220616_135409:cmsbot_crab_extraJDL - 0

FAILED TESTS:
 none

cmsbuild commented 2 years ago

Test: Task Submission Status Tracking Result: FULL-STATUS-UNKNOWN Attempt: 0 out of 4. Will run again. Finished at: 2022-06-16 16:57:17 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_CheckTestResults/246/console

{'TN': '220616_135413:cmsbot_crab_20220616_155411', 'dbStatus': u'SUBMITTED', 'testResult': 'TestRunning', 'jobsPerStatus': {'finished': 989, 'transferring': 11}, 'combinedStatus': 'SUBMITTED'}
{'TN': '220616_135417:cmsbot_crab_20220616_155414', 'dbStatus': u'SUBMITTED', 'testResult': 'TestRunning', 'jobsPerStatus': {'finished': 5, 'running': 1}, 'combinedStatus': 'SUBMITTED'}
{'TN': '220616_135420:cmsbot_crab_20220616_155418', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 1}, 'combinedStatus': 'COMPLETED'}
{'TN': '220616_135424:cmsbot_crab_20220616_155421', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 10}, 'combinedStatus': 'COMPLETED'}
{'TN': '220616_135428:cmsbot_crab_20220616_155425', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 100}, 'combinedStatus': 'COMPLETED'}
{'TN': '220616_135442:cmsbot_crab_20220616_155429', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 10}, 'combinedStatus': 'COMPLETED'}

cmsbuild commented 2 years ago

Test: Client configuration validation Result: SUCCEEDED Attempt: 2 out of 4. Test is done. Finished at: 2022-06-16 17:16:07 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_ClientConfigurationValidation/383/console

RETRY TESTS:
 none

SUCCESSFUL TESTS:
transferOutputs-check.sh 220616_135221:cmsbot_crab_transferOutputs - 0
transferLogs-check.sh 220616_135224:cmsbot_crab_transferLogs - 0
activity-check.sh 220616_135228:cmsbot_crab_activity - 0
inputFiles-check.sh 220616_135231:cmsbot_crab_inputFiles - 0
disableAutomaticOutputCollection-check.sh 220616_135235:cmsbot_crab_disableAutomaticOutputCollection - 0
outputFiles-check.sh 220616_135238:cmsbot_crab_outputFiles - 0
allowUndistributedCMSSW-check.sh 220616_135242:cmsbot_crab_allowUndistributedCMSSW - 0
maxMemoryMB-check.sh 220616_135245:cmsbot_crab_maxMemoryMB - 0
maxJobRuntimeMin-check.sh 220616_135248:cmsbot_crab_maxJobRuntimeMin - 0
numCores-check.sh 220616_135252:cmsbot_crab_numCores - 0
scriptExe-check.sh 220616_135255:cmsbot_crab_scriptExe - 0
scriptArgs-check.sh 220616_135259:cmsbot_crab_scriptArgs - 0
sendPythonFolder-check.sh 220616_135302:cmsbot_crab_sendPythonFolder - 0
sendExternalFolder-check.sh 220616_135310:cmsbot_crab_sendExternalFolder - 0
inputDBS-check.sh 220616_135314:cmsbot_crab_inputDBS - 0
useParent-check.sh 220616_135317:cmsbot_crab_useParent - 0
secondaryInputDataset-check.sh 220616_135321:cmsbot_crab_secondaryInputDataset - 0
lumiMaskFile-check.sh 220616_135324:cmsbot_crab_lumiMaskFile - 0
lumiMaskUrl-check.sh 220616_135327:cmsbot_crab_lumiMaskUrl - 0
outLFNDirBase-check.sh 220616_135332:cmsbot_crab_outLFNDirBase - 0
runRange-check.sh 220616_135335:cmsbot_crab_runRange - 0
ignoreLocality-check.sh 220616_135338:cmsbot_crab_ignoreLocality - 0
userInputFiles-check.sh 220616_135342:cmsbot_crab_userInputFiles - 0
whitelist-check.sh 220616_135345:cmsbot_crab_whitelist - 0
blacklist-check.sh 220616_135349:cmsbot_crab_blacklist - 0
ignoreGlobalBlacklist-check.sh 220616_135352:cmsbot_crab_ignoreGlobalBlacklist - 0
voRole-check.sh 220616_135355:cmsbot_crab_voRole - 0
voGroup-check.sh 220616_135359:cmsbot_crab_voGroup - 0
scheddName-check.sh 220616_135402:cmsbot_crab_scheddName - 0
collector-check.sh 220616_135406:cmsbot_crab_collector - 0
extraJDL-check.sh 220616_135409:cmsbot_crab_extraJDL - 0

FAILED TESTS:
 none

cmsbuild commented 2 years ago

Test: Task Submission Status Tracking Result: FULL-STATUS-UNKNOWN Attempt: 1 out of 4. Will run again. Finished at: 2022-06-16 17:59:45 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_CheckTestResults/247/console

{'TN': '220616_135413:cmsbot_crab_20220616_155411', 'dbStatus': u'SUBMITTED', 'testResult': 'TestRunning', 'jobsPerStatus': {'finished': 998, 'transferring': 2}, 'combinedStatus': 'SUBMITTED'}
{'TN': '220616_135417:cmsbot_crab_20220616_155414', 'dbStatus': u'SUBMITTED', 'testResult': 'TestRunning', 'jobsPerStatus': {'finished': 5, 'transferring': 1}, 'combinedStatus': 'SUBMITTED'}
{'TN': '220616_135420:cmsbot_crab_20220616_155418', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 1}, 'combinedStatus': 'COMPLETED'}
{'TN': '220616_135424:cmsbot_crab_20220616_155421', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 10}, 'combinedStatus': 'COMPLETED'}
{'TN': '220616_135428:cmsbot_crab_20220616_155425', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 100}, 'combinedStatus': 'COMPLETED'}
{'TN': '220616_135442:cmsbot_crab_20220616_155429', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 10}, 'combinedStatus': 'COMPLETED'}

cmsbuild commented 2 years ago

Test: Task Submission Status Tracking Result: FULL-STATUS-UNKNOWN Attempt: 2 out of 4. Will run again. Finished at: 2022-06-16 19:02:07 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_CheckTestResults/248/console

{'TN': '220616_135413:cmsbot_crab_20220616_155411', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 1000}, 'combinedStatus': 'COMPLETED'}
{'TN': '220616_135417:cmsbot_crab_20220616_155414', 'dbStatus': u'SUBMITTED', 'testResult': 'TestRunning', 'jobsPerStatus': {'finished': 5, 'transferring': 1}, 'combinedStatus': 'SUBMITTED'}
{'TN': '220616_135420:cmsbot_crab_20220616_155418', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 1}, 'combinedStatus': 'COMPLETED'}
{'TN': '220616_135424:cmsbot_crab_20220616_155421', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 10}, 'combinedStatus': 'COMPLETED'}
{'TN': '220616_135428:cmsbot_crab_20220616_155425', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 100}, 'combinedStatus': 'COMPLETED'}
{'TN': '220616_135442:cmsbot_crab_20220616_155429', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 10}, 'combinedStatus': 'COMPLETED'}

cmsbuild commented 2 years ago

Test: Task Submission Status Tracking Result: SUCCEEDED Attempt: 3 out of 4. Test is done. Finished at: 2022-06-16 20:05:14 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_CheckTestResults/249/console

{'TN': '220616_135413:cmsbot_crab_20220616_155411', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 1000}, 'combinedStatus': 'COMPLETED'}
{'TN': '220616_135417:cmsbot_crab_20220616_155414', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 6}, 'combinedStatus': 'COMPLETED'}
{'TN': '220616_135420:cmsbot_crab_20220616_155418', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 1}, 'combinedStatus': 'COMPLETED'}
{'TN': '220616_135424:cmsbot_crab_20220616_155421', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 10}, 'combinedStatus': 'COMPLETED'}
{'TN': '220616_135428:cmsbot_crab_20220616_155425', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 100}, 'combinedStatus': 'COMPLETED'}
{'TN': '220616_135442:cmsbot_crab_20220616_155429', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 10}, 'combinedStatus': 'COMPLETED'}

mapellidario / CRABServer

#264: Test prod CRABClient using preprod REST instance and CMSSW_12_0_1 CMSSW release #13