#124: Test dev CRABClient using preprod REST instance and CMSSW_10_6_26 CMSSW release

cmsbuild commented 2 years ago

Tests started for following configuration:

Configuration:

CRABClient_version: dev
- REST_Instance: preprod
- CMSSW_release: CMSSW_10_6_26
- SCRAM_ARCH: slc7_amd64_gcc700

Tests started:

[x] Task_Submission_Status_Tracking: started
[x] Client_Validation: started
[x] Client_Configuration_Validation: not-requested

Started at: 2021-11-18 15:10:46 Link to the job

cmsbuild commented 2 years ago

Task submission for Task_Submission_Status_Tracking successfully ended.

211118_141402:cmsbot_crab_20211118_151359
211118_141406:cmsbot_crab_20211118_151402
211118_141409:cmsbot_crab_20211118_151406
211118_141413:cmsbot_crab_20211118_151410
211118_141417:cmsbot_crab_20211118_151414
211118_141423:cmsbot_crab_20211118_151417

Task submission for Client_Configuration_Validation successfully ended.

211118_141232:cmsbot_crab_transferOutputs
211118_141235:cmsbot_crab_transferLogs
211118_141238:cmsbot_crab_activity
211118_141241:cmsbot_crab_inputFiles
211118_141243:cmsbot_crab_disableAutomaticOutputCollection
211118_141246:cmsbot_crab_outputFiles
211118_141249:cmsbot_crab_allowUndistributedCMSSW
211118_141252:cmsbot_crab_maxMemoryMB
211118_141255:cmsbot_crab_maxJobRuntimeMin
211118_141258:cmsbot_crab_numCores
211118_141300:cmsbot_crab_scriptExe
211118_141303:cmsbot_crab_scriptArgs
211118_141306:cmsbot_crab_sendPythonFolder
211118_141311:cmsbot_crab_sendExternalFolder
211118_141314:cmsbot_crab_inputDBS
211118_141317:cmsbot_crab_useParent
211118_141320:cmsbot_crab_secondaryInputDataset
211118_141322:cmsbot_crab_lumiMaskFile
211118_141325:cmsbot_crab_lumiMaskUrl
211118_141329:cmsbot_crab_outLFNDirBase
211118_141333:cmsbot_crab_runRange
211118_141336:cmsbot_crab_ignoreLocality
211118_141338:cmsbot_crab_userInputFiles
211118_141341:cmsbot_crab_whitelist
211118_141344:cmsbot_crab_blacklist
211118_141347:cmsbot_crab_ignoreGlobalBlacklist
211118_141349:cmsbot_crab_voRole
211118_141352:cmsbot_crab_scheddName
211118_141355:cmsbot_crab_collector
211118_141358:cmsbot_crab_extraJDL

Task submission for Client_Validation_Suite successfully ended.

211118_141229:cmsbot_crab_20211118_151224

Finished at: 2021-11-18 15:14:24 Find submission log here

cmsbuild commented 2 years ago

Test: Client configuration validation Result: FULL-STATUS-UNKNOWN Finished at: 2021-11-18 15:39:52 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_ClientConfigurationValidation/71/console

RETRY TESTS:
transferLogs-check.sh 211118_141235:cmsbot_crab_transferLogs - 2
activity-check.sh 211118_141238:cmsbot_crab_activity - 2
useParent-check.sh 211118_141317:cmsbot_crab_useParent - 2
lumiMaskUrl-check.sh 211118_141325:cmsbot_crab_lumiMaskUrl - 2
runRange-check.sh 211118_141333:cmsbot_crab_runRange - 2
whitelist-check.sh 211118_141341:cmsbot_crab_whitelist - 2
ignoreGlobalBlacklist-check.sh 211118_141347:cmsbot_crab_ignoreGlobalBlacklist - 2
voRole-check.sh 211118_141349:cmsbot_crab_voRole - 2

SUCCESSFUL TESTS:
transferOutputs-check.sh 211118_141232:cmsbot_crab_transferOutputs - 0
inputFiles-check.sh 211118_141241:cmsbot_crab_inputFiles - 0
disableAutomaticOutputCollection-check.sh 211118_141243:cmsbot_crab_disableAutomaticOutputCollection - 0
outputFiles-check.sh 211118_141246:cmsbot_crab_outputFiles - 0
allowUndistributedCMSSW-check.sh 211118_141249:cmsbot_crab_allowUndistributedCMSSW - 0
maxMemoryMB-check.sh 211118_141252:cmsbot_crab_maxMemoryMB - 0
maxJobRuntimeMin-check.sh 211118_141255:cmsbot_crab_maxJobRuntimeMin - 0
numCores-check.sh 211118_141258:cmsbot_crab_numCores - 0
scriptExe-check.sh 211118_141300:cmsbot_crab_scriptExe - 0
scriptArgs-check.sh 211118_141303:cmsbot_crab_scriptArgs - 0
sendPythonFolder-check.sh 211118_141306:cmsbot_crab_sendPythonFolder - 0
sendExternalFolder-check.sh 211118_141311:cmsbot_crab_sendExternalFolder - 0
inputDBS-check.sh 211118_141314:cmsbot_crab_inputDBS - 0
secondaryInputDataset-check.sh 211118_141320:cmsbot_crab_secondaryInputDataset - 0
lumiMaskFile-check.sh 211118_141322:cmsbot_crab_lumiMaskFile - 0
outLFNDirBase-check.sh 211118_141329:cmsbot_crab_outLFNDirBase - 0
ignoreLocality-check.sh 211118_141336:cmsbot_crab_ignoreLocality - 0
userInputFiles-check.sh 211118_141338:cmsbot_crab_userInputFiles - 0
blacklist-check.sh 211118_141344:cmsbot_crab_blacklist - 0
scheddName-check.sh 211118_141352:cmsbot_crab_scheddName - 0
collector-check.sh 211118_141355:cmsbot_crab_collector - 0
extraJDL-check.sh 211118_141358:cmsbot_crab_extraJDL - 0

FAILED TESTS:
 none

cmsbuild commented 2 years ago

Test: Client validation Result: SUCCEED Finished at: 2021-11-18 15:39:22 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_ClientValidation/162/console All executed commands: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_ClientValidation/162//artifact/client-validation.log/*view*/ Message: All commands were executed successfully.

cmsbuild commented 2 years ago

Test: Client configuration validation Result: FULL-STATUS-UNKNOWN Finished at: 2021-11-18 16:05:20 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_ClientConfigurationValidation/74/console

RETRY TESTS:
lumiMaskUrl-check.sh 211118_141325:cmsbot_crab_lumiMaskUrl - 2

SUCCESSFUL TESTS:
transferOutputs-check.sh 211118_141232:cmsbot_crab_transferOutputs - 0
transferLogs-check.sh 211118_141235:cmsbot_crab_transferLogs - 0
activity-check.sh 211118_141238:cmsbot_crab_activity - 0
inputFiles-check.sh 211118_141241:cmsbot_crab_inputFiles - 0
disableAutomaticOutputCollection-check.sh 211118_141243:cmsbot_crab_disableAutomaticOutputCollection - 0
outputFiles-check.sh 211118_141246:cmsbot_crab_outputFiles - 0
allowUndistributedCMSSW-check.sh 211118_141249:cmsbot_crab_allowUndistributedCMSSW - 0
maxMemoryMB-check.sh 211118_141252:cmsbot_crab_maxMemoryMB - 0
maxJobRuntimeMin-check.sh 211118_141255:cmsbot_crab_maxJobRuntimeMin - 0
numCores-check.sh 211118_141258:cmsbot_crab_numCores - 0
scriptExe-check.sh 211118_141300:cmsbot_crab_scriptExe - 0
scriptArgs-check.sh 211118_141303:cmsbot_crab_scriptArgs - 0
sendPythonFolder-check.sh 211118_141306:cmsbot_crab_sendPythonFolder - 0
sendExternalFolder-check.sh 211118_141311:cmsbot_crab_sendExternalFolder - 0
inputDBS-check.sh 211118_141314:cmsbot_crab_inputDBS - 0
useParent-check.sh 211118_141317:cmsbot_crab_useParent - 0
secondaryInputDataset-check.sh 211118_141320:cmsbot_crab_secondaryInputDataset - 0
lumiMaskFile-check.sh 211118_141322:cmsbot_crab_lumiMaskFile - 0
outLFNDirBase-check.sh 211118_141329:cmsbot_crab_outLFNDirBase - 0
runRange-check.sh 211118_141333:cmsbot_crab_runRange - 0
ignoreLocality-check.sh 211118_141336:cmsbot_crab_ignoreLocality - 0
userInputFiles-check.sh 211118_141338:cmsbot_crab_userInputFiles - 0
whitelist-check.sh 211118_141341:cmsbot_crab_whitelist - 0
blacklist-check.sh 211118_141344:cmsbot_crab_blacklist - 0
ignoreGlobalBlacklist-check.sh 211118_141347:cmsbot_crab_ignoreGlobalBlacklist - 0
voRole-check.sh 211118_141349:cmsbot_crab_voRole - 0
scheddName-check.sh 211118_141352:cmsbot_crab_scheddName - 0
collector-check.sh 211118_141355:cmsbot_crab_collector - 0
extraJDL-check.sh 211118_141358:cmsbot_crab_extraJDL - 0

FAILED TESTS:
 none

cmsbuild commented 2 years ago

Test: Task Submission Status Tracking Result: FULL-STATUS-UNKNOWN Finished at: 2021-11-18 16:16:42 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_CheckTestResults/61/console Message: Status checking will be executed again because some jobs are still running

{'TN': '211118_141402:cmsbot_crab_20211118_151359', 'dbStatus': u'SUBMITTED', 'testResult': 'TestRunning', 'jobsPerStatus': {'finished': 962, 'transferring': 37, 'running': 1}, 'combinedStatus': 'SUBMITTED'}
{'TN': '211118_141406:cmsbot_crab_20211118_151402', 'dbStatus': u'SUBMITTED', 'testResult': 'TestRunning', 'jobsPerStatus': {'finished': 5, 'running': 1}, 'combinedStatus': 'SUBMITTED'}
{'TN': '211118_141409:cmsbot_crab_20211118_151406', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 1}, 'combinedStatus': 'COMPLETED'}
{'TN': '211118_141413:cmsbot_crab_20211118_151410', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 10}, 'combinedStatus': 'COMPLETED'}
{'TN': '211118_141417:cmsbot_crab_20211118_151414', 'dbStatus': u'SUBMITTED', 'testResult': 'TestRunning', 'jobsPerStatus': {'finished': 97, 'transferring': 3}, 'combinedStatus': 'SUBMITTED'}
{'TN': '211118_141423:cmsbot_crab_20211118_151417', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 10}, 'combinedStatus': 'COMPLETED'}

cmsbuild commented 2 years ago

Test: Client configuration validation Result: FULL-STATUS-UNKNOWN Finished at: 2021-11-18 16:30:13 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_ClientConfigurationValidation/76/console

RETRY TESTS:
lumiMaskUrl-check.sh 211118_141325:cmsbot_crab_lumiMaskUrl - 2

SUCCESSFUL TESTS:
transferOutputs-check.sh 211118_141232:cmsbot_crab_transferOutputs - 0
transferLogs-check.sh 211118_141235:cmsbot_crab_transferLogs - 0
activity-check.sh 211118_141238:cmsbot_crab_activity - 0
inputFiles-check.sh 211118_141241:cmsbot_crab_inputFiles - 0
disableAutomaticOutputCollection-check.sh 211118_141243:cmsbot_crab_disableAutomaticOutputCollection - 0
outputFiles-check.sh 211118_141246:cmsbot_crab_outputFiles - 0
allowUndistributedCMSSW-check.sh 211118_141249:cmsbot_crab_allowUndistributedCMSSW - 0
maxMemoryMB-check.sh 211118_141252:cmsbot_crab_maxMemoryMB - 0
maxJobRuntimeMin-check.sh 211118_141255:cmsbot_crab_maxJobRuntimeMin - 0
numCores-check.sh 211118_141258:cmsbot_crab_numCores - 0
scriptExe-check.sh 211118_141300:cmsbot_crab_scriptExe - 0
scriptArgs-check.sh 211118_141303:cmsbot_crab_scriptArgs - 0
sendPythonFolder-check.sh 211118_141306:cmsbot_crab_sendPythonFolder - 0
sendExternalFolder-check.sh 211118_141311:cmsbot_crab_sendExternalFolder - 0
inputDBS-check.sh 211118_141314:cmsbot_crab_inputDBS - 0
useParent-check.sh 211118_141317:cmsbot_crab_useParent - 0
secondaryInputDataset-check.sh 211118_141320:cmsbot_crab_secondaryInputDataset - 0
lumiMaskFile-check.sh 211118_141322:cmsbot_crab_lumiMaskFile - 0
outLFNDirBase-check.sh 211118_141329:cmsbot_crab_outLFNDirBase - 0
runRange-check.sh 211118_141333:cmsbot_crab_runRange - 0
ignoreLocality-check.sh 211118_141336:cmsbot_crab_ignoreLocality - 0
userInputFiles-check.sh 211118_141338:cmsbot_crab_userInputFiles - 0
whitelist-check.sh 211118_141341:cmsbot_crab_whitelist - 0
blacklist-check.sh 211118_141344:cmsbot_crab_blacklist - 0
ignoreGlobalBlacklist-check.sh 211118_141347:cmsbot_crab_ignoreGlobalBlacklist - 0
voRole-check.sh 211118_141349:cmsbot_crab_voRole - 0
scheddName-check.sh 211118_141352:cmsbot_crab_scheddName - 0
collector-check.sh 211118_141355:cmsbot_crab_collector - 0
extraJDL-check.sh 211118_141358:cmsbot_crab_extraJDL - 0

FAILED TESTS:
 none

cmsbuild commented 2 years ago

Test: Client configuration validation Result: SUCCEED Finished at: 2021-11-18 16:55:39 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_ClientConfigurationValidation/77/console

RETRY TESTS:
 none

SUCCESSFUL TESTS:
transferOutputs-check.sh 211118_141232:cmsbot_crab_transferOutputs - 0
transferLogs-check.sh 211118_141235:cmsbot_crab_transferLogs - 0
activity-check.sh 211118_141238:cmsbot_crab_activity - 0
inputFiles-check.sh 211118_141241:cmsbot_crab_inputFiles - 0
disableAutomaticOutputCollection-check.sh 211118_141243:cmsbot_crab_disableAutomaticOutputCollection - 0
outputFiles-check.sh 211118_141246:cmsbot_crab_outputFiles - 0
allowUndistributedCMSSW-check.sh 211118_141249:cmsbot_crab_allowUndistributedCMSSW - 0
maxMemoryMB-check.sh 211118_141252:cmsbot_crab_maxMemoryMB - 0
maxJobRuntimeMin-check.sh 211118_141255:cmsbot_crab_maxJobRuntimeMin - 0
numCores-check.sh 211118_141258:cmsbot_crab_numCores - 0
scriptExe-check.sh 211118_141300:cmsbot_crab_scriptExe - 0
scriptArgs-check.sh 211118_141303:cmsbot_crab_scriptArgs - 0
sendPythonFolder-check.sh 211118_141306:cmsbot_crab_sendPythonFolder - 0
sendExternalFolder-check.sh 211118_141311:cmsbot_crab_sendExternalFolder - 0
inputDBS-check.sh 211118_141314:cmsbot_crab_inputDBS - 0
useParent-check.sh 211118_141317:cmsbot_crab_useParent - 0
secondaryInputDataset-check.sh 211118_141320:cmsbot_crab_secondaryInputDataset - 0
lumiMaskFile-check.sh 211118_141322:cmsbot_crab_lumiMaskFile - 0
lumiMaskUrl-check.sh 211118_141325:cmsbot_crab_lumiMaskUrl - 0
outLFNDirBase-check.sh 211118_141329:cmsbot_crab_outLFNDirBase - 0
runRange-check.sh 211118_141333:cmsbot_crab_runRange - 0
ignoreLocality-check.sh 211118_141336:cmsbot_crab_ignoreLocality - 0
userInputFiles-check.sh 211118_141338:cmsbot_crab_userInputFiles - 0
whitelist-check.sh 211118_141341:cmsbot_crab_whitelist - 0
blacklist-check.sh 211118_141344:cmsbot_crab_blacklist - 0
ignoreGlobalBlacklist-check.sh 211118_141347:cmsbot_crab_ignoreGlobalBlacklist - 0
voRole-check.sh 211118_141349:cmsbot_crab_voRole - 0
scheddName-check.sh 211118_141352:cmsbot_crab_scheddName - 0
collector-check.sh 211118_141355:cmsbot_crab_collector - 0
extraJDL-check.sh 211118_141358:cmsbot_crab_extraJDL - 0

FAILED TESTS:
 none

cmsbuild commented 2 years ago

Test: Task Submission Status Tracking Result: FULL-STATUS-UNKNOWN Finished at: 2021-11-18 17:18:57 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/COPYCAT_CRABServer_CheckTestResults/64/console Message: Status checking will be executed again because some jobs are still running

{'TN': '211118_141402:cmsbot_crab_20211118_151359', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 1000}, 'combinedStatus': 'COMPLETED'}
{'TN': '211118_141406:cmsbot_crab_20211118_151402', 'dbStatus': u'SUBMITTED', 'testResult': 'TestRunning', 'jobsPerStatus': {'finished': 5, 'running': 1}, 'combinedStatus': 'SUBMITTED'}
{'TN': '211118_141409:cmsbot_crab_20211118_151406', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 1}, 'combinedStatus': 'COMPLETED'}
{'TN': '211118_141413:cmsbot_crab_20211118_151410', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 10}, 'combinedStatus': 'COMPLETED'}
{'TN': '211118_141417:cmsbot_crab_20211118_151414', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 100}, 'combinedStatus': 'COMPLETED'}
{'TN': '211118_141423:cmsbot_crab_20211118_151417', 'dbStatus': u'SUBMITTED', 'testResult': 'TestPassed', 'jobsPerStatus': {'finished': 10}, 'combinedStatus': 'COMPLETED'}

ddaina / variousStuff

#124: Test dev CRABClient using preprod REST instance and CMSSW_10_6_26 CMSSW release #68