#773: Test prod CRABClient using preprod REST instance and CMSSW_13_0_2 CMSSW release

cmsdmwmbot commented 1 month ago

Tests started for following configuration:

Configuration:

CRABClient_version: prod
- REST_Instance: preprod
- CMSSW_release: CMSSW_13_0_2
- SCRAM_ARCH: el8_amd64_gcc11

Tests started:

[x] Task_Submission_Status_Tracking

Started at: 2024-05-10 11:57:37 Link to the job

cmsdmwmbot commented 1 month ago

Task submission for Task_Submission_Status_Tracking successfully ended.

240510_095800:cmsbot_crab_20240510_115758
240510_095803:cmsbot_crab_20240510_115802
240510_095805:cmsbot_crab_20240510_115805
240510_095807:cmsbot_crab_20240510_115807
240510_095810:cmsbot_crab_20240510_115809
240510_095813:cmsbot_crab_20240510_115811
240510_095816:cmsbot_crab_rucio_transfers_20240510_115815
240510_095818:cmsbot_crab_rucio_transfers_group_20240510_115818
240510_095822:cmsbot_crab_rucio_transfers_manyedm_nopublication_20240510_115820
240510_095825:cmsbot_crab_rucio_transfers_nopublication_20240510_115823
240510_095828:cmsbot_crab_rucio_transfers_withnoneedm_20240510_115826
240510_095832:cmsbot_crab_rucio_transfers_withnoneedm_nopublication_20240510_115830

Finished at: 2024-05-10 11:58:32 Find submission log here

cmsdmwmbot commented 1 month ago

Test: Task Submission Status Tracking Result: FULL-STATUS-UNKNOWN Attempt: 0 out of 4. Will run again. Finished at: 2024-05-10 12:20:17 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/CRABServer_CheckTestResults/914/console

{'TN': '240510_095800:cmsbot_crab_20240510_115758', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'SUBMITTED', 'jobsPerStatus': {'transferring': 998, 'unsubmitted': 2}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095803:cmsbot_crab_20240510_115802', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'SUBMITTED', 'jobsPerStatus': {'finished': 5, 'running': 1}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095805:cmsbot_crab_20240510_115805', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'SUBMITTED', 'jobsPerStatus': {'transferring': 1}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095807:cmsbot_crab_20240510_115807', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'SUBMITTED', 'jobsPerStatus': {'transferring': 10}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095810:cmsbot_crab_20240510_115809', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'SUBMITTED', 'jobsPerStatus': {'transferring': 98, 'idle': 2}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095813:cmsbot_crab_20240510_115811', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'SUBMITTED', 'jobsPerStatus': {'transferring': 9, 'running': 1}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095816:cmsbot_crab_rucio_transfers_20240510_115815', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'SUBMITTED', 'jobsPerStatus': {'transferring': 40}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095818:cmsbot_crab_rucio_transfers_group_20240510_115818', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'SUBMITTED', 'jobsPerStatus': {'transferring': 40}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095822:cmsbot_crab_rucio_transfers_manyedm_nopublication_20240510_115820', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'SUBMITTED', 'jobsPerStatus': {'transferring': 40}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095825:cmsbot_crab_rucio_transfers_nopublication_20240510_115823', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'SUBMITTED', 'jobsPerStatus': {'transferring': 40}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095828:cmsbot_crab_rucio_transfers_withnoneedm_20240510_115826', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'SUBMITTED', 'jobsPerStatus': {'transferring': 40}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095832:cmsbot_crab_rucio_transfers_withnoneedm_nopublication_20240510_115830', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'SUBMITTED', 'jobsPerStatus': {'transferring': 40}, 'publication (fail/tdb/DBS)': '0/0/0'}

cmsdmwmbot commented 1 month ago

Test: Task Submission Status Tracking Result: FULL-STATUS-UNKNOWN Attempt: 1 out of 5. Will run again. Finished at: 2024-05-10 12:37:13 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/CRABServer_CheckTestResults/915/console

{'TN': '240510_095800:cmsbot_crab_20240510_115758', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'SUBMITTED', 'jobsPerStatus': {'finished': 676, 'transferring': 308, 'idle': 10, 'cooloff': 5, 'running': 1}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095803:cmsbot_crab_20240510_115802', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'SUBMITTED', 'jobsPerStatus': {'finished': 5, 'running': 1}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095805:cmsbot_crab_20240510_115805', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 1}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095807:cmsbot_crab_20240510_115807', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'SUBMITTED', 'jobsPerStatus': {'finished': 6, 'transferring': 4}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095810:cmsbot_crab_20240510_115809', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'SUBMITTED', 'jobsPerStatus': {'transferring': 14, 'finished': 85, 'idle': 1}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095813:cmsbot_crab_20240510_115811', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'SUBMITTED', 'jobsPerStatus': {'transferring': 10}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095816:cmsbot_crab_rucio_transfers_20240510_115815', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'SUBMITTED', 'jobsPerStatus': {'transferring': 6, 'finished': 34}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095818:cmsbot_crab_rucio_transfers_group_20240510_115818', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'SUBMITTED', 'jobsPerStatus': {'finished': 39, 'transferring': 1}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095822:cmsbot_crab_rucio_transfers_manyedm_nopublication_20240510_115820', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'SUBMITTED', 'jobsPerStatus': {'finished': 39, 'transferring': 1}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095825:cmsbot_crab_rucio_transfers_nopublication_20240510_115823', 'testResult': 'TestPassed', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 40}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095828:cmsbot_crab_rucio_transfers_withnoneedm_20240510_115826', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'SUBMITTED', 'jobsPerStatus': {'finished': 38, 'transferring': 2}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095832:cmsbot_crab_rucio_transfers_withnoneedm_nopublication_20240510_115830', 'testResult': 'TestPassed', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 40}, 'publication (fail/tdb/DBS)': '0/0/0'}

cmsdmwmbot commented 1 month ago

Test: Task Submission Status Tracking Result: FULL-STATUS-UNKNOWN Attempt: 2 out of 5. Will run again. Finished at: 2024-05-10 13:23:14 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/CRABServer_CheckTestResults/916/console

{'TN': '240510_095800:cmsbot_crab_20240510_115758', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'SUBMITTED', 'jobsPerStatus': {'finished': 998, 'transferring': 2}, 'publication (fail/tdb/DBS)': '0/900/900'}
{'TN': '240510_095803:cmsbot_crab_20240510_115802', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 6}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095805:cmsbot_crab_20240510_115805', 'testResult': 'TestPassed', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 1}, 'publication (fail/tdb/DBS)': '0/1/1'}
{'TN': '240510_095807:cmsbot_crab_20240510_115807', 'testResult': 'TestPassed', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 10}, 'publication (fail/tdb/DBS)': '0/10/10'}
{'TN': '240510_095810:cmsbot_crab_20240510_115809', 'testResult': 'TestRunning', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'SUBMITTED', 'jobsPerStatus': {'finished': 99, 'transferring': 1}, 'publication (fail/tdb/DBS)': '0/98/98'}
{'TN': '240510_095813:cmsbot_crab_20240510_115811', 'testResult': 'TestPassed', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 10}, 'publication (fail/tdb/DBS)': '0/10/10'}
{'TN': '240510_095816:cmsbot_crab_rucio_transfers_20240510_115815', 'testResult': 'TestPassed', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 40}, 'publication (fail/tdb/DBS)': '0/40/40'}
{'TN': '240510_095818:cmsbot_crab_rucio_transfers_group_20240510_115818', 'testResult': 'TestPassed', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 40}, 'publication (fail/tdb/DBS)': '0/40/40'}
{'TN': '240510_095822:cmsbot_crab_rucio_transfers_manyedm_nopublication_20240510_115820', 'testResult': 'TestPassed', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 40}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095825:cmsbot_crab_rucio_transfers_nopublication_20240510_115823', 'testResult': 'TestPassed', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 40}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095828:cmsbot_crab_rucio_transfers_withnoneedm_20240510_115826', 'testResult': 'TestPassed', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 40}, 'publication (fail/tdb/DBS)': '0/40/40'}
{'TN': '240510_095832:cmsbot_crab_rucio_transfers_withnoneedm_nopublication_20240510_115830', 'testResult': 'TestPassed', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 40}, 'publication (fail/tdb/DBS)': '0/0/0'}

cmsdmwmbot commented 1 month ago

Test: Task Submission Status Tracking Result: SUCCEEDED Attempt: 3 out of 5. Test is done. Finished at: 2024-05-10 14:54:22 Test log: https://cmssdt.cern.ch/dmwm-jenkins/job/CRABServer_CheckTestResults/917/console

{'TN': '240510_095800:cmsbot_crab_20240510_115758', 'testResult': 'TestPassed', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 1000}, 'publication (fail/tdb/DBS)': '0/1000/1000'}
{'TN': '240510_095803:cmsbot_crab_20240510_115802', 'testResult': 'TestPassed', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 6}, 'publication (fail/tdb/DBS)': '0/1/1'}
{'TN': '240510_095805:cmsbot_crab_20240510_115805', 'testResult': 'TestPassed', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 1}, 'publication (fail/tdb/DBS)': '0/1/1'}
{'TN': '240510_095807:cmsbot_crab_20240510_115807', 'testResult': 'TestPassed', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 10}, 'publication (fail/tdb/DBS)': '0/10/10'}
{'TN': '240510_095810:cmsbot_crab_20240510_115809', 'testResult': 'TestPassed', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 100}, 'publication (fail/tdb/DBS)': '0/100/100'}
{'TN': '240510_095813:cmsbot_crab_20240510_115811', 'testResult': 'TestPassed', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 10}, 'publication (fail/tdb/DBS)': '0/10/10'}
{'TN': '240510_095816:cmsbot_crab_rucio_transfers_20240510_115815', 'testResult': 'TestPassed', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 40}, 'publication (fail/tdb/DBS)': '0/40/40'}
{'TN': '240510_095818:cmsbot_crab_rucio_transfers_group_20240510_115818', 'testResult': 'TestPassed', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 40}, 'publication (fail/tdb/DBS)': '0/40/40'}
{'TN': '240510_095822:cmsbot_crab_rucio_transfers_manyedm_nopublication_20240510_115820', 'testResult': 'TestPassed', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 40}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095825:cmsbot_crab_rucio_transfers_nopublication_20240510_115823', 'testResult': 'TestPassed', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 40}, 'publication (fail/tdb/DBS)': '0/0/0'}
{'TN': '240510_095828:cmsbot_crab_rucio_transfers_withnoneedm_20240510_115826', 'testResult': 'TestPassed', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 40}, 'publication (fail/tdb/DBS)': '0/40/40'}
{'TN': '240510_095832:cmsbot_crab_rucio_transfers_withnoneedm_nopublication_20240510_115830', 'testResult': 'TestPassed', 'dbStatus': 'SUBMITTED', 'combinedStatus': 'COMPLETED', 'jobsPerStatus': {'finished': 40}, 'publication (fail/tdb/DBS)': '0/0/0'}

belforte commented 1 month ago

all OK

dmwm / CRABServer

#773: Test prod CRABClient using preprod REST instance and CMSSW_13_0_2 CMSSW release #8393