dmwm / das2go

Go implementation of Data Aggregation System (DAS) for CMS experiment
MIT License
2 stars 3 forks source link

site query broken in web UI #49

Closed clelange closed 2 years ago

clelange commented 2 years ago

I was trying to figure out if a data set is already available at a site, but the query

'site dataset=/DYJetsToLL_0J_TuneCP5_13TeV-amcatnloFXFX-pythia8/RunIISummer20UL16NanoAODAPVv9-106X_mcRun2_asymptotic_preVFP_v11-v1/NANOAODSIM'

equivalent to https://cmsweb.cern.ch/das/request?instance=prod/global&input=site+dataset%3D%2FDYJetsToLL_0J_TuneCP5_13TeV-amcatnloFXFX-pythia8%2FRunIISummer20UL16NanoAODAPVv9-106X_mcRun2_asymptotic_preVFP_v11-v1%2FNANOAODSIM

returns

image

while dasgoclient lists the sites:

dasgoclient -query 'site dataset=/DYJetsToLL_0J_TuneCP5_13TeV-amcatnloFXFX-pythia8/RunIISummer20UL16NanoAODAPVv9-106X_mcRun2_asymptotic_preVFP_v11-v1/NANOAODSIM'
T1_DE_KIT_Disk
T1_ES_PIC_Disk
T1_RU_JINR_Disk
T1_US_FNAL_Disk
T2_BE_IIHE
T2_BE_UCL
T2_CH_CSCS
T2_DE_DESY
T2_EE_Estonia
T2_ES_CIEMAT
T2_FR_GRIF_LLR
T2_IN_TIFR
T2_IT_Legnaro
T2_UK_London_IC
T2_UK_SGrid_RALPP
T2_US_MIT
T2_US_Nebraska
T2_US_Purdue
T3_IT_Trieste

Any idea what could be wrong?

vkuznet commented 2 years ago

Clemens, thanks for report, it seems you found a bug in DAS web interface. The issue comes from calculation of ratios and in this case a dataset/blocks has zero files which cause to lead to NaN and web server fails to proceed. I identified the issue and send a patch in this commit: 5be4186 I need some time to perform additional tests to put version in production though and it may take a while since I'm traveling.

clelange commented 2 years ago

Thanks, Valentin! I'll wait for the fixed version to be deployed.

vkuznet commented 2 years ago

also, I found that any site queries on DAS web UI are broken now due to wrong proxy cert, see discussion here https://mattermost.web.cern.ch/cms-o-and-c/channels/web-serv--security

vkuznet commented 2 years ago

Now, the certificate issue is fixed and new version of DAS server is deployed, if you'll query DAS on cmsweb again you'll see the site content. Please verify and close the issue.

clelange commented 2 years ago

Thanks a lot! I can confirm it's working now (showing only the first 4 sites):

image

I haven't checked if the percentages are correct though. I assume they are.