search

dmwm / DAS

Data Aggregation System
11 stars 7 forks source link

A status page for DAS service? #4258

Closed xealits closed 7 years ago

xealits commented 7 years ago

Hi,

Is there a web page with the current status of the DAS service? I think it does not work now, but cannot check/have some feed-back on this.

Regards.

vkuznet commented 7 years ago

Alex, you need to provide more info what "does not work". I checked DAS web page https://cmsweb.cern.ch/das/ and it works for me, I was able to place the query. Please note, that yesterday upgrade on cmsweb brings DAS with mandatory authentication (it was announced MANY times in different CMS HN forums). May be you lack of GRID certificate which now is required and that cause your problem. Please describe. Valentin.

On 0, Alex Toldaiev notifications@github.com wrote:

Hi,

Is there a web page with the current status of the DAS service? I think it does not work now, but cannot check/have some feed-back on this.

Regards.

You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub: https://github.com/dmwm/DAS/issues/4258

xealits commented 7 years ago

Yep, the web page works, the das_client fails on lxplus with HTTP Error 403: Forbidden -- so, probably it is due to the grid authentification. Let me check.

vkuznet commented 7 years ago

Please read the announcement, it provides details what needs to be done on client side: https://hypernews.cern.ch/HyperNews/CMS/get/cernCompAnnounce/1144/1.html

On 0, Alex Toldaiev notifications@github.com wrote:

Yep, the web page works, the das_client fails on lxplus with HTTP Error 403: Forbidden -- so, probably it is due to the grid authentification. Let me check.

You are receiving this because you commented. Reply to this email directly or view it on GitHub: https://github.com/dmwm/DAS/issues/4258#issuecomment-238556286

xealits commented 7 years ago

Ok, the new das_client queries fine, thanks! But now the grep procedure fails:

das_client --query="site dataset=/WJetsToLNu_TuneCUETP8M1_13TeV-amcatnloFXFX-pythia8/RunIISpring16MiniAODv2-PUSpring16_80X_mcRun2_asymptotic_2016_miniAODv2_v0-v1/MINIAODSIM | grep site.name,site.dataset_fraction "

with error:

File "/cvmfs/cms.cern.ch/slc6_amd64_gcc481/cms/das_client/v02.17.04/bin/das_client.py", line 476, in main
    print(' '.join(rows))
TypeError: sequence item 0: expected string, list found

When it works fine on the web interface.

vkuznet commented 7 years ago

This was never the case. The query you placed in CLI tool by default look-up a primary key of your query, i.e. site. But in grep you asked for other attributes of DAS records. To get all attributes you need to use JSON format, e.g.

das_client --query="site dataset=/WJetsToLNu_TuneCUETP8M1_13TeV-amcatnloFXFX-pythia8/RunIISpring16MiniAODv2-PUSpring16_80X_mcRun2_asymptotic_2016_miniAODv2_v0-v1/MINIAODSIM" --format=JSON

and then parse JSON as you like. It will contain all site attributes (which you're trying via grep).

Valentin.

On 0, Alex Toldaiev notifications@github.com wrote:

Ok, the new das_client queries fine, thanks! But now the grep procedure fails:

das_client --query="site dataset=/WJetsToLNu_TuneCUETP8M1_13TeV-amcatnloFXFX-pythia8/RunIISpring16MiniAODv2-PUSpring16_80X_mcRun2_asymptotic_2016_miniAODv2_v0-v1/MINIAODSIM | grep site.name,site.dataset_fraction "

with error:

File "/cvmfs/cms.cern.ch/slc6_amd64_gcc481/cms/das_client/v02.17.04/bin/das_client.py", line 476, in main
    print(' '.join(rows))
TypeError: sequence item 0: expected string, list found

When it works fine on the web interface.

You are receiving this because you commented. Reply to this email directly or view it on GitHub: https://github.com/dmwm/DAS/issues/4258#issuecomment-238569924

xealits commented 7 years ago

Ok, indeed I'll work via json format then.