dmwm / DAS

Data Aggregation System
11 stars 7 forks source link

No results, dataset=/DarkMatter_Codex_LQ1000_DM_400_X_420_TuneCUETP8M1_13TeV-madgraph/RunIISummer16MiniAODv2-PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/MINIAODSIM (20 Feb 2017 01:53:28 GMT) #4271

Closed abdollah110 closed 6 years ago

abdollah110 commented 7 years ago

DAS is working terribly. It frequently fails to show the search results. do you have any idea why this is so unreliable ?

vkuznet commented 7 years ago

Hi, I requested DAS restart, but the problem seems to be related to amount of info certain datasets (including this one) contains in McM and/or reqmgr2 data-services. The error I got shown that meta-data transferred from these services exceed the limit DAS is capable to store for single record (16MB). Why McM/ReqMgr2 contains 16MB of info for a dataset is a different story.

In a future, you may avoid this overhead by restricting your query only to DBS3 info, e.g. dataset dataset=/DarkMatter_Codex_LQ1000_DM_400_X_420_TuneCUETP8M1_13TeV-madgraph/RunIISummer16MiniAODv2-PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/MINIAODSIM system=dbs3

Best, Valentin.

On 0, abdollah notifications@github.com wrote:

DAS is working terribly. It frequently fails to show the search results. do you have any idea why this is so unreliable ?

-- You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub: https://github.com/dmwm/DAS/issues/4271

vkuznet commented 6 years ago

identified racing condition in DAS, new version was deployed to production and it is more stable now.