search

dmwm / DBS

CMS Dataset Bookkeeping Service
Apache License 2.0
7 stars 21 forks source link

DBS3 API transient error while using dataset regex #400

Closed merictaze closed 8 years ago

merictaze commented 9 years ago

I've encountered a transient problem in DBS, I don't have much details, but if you want to check the logs, here is the details:

I've got VALID Fall11 samples from DBS on July 11, and it returned only 203 datasets. I used both DBS python API, and DBS web-page. You can find dataset returned by DBS at: /afs/cern.ch/user/m/mtaze/work/public/dbs3/Fall11.txt

Since PhEDEx has ~13k Fall11 samples in TMDB, I checked DBS again on July 14, and this time it returned ~13k valid datasets.

I also checked the history in case I had given wrong dataset regex, but it was the same, /_/Fall11/_

Regards, Meric

yuyiguo commented 9 years ago

@merictaze

I checked DBS using both API and directly access to the DB with dataset=/_/Fall11/_, but I could not repeat your result. I don't know what happened during the time you was running the query. I leave the issue open for now. Please let know if you experienced the same problem again.

yuyiguo commented 8 years ago

It was because DBS API only show valid dataset by default, if the dataset is in PRODUCTION, it will not show in default searching until the dataOps change the status to VALID.