ssl-hep / ServiceX

ServiceX - a data delivery service pilot for IRIS-HEP DOMA
BSD 3-Clause "New" or "Revised" License
20 stars 21 forks source link

messed up dataset names prevents caching of did lookups #759

Open ivukotic opened 6 months ago

ivukotic commented 6 months ago

If I look at the postgresdb datasets, I see things like this:


 rucio://mc20_13TeV.364157.Sherpa_221_NNPDF30NNLO_Wmunu_MAXHTPTV0_70_CFilterBVeto.deriv.DAOD_PHYSLITE.e5340_s3681_r13145_p6026?files=1
 rucio://mc20_13TeV.364157.Sherpa_221_NNPDF30NNLO_Wmunu_MAXHTPTV0_70_CFilterBVeto.deriv.DAOD_PHYSLITE.e5340_s3681_r13145_p6026?files=2
 rucio://mc20_13TeV:mc20_13TeV.345705.Sherpa_222_NNPDF30NNLO_ggllll_0M4l130.deriv.DAOD_PHYSLITE.e6213_s3681_r13167_p6026?files=1```

each time we append something to the dataset name it will do a new did lookup and it will fail as there is no such dataset. 
I also find it not at all clean way to pass parameters.
ivukotic commented 6 months ago

this will be solved with #767