CMS - updates to luminosity workflow

katilp commented 1 year ago

[x] update actions to v3
[x] add quotes to curl URLs
[x] update GitHub workflow env variable syntax
[x] update calls to release info API with the collision type, see #169
[x] make collision type configurable with GitHub workflow env variables
[x] read collision energy from the release info API, see #170
[x] make the necessary changes to the description text for the collision type (pp vs pphiref vs PbPb or pPb)
[x] adapt workflow for the remaining Run-1 (without the normtag file).

katilp commented 1 year ago

Is the norm tag valid for HI ref? In any case, the luminometer is all PXL (from the detailed lumi by ls file)

  YEAR: 2015
  ERAS: Run2015E
  TYPE: pphiref

CHECK the values!!

--type pxl gives 0.650551451 (PXL in byls listing), nb the pu value in the detailed listing (last lines)

262328:4647,161:161,11/23/15 06:26:44,STABLE BEAMS,2510,0.000135567,0.000132949,22.8,PXL
262328:4647,163:163,11/23/15 06:27:31,STABLE BEAMS,2510,0.000134466,0.000131870,22.6,PXL
262328:4647,164:164,11/23/15 06:27:54,STABLE BEAMS,2510,0.000136354,0.000133655,23.0,PXL
262328:4647,165:165,11/23/15 06:28:18,STABLE BEAMS,2510,0.000135275,0.000132630,22.8,PXL

no option gives 0.025775344 (PLTZERO in byls listing)

with norm tag file 0.027391601 (PXL in byls listing, see also the messages above), in the detailed listing

262328:4647,161:161,11/23/15 06:26:44,STABLE BEAMS,2510,0.000005688,0.000005578,1.0,PXL
262328:4647,163:163,11/23/15 06:27:31,STABLE BEAMS,2510,0.000005641,0.000005532,0.9,PXL
262328:4647,164:164,11/23/15 06:27:54,STABLE BEAMS,2510,0.000005723,0.000005609,1.0,PXL
262328:4647,165:165,11/23/15 06:28:18,STABLE BEAMS,2510,0.000005677,0.000005566,1.0,PXL

Compare with https://twiki.cern.ch/twiki/bin/viewauth/CMS/HIData2015#pp_Run_Table

Applying normtag file or not should not change the values as the lumi is computed for ls in cert.txt (in both cases https://cms-service-dqmdc.web.cern.ch/CAF/certification/Collisions15/5TeV/Cert_262081-262328_5TeV_PromptReco_Collisions15_25ns_JSON.txt)

Run "without normtag" https://github.com/katilp/cms-luminosity-info/actions/runs/4962604076

# cert file:
{"262163": [[1, 117], [119, 242]], "262165": [[1, 40], [45, 139]], "262167": [[1, 170], [173, 280]], "262173": [[1, 190]], "262174": [[1, 144], [149, 158]], "262204": [[1, 49]], "262205": [[1, 77], [80, 93], [95, 123], [126, 263]], "262235": [[24, 287], [289, 379]], "262248": [[26, 32], [35, 35]], "262250": [[1, 32], [34, 93], [96, 96], [99, 100]], "262252": [[1, 241]], "262253": [[1, 70], [73, 163]], "262254": [[1, 356], [361, 827], [829, 1093]], "262270": [[27, 87]], "262271": [[1, 306], [309, 329], [335, 344]], "262272": [[1, 241]], "262273": [[1, 85]], "262274": [[1, 403], [406, 449], [452, 495], [499, 573], [576, 596], [599, 1014]], "262275": [[1, 87]], "262277": [[1, 53], [55, 283]], "262325": [[14, 44], [46, 167], [170, 182], [184, 260], [262, 412], [414, 460]], "262326": [[1, 63], [66, 69], [75, 86]], "262327": [[1, 240]], "262328": [[1, 161], [163, 165]]}#from commands: value of options is --type pxl, value of input is pxl
#Brilcalc command:  brilcalc lumi -c web  -i /mnt/vol/cert.txt -u /fb --type pxl --output-style tab
#Data tag : 23v1 , Norm tag: onlineresult
+-------------+-------------------+------+------+----------------+---------------+
| run:fill    | time              | nls  | ncms | delivered(/fb) | recorded(/fb) |
+-------------+-------------------+------+------+----------------+---------------+
| 262163:4634 | 11/19/15 17:41:34 | 234  | 234  | 0.000262978    | 0.000259978   |
| 262165:4634 | 11/19/15 21:47:30 | 129  | 129  | 0.000122152    | 0.000120777   |
| 262167:4634 | 11/19/15 22:41:49 | 276  | 276  | 0.000249286    | 0.000246412   |
| 262173:4634 | 11/20/15 03:57:51 | 182  | 182  | 0.000141096    | 0.000139024   |
| 262174:4634 | 11/20/15 05:13:04 | 154  | 154  | 0.000114315    | 0.000110274   |
| 262204:4638 | 11/20/15 12:33:00 | 49   | 49   | 0.001303458    | 0.001277008   |
| 262205:4638 | 11/20/15 12:54:08 | 258  | 258  | 0.006299019    | 0.006185136   |
| 262235:4639 | 11/20/15 19:44:42 | 354  | 354  | 0.034408840    | 0.033363837   |
| 262248:4640 | 11/21/15 01:26:19 | 3    | 3    | 0.000506224    | 0.000331838   |
| 262250:4640 | 11/21/15 01:50:55 | 91   | 91   | 0.013887455    | 0.013587074   |
| 262252:4640 | 11/21/15 02:31:40 | 233  | 233  | 0.031989371    | 0.031292800   |
| 262253:4640 | 11/21/15 04:05:52 | 153  | 153  | 0.018931971    | 0.018518840   |
| 262254:4640 | 11/21/15 05:09:08 | 1068 | 1068 | 0.102274727    | 0.100339708   |
| 262270:4643 | 11/21/15 20:04:40 | 52   | 52   | 0.011279946    | 0.010651186   |
| 262271:4643 | 11/21/15 20:28:21 | 335  | 335  | 0.065289351    | 0.063661673   |
| 262272:4643 | 11/21/15 22:44:29 | 232  | 232  | 0.040171958    | 0.039233292   |
| 262273:4643 | 11/22/15 00:18:00 | 78   | 78   | 0.012823915    | 0.012489855   |
| 262274:4643 | 11/22/15 00:50:50 | 995  | 995  | 0.137526772    | 0.134367688   |
| 262275:4643 | 11/22/15 07:27:49 | 78   | 78   | 0.009196274    | 0.008979006   |
| 262277:4643 | 11/22/15 08:07:06 | 282  | 282  | 0.031358835    | 0.030591626   |
| 262325:4647 | 11/23/15 00:21:37 | 441  | 441  | 0.079569718    | 0.077354571   |
| 262326:4647 | 11/23/15 03:18:03 | 71   | 71   | 0.011379532    | 0.011085507   |
| 262327:4647 | 11/23/15 03:51:20 | 233  | 233  | 0.034841847    | 0.034066793   |
| 262328:4647 | 11/23/15 05:24:35 | 164  | 164  | 0.022808970    | 0.022297548   |
+-------------+-------------------+------+------+----------------+---------------+
#Summary: 
+-------+------+------+------+-------------------+------------------+
| nfill | nrun | nls  | ncms | totdelivered(/fb) | totrecorded(/fb) |
+-------+------+------+------+-------------------+------------------+
| 6     | 24   | 6145 | 6145 | 0.666738009       | 0.650551451      |
+-------+------+------+------+-------------------+------------------+
#Check JSON:
#(run,ls) in json but not in results: [(262163, 236), (262163, 237), (262163, 238), (262163, 239), (262163, 240), (262163, 241), (262163, 242), (262165, 134), (262165, 135), (262165, 136), (262165, 137), (262165, 138), (262165, 139), (262167, 279), (262167, 280), (262173, 183), (262173, 184), (262173, 185), (262173, 186), (262173, 187), (262173, 188), (262173, 189), (262173, 190), (262235, 25), (262248, 26), (262248, 30), (262248, 31), (262248, 32), (262248, 35), (262250, 93), (262250, 96), (262250, 99), (262250, 100), (262252, 234), (262252, 235), (262252, 236), (262252, 237), (262252, 238), (262252, 239), (262252, 240), (262252, 241), (262253, 156), (262253, 157), (262253, 158), (262253, 159), (262253, 160), (262253, 161), (262253, 162), (262253, 163), (262254, 549), (262254, 550), (262254, 551), (262254, 552), (262254, 553), (262254, 554), (262254, 555), (262254, 556), (262254, 557), (262254, 558), (262254, 859), (262254, 860), (262254, 861), (262254, 862), (262254, 863), (262254, 864), (262254, 865), (262254, 866), (262254, 867), (262254, 868), (262270, 27), (262270, 80), (262270, 81), (262270, 82), (262270, 83), (262270, 84), (262270, 85), (262270, 86), (262270, 87), (262271, 343), (262271, 344), (262272, 233), (262272, 234), (262272, 235), (262272, 236), (262272, 237), (262272, 238), (262272, 239), (262272, 240), (262272, 241), (262273, 79), (262273, 80), (262273, 81), (262273, 82), (262273, 83), (262273, 84), (262273, 85), (262274, 1007), (262274, 1008), (262274, 1009), (262274, 1010), (262274, 1011), (262274, 1012), (262274, 1013), (262274, 1014), (262275, 79), (262275, 80), (262275, 81), (262275, 82), (262275, 83), (262275, 84), (262275, 85), (262275, 86), (262275, 87), (262326, 79), (262326, 80), (262326, 81), (262326, 82), (262326, 83), (262326, 84), (262326, 85), (262326, 86), (262327, 234), (262327, 235), (262327, 236), (262327, 237), (262327, 238), (262327, 239), (262327, 240)]

Run "with normtag" https://github.com/katilp/cms-luminosity-info/actions/runs/4962696210

# cert file:
{"262163": [[1, 117], [119, 242]], "262165": [[1, 40], [45, 139]], "262167": [[1, 170], [173, 280]], "262173": [[1, 190]], "262174": [[1, 144], [149, 158]], "262204": [[1, 49]], "262205": [[1, 77], [80, 93], [95, 123], [126, 263]], "262235": [[24, 287], [289, 379]], "262248": [[26, 32], [35, 35]], "262250": [[1, 32], [34, 93], [96, 96], [99, 100]], "262252": [[1, 241]], "262253": [[1, 70], [73, 163]], "262254": [[1, 356], [361, 827], [829, 1093]], "262270": [[27, 87]], "262271": [[1, 306], [309, 329], [335, 344]], "262272": [[1, 241]], "262273": [[1, 85]], "262274": [[1, 403], [406, 449], [452, 495], [499, 573], [576, 596], [599, 1014]], "262275": [[1, 87]], "262277": [[1, 53], [55, 283]], "262325": [[14, 44], [46, 167], [170, 182], [184, 260], [262, 412], [414, 460]], "262326": [[1, 63], [66, 69], [75, 86]], "262327": [[1, 240]], "262328": [[1, 161], [163, 165]]}# normtag file:
[
["pcc5TeV15v3",{"262163":[[1,117],[118,118],[119,235]]}],
["pcc5TeV15v3",{"262165":[[1,133]]}],
["pcc5TeV15v3",{"262167":[[1,278]]}],
["pcc5TeV15v3",{"262169":[[1,50]]}],
["pcc5TeV15v3",{"262170":[[1,56]]}],
["pcc5TeV15v3",{"262171":[[1,161]]}],
["pcc5TeV15v3",{"262172":[[1,156]]}],
["pcc5TeV15v3",{"262173":[[1,182]]}],
["pcc5TeV15v3",{"262174":[[1,158]]}],
["pcc5TeV15v3",{"262204":[[1,49]]}],
["pcc5TeV15v3",{"262205":[[1,263]]}],
["pcc5TeV15v3",{"262235":[[24,24],[26,379]]}],
["pcc5TeV15v3",{"262248":[[27,29]]}],
["pcc5TeV15v3",{"262249":[[1,48]]}],
["pcc5TeV15v3",{"262250":[[1,92]]}],
["pcc5TeV15v3",{"262252":[[1,233]]}],
["pcc5TeV15v3",{"262253":[[1,155]]}],
["pcc5TeV15v3",{"262254":[[1,1093]]}],
["pcc5TeV15v3",{"262270":[[28,79]]}],
["pcc5TeV15v3",{"262271":[[1,342]]}],
["pcc5TeV15v3",{"262272":[[1,232]]}],
["pcc5TeV15v3",{"262273":[[1,78]]}],
["pcc5TeV15v3",{"262274":[[1,1006]]}],
["pcc5TeV15v3",{"262275":[[1,78]]}],
["pcc5TeV15v3",{"262277":[[1,283]]}],
["pcc5TeV15v3",{"262325":[[14,460]]}],
["pcc5TeV15v3",{"262326":[[1,78]]}],
["pcc5TeV15v3",{"262327":[[1,233]]}],
["pcc5TeV15v3",{"262328":[[1,165]]}]
]
#from commands: value of options is --normtag /mnt/vol/normtag_PHYSICS.json, value of input is normtag
#Brilcalc command:  brilcalc lumi -c web  -i /mnt/vol/cert.txt -u /fb --normtag /mnt/vol/normtag_PHYSICS.json --output-style tab
#Data tag : 23v1 , Norm tag: composite
+-------------+-------------------+------+------+----------------+---------------+
| run:fill    | time              | nls  | ncms | delivered(/fb) | recorded(/fb) |
+-------------+-------------------+------+------+----------------+---------------+
| 262163:4634 | 11/19/15 17:41:34 | 234  | 234  | 0.000011082    | 0.000010956   |
| 262165:4634 | 11/19/15 21:47:30 | 129  | 129  | 0.000005147    | 0.000005089   |
| 262167:4634 | 11/19/15 22:41:49 | 276  | 276  | 0.000010509    | 0.000010387   |
| 262173:4634 | 11/20/15 03:57:51 | 182  | 182  | 0.000005947    | 0.000005859   |
| 262174:4634 | 11/20/15 05:13:04 | 154  | 154  | 0.000004819    | 0.000004649   |
| 262204:4638 | 11/20/15 12:33:00 | 49   | 49   | 0.000054684    | 0.000053575   |
| 262205:4638 | 11/20/15 12:54:08 | 258  | 258  | 0.000264762    | 0.000259975   |
| 262235:4639 | 11/20/15 19:44:42 | 354  | 354  | 0.001445192    | 0.001401310   |
| 262248:4640 | 11/21/15 01:26:19 | 3    | 3    | 0.000021241    | 0.000013929   |
| 262250:4640 | 11/21/15 01:50:55 | 91   | 91   | 0.000583429    | 0.000570810   |
| 262252:4640 | 11/21/15 02:31:40 | 233  | 233  | 0.001345096    | 0.001315807   |
| 262253:4640 | 11/21/15 04:05:52 | 153  | 153  | 0.000795049    | 0.000777700   |
| 262254:4640 | 11/21/15 05:09:08 | 1088 | 1088 | 0.004357559    | 0.004275163   |
| 262270:4643 | 11/21/15 20:04:40 | 52   | 52   | 0.000473596    | 0.000447208   |
| 262271:4643 | 11/21/15 20:28:21 | 335  | 335  | 0.002744753    | 0.002676325   |
| 262272:4643 | 11/21/15 22:44:29 | 232  | 232  | 0.001689411    | 0.001649937   |
| 262273:4643 | 11/22/15 00:18:00 | 78   | 78   | 0.000537520    | 0.000523518   |
| 262274:4643 | 11/22/15 00:50:50 | 995  | 995  | 0.005780406    | 0.005647629   |
| 262275:4643 | 11/22/15 07:27:49 | 78   | 78   | 0.000381672    | 0.000372654   |
| 262277:4643 | 11/22/15 08:07:06 | 282  | 282  | 0.001311056    | 0.001278981   |
| 262325:4647 | 11/23/15 00:21:37 | 441  | 441  | 0.003349266    | 0.003256025   |
| 262326:4647 | 11/23/15 03:18:03 | 71   | 71   | 0.000477376    | 0.000465041   |
| 262327:4647 | 11/23/15 03:51:20 | 233  | 233  | 0.001466512    | 0.001433890   |
| 262328:4647 | 11/23/15 05:24:35 | 164  | 164  | 0.000956634    | 0.000935184   |
+-------------+-------------------+------+------+----------------+---------------+
#Summary: 
+-------+------+------+------+-------------------+------------------+
| nfill | nrun | nls  | ncms | totdelivered(/fb) | totrecorded(/fb) |
+-------+------+------+------+-------------------+------------------+
| 6     | 24   | 6165 | 6165 | 0.028072716       | 0.027391601      |
+-------+------+------+------+-------------------+------------------+

Warning: problems found in merging -i and --normtag selections:
  in run 262163 [[1, 235]] is not a superset of [[1, 117], [119, 242]]
  in run 262165 [[1, 133]] is not a superset of [[1, 40], [45, 139]]
  in run 262167 [[1, 278]] is not a superset of [[1, 170], [173, 280]]
  in run 262173 [[1, 182]] is not a superset of [[1, 190]]
  in run 262235 [[24, 24], [26, 379]] is not a superset of [[24, 287], [289, 379]]
  in run 262248 [[27, 29]] is not a superset of [[26, 32], [35, 35]]
  in run 262250 [[1, 92]] is not a superset of [[1, 32], [34, 93], [96, 96], [99, 100]]
  in run 262252 [[1, 233]] is not a superset of [[1, 241]]
  in run 262253 [[1, 155]] is not a superset of [[1, 70], [73, 163]]
  in run 262270 [[28, 79]] is not a superset of [[27, 87]]
  in run 262271 [[1, 342]] is not a superset of [[1, 306], [309, 329], [335, 344]]
  in run 262272 [[1, 232]] is not a superset of [[1, 241]]
  in run 262273 [[1, 78]] is not a superset of [[1, 85]]
  in run 262274 [[1, 1006]] is not a superset of [[1, 403], [406, 449], [452, 495], [499, 573], [576, 596], [599, 1014]]
  in run 262275 [[1, 78]] is not a superset of [[1, 87]]
  in run 262326 [[1, 78]] is not a superset of [[1, 63], [66, 69], [75, 86]]
  in run 262327 [[1, 233]] is not a superset of [[1, 240]]
#Check JSON:
#(run,ls) in json but not in results: []

The values obtained with normtag file are fairly close to those of https://twiki.cern.ch/twiki/bin/viewauth/CMS/HIData2015#pp_Run_Table

katilp commented 1 year ago

Check Run-1 values

Note, normtag starts only at Run-2

  YEAR: 2013
  ERAS: Run2013A
  TYPE: pphiref

https://github.com/katilp/cms-luminosity-info/actions/runs/4962977884

Shows 0 lumi, to be checked. Maybe --type pxl is not good... From bril docs: options available for type are: hfoc,hfet,bcm1f,bcm1fsi,bcm1futca,pltzero,pltslink,dt,pxl,ramses,radmon

cert file

# cert file:
{"211739": [[74, 189]], "211740": [[1, 127]], "211752": [[32, 211], [217, 865]], "211760": [[16, 27], [34, 238]], "211765": [[24, 198]], "211792": [[30, 902], [904, 1303]], "211797": [[22, 821]], "211812": [[66, 402]], "211821": [[370, 420]], "211822": [[1, 11]], "211823": [[1, 289]], "211831": [[38, 149]]}

Checking with bril, the values are there:

$ brilcalc lumi -c web -r 211739
#Data tag : 23v1 , Norm tag: onlineresult
+-------------+-------------------+-----+------+-----------------+-----------------+
| run:fill    | time              | nls | ncms | delivered(/ub)  | recorded(/ub)   |
+-------------+-------------------+-----+------+-----------------+-----------------+
| 211739:3555 | 02/11/13 19:43:22 | 194 | 190  | 14904.599243732 | 13570.761271201 |
+-------------+-------------------+-----+------+-----------------+-----------------+
#Summary:
+-------+------+-----+------+-------------------+------------------+
| nfill | nrun | nls | ncms | totdelivered(/ub) | totrecorded(/ub) |
+-------+------+-----+------+-------------------+------------------+
| 1     | 1    | 194 | 190  | 14904.599243732   | 13570.761271201  |
+-------+------+-----+------+-------------------+------------------+

and:

$ brilcalc lumi -c web -r 211740 --byls

#Data tag : 23v1 , Norm tag: onlineresult
+-------------+---------+-------------------+--------------+--------+----------------+---------------+-------+--------+
| run:fill    | ls      | time              | beamstatus   | E(GeV) | delivered(/ub) | recorded(/ub) | avgpu | source |
+-------------+---------+-------------------+--------------+--------+----------------+---------------+-------+--------+
| 211740:3555 | 1:1     | 02/11/13 20:59:11 | STABLE BEAMS | 1380   | 79.632232065   | 74.198927709  | 13.9  | hfoc   |
| 211740:3555 | 2:2     | 02/11/13 20:59:35 | STABLE BEAMS | 1380   | 79.505691832   | 75.652839648  | 13.8  | hfoc   |
| 211740:3555 | 3:3     | 02/11/13 20:59:58 | STABLE BEAMS | 1380   | 79.524233226   | 75.711039670  | 13.8  | hfoc   |

Only --type hfoc gives a value for these runs.

Checking in the lumi reference (http://api-server-cms-release-info.app.cern.ch/years/?year=2013) https://cds.cern.ch/record/1643269 (but it does not indicate any luminometer information)

With --type hfoc https://github.com/katilp/cms-luminosity-info/actions/runs/4978606791

# cert file:
{"211739": [[74, 189]], "211740": [[1, 127]], "211752": [[32, 211], [217, 865]], "211760": [[16, 27], [34, 238]], "211765": [[24, 198]], "211792": [[30, 902], [904, 1303]], "211797": [[22, 821]], "211812": [[66, 402]], "211821": [[370, 420]], "211822": [[1, 11]], "211823": [[1, 289]], "211831": [[38, 149]]}#from commands: value of options is --type hfoc, value of input is hfoc
#Brilcalc command:  brilcalc lumi -c web  -i /mnt/vol/cert.txt -u /fb --type hfoc --output-style tab
#Data tag : 23v1 , Norm tag: onlineresult
+-------------+-------------------+------+------+----------------+---------------+
| run:fill    | time              | nls  | ncms | delivered(/fb) | recorded(/fb) |
+-------------+-------------------+------+------+----------------+---------------+
| 211739:3555 | 02/11/13 20:11:45 | 116  | 116  | 0.000009902    | 0.000009344   |
| 211740:3555 | 02/11/13 20:59:11 | 127  | 127  | 0.000009573    | 0.000009392   |
| 211752:3556 | 02/12/13 00:16:53 | 829  | 829  | 0.000573095    | 0.000566510   |
| 211760:3557 | 02/12/13 08:34:04 | 194  | 194  | 0.000356370    | 0.000350025   |
| 211765:3558 | 02/12/13 12:08:29 | 175  | 175  | 0.000482922    | 0.000471495   |
| 211792:3559 | 02/12/13 20:41:43 | 1273 | 1273 | 0.002001115    | 0.001979328   |
| 211797:3560 | 02/13/13 07:02:59 | 800  | 800  | 0.001646550    | 0.001624956   |
| 211812:3562 | 02/13/13 16:58:56 | 337  | 337  | 0.000014357    | 0.000014308   |
+-------------+-------------------+------+------+----------------+---------------+
#Summary: 
+-------+------+------+------+-------------------+------------------+
| nfill | nrun | nls  | ncms | totdelivered(/fb) | totrecorded(/fb) |
+-------+------+------+------+-------------------+------------------+
| 7     | 8    | 3851 | 3851 | 0.005093882       | 0.005025359      |
+-------+------+------+------+-------------------+------------------+
#Check JSON:
#(run,ls) in json but not in results: [(211760, 196), (211760, 197), (211760, 198), (211760, 199), (211760, 200), (211760, 201), (211760, 202), (211760, 203), (211760, 204), (211760, 205), (211760, 206), (211760, 207), (211760, 208), (211760, 209), (211760, 210), (211760, 211), (211760, 212), (211760, 213), (211760, 214), (211760, 215), (211760, 216), (211760, 225), (211760, 230), (211821, 370), (211821, 371), (211821, 372), (211821, 373), (211821, 374), (211821, 375), (211821, 376), (211821, 377), (211821, 378), (211821, 379), (211821, 380), (211821, 381), (211821, 382), (211821, 383), (211821, 384), (211821, 385), (211821, 386), (211821, 387), (211821, 388), (211821, 389), (211821, 390), (211821, 391), (211821, 392), (211821, 393), (211821, 394), (211821, 395), (211821, 396), (211821, 397), (211821, 398), (211821, 399), (211821, 400), (211821, 401), (211821, 402), (211821, 403), (211821, 404), (211821, 405), (211821, 406), (211821, 407), (211821, 408), (211821, 409), (211821, 410), (211821, 411), (211821, 412), (211821, 413), (211821, 414), (211821, 415), (211821, 416), (211821, 417), (211821, 418), (211821, 419), (211821, 420), (211822, 1), (211822, 2), (211822, 3), (211822, 4), (211822, 5), (211822, 6), (211822, 7), (211822, 8), (211822, 9), (211822, 10), (211822, 11), (211823, 1), (211823, 2), (211823, 3), (211823, 4), (211823, 5), (211823, 6), (211823, 7), (211823, 8), (211823, 9), (211823, 10), (211823, 11), (211823, 12), (211823, 13), (211823, 14), (211823, 15), (211823, 16), (211823, 17), (211823, 18), (211823, 19), (211823, 20), (211823, 21), (211823, 22), (211823, 23), (211823, 24), (211823, 25), (211823, 26), (211823, 27), (211823, 28), (211823, 29), (211823, 30), (211823, 31), (211823, 32), (211823, 33), (211823, 34), (211823, 35), (211823, 36), (211823, 37), (211823, 38), (211823, 39), (211823, 40), (211823, 41), (211823, 42), (211823, 43), (211823, 44), (211823, 45), (211823, 46), (211823, 47), (211823, 48), (211823, 49), (211823, 50), (211823, 51), (211823, 52), (211823, 53), (211823, 54), (211823, 55), (211823, 56), (211823, 57), (211823, 58), (211823, 59), (211823, 60), (211823, 61), (211823, 62), (211823, 63), (211823, 64), (211823, 65), (211823, 66), (211823, 67), (211823, 68), (211823, 69), (211823, 70), (211823, 71), (211823, 72), (211823, 73), (211823, 74), (211823, 75), (211823, 76), (211823, 77), (211823, 78), (211823, 79), (211823, 80), (211823, 81), (211823, 82), (211823, 83), (211823, 84), (211823, 85), (211823, 86), (211823, 87), (211823, 88), (211823, 89), (211823, 90), (211823, 91), (211823, 92), (211823, 93), (211823, 94), (211823, 95), (211823, 96), (211823, 97), (211823, 98), (211823, 99), (211823, 100), (211823, 101), (211823, 102), (211823, 103), (211823, 104), (211823, 105), (211823, 106), (211823, 107), (211823, 108), (211823, 109), (211823, 110), (211823, 111), (211823, 112), (211823, 113), (211823, 114), (211823, 115), (211823, 116), (211823, 117), (211823, 118), (211823, 119), (211823, 120), (211823, 121), (211823, 122), (211823, 123), (211823, 124), (211823, 125), (211823, 126), (211823, 127), (211823, 128), (211823, 129), (211823, 130), (211823, 131), (211823, 132), (211823, 133), (211823, 134), (211823, 135), (211823, 136), (211823, 137), (211823, 138), (211823, 139), (211823, 140), (211823, 141), (211823, 142), (211823, 143), (211823, 144), (211823, 145), (211823, 146), (211823, 147), (211823, 148), (211823, 149), (211823, 150), (211823, 151), (211823, 152), (211823, 153), (211823, 154), (211823, 155), (211823, 156), (211823, 157), (211823, 158), (211823, 159), (211823, 160), (211823, 161), (211823, 162), (211823, 163), (211823, 164), (211823, 165), (211823, 166), (211823, 167), (211823, 168), (211823, 169), (211823, 170), (211823, 171), (211823, 172), (211823, 173), (211823, 174), (211823, 175), (211823, 176), (211823, 177), (211823, 178), (211823, 179), (211823, 180), (211823, 181), (211823, 182), (211823, 183), (211823, 184), (211823, 185), (211823, 186), (211823, 187), (211823, 188), (211823, 189), (211823, 190), (211823, 191), (211823, 192), (211823, 193), (211823, 194), (211823, 195), (211823, 196), (211823, 197), (211823, 198), (211823, 199), (211823, 200), (211823, 201), (211823, 202), (211823, 203), (211823, 204), (211823, 205), (211823, 206), (211823, 207), (211823, 208), (211823, 209), (211823, 210), (211823, 211), (211823, 212), (211823, 213), (211823, 214), (211823, 215), (211823, 216), (211823, 217), (211823, 218), (211823, 219), (211823, 220), (211823, 221), (211823, 222), (211823, 223), (211823, 224), (211823, 225), (211823, 226), (211823, 227), (211823, 228), (211823, 229), (211823, 230), (211823, 231), (211823, 232), (211823, 233), (211823, 234), (211823, 235), (211823, 236), (211823, 237), (211823, 238), (211823, 239), (211823, 240), (211823, 241), (211823, 242), (211823, 243), (211823, 244), (211823, 245), (211823, 246), (211823, 247), (211823, 248), (211823, 249), (211823, 250), (211823, 251), (211823, 252), (211823, 253), (211823, 254), (211823, 255), (211823, 256), (211823, 257), (211823, 258), (211823, 259), (211823, 260), (211823, 261), (211823, 262), (211823, 263), (211823, 264), (211823, 265), (211823, 266), (211823, 267), (211823, 268), (211823, 269), (211823, 270), (211823, 271), (211823, 272), (211823, 273), (211823, 274), (211823, 275), (211823, 276), (211823, 277), (211823, 278), (211823, 279), (211823, 280), (211823, 281), (211823, 282), (211823, 283), (211823, 284), (211823, 285), (211823, 286), (211823, 287), (211823, 288), (211823, 289), (211831, 38), (211831, 39), (211831, 40), (211831, 41), (211831, 42), (211831, 43), (211831, 44), (211831, 45), (211831, 46), (211831, 47), (211831, 48), (211831, 49), (211831, 50), (211831, 51), (211831, 52), (211831, 53), (211831, 54), (211831, 55), (211831, 56), (211831, 57), (211831, 58), (211831, 59), (211831, 60), (211831, 61), (211831, 62), (211831, 63), (211831, 64), (211831, 65), (211831, 66), (211831, 67), (211831, 68), (211831, 69), (211831, 70), (211831, 71), (211831, 72), (211831, 73), (211831, 74), (211831, 75), (211831, 76), (211831, 77), (211831, 78), (211831, 79), (211831, 80), (211831, 81), (211831, 82), (211831, 83), (211831, 84), (211831, 85), (211831, 86), (211831, 87), (211831, 88), (211831, 89), (211831, 90), (211831, 91), (211831, 92), (211831, 93), (211831, 94), (211831, 95), (211831, 96), (211831, 97), (211831, 98), (211831, 99), (211831, 100), (211831, 101), (211831, 102), (211831, 103), (211831, 104), (211831, 105), (211831, 106), (211831, 107), (211831, 108), (211831, 109), (211831, 110), (211831, 111), (211831, 112), (211831, 113), (211831, 114), (211831, 115), (211831, 116), (211831, 117), (211831, 118), (211831, 119), (211831, 120), (211831, 121), (211831, 122), (211831, 123), (211831, 124), (211831, 125), (211831, 126), (211831, 127), (211831, 128), (211831, 129), (211831, 130), (211831, 131), (211831, 132), (211831, 133), (211831, 134), (211831, 135), (211831, 136), (211831, 137), (211831, 138), (211831, 139), (211831, 140), (211831, 141), (211831, 142), (211831, 143), (211831, 144), (211831, 145), (211831, 146), (211831, 147), (211831, 148), (211831, 149)]

Compare with https://twiki.cern.ch/twiki/bin/view/CMS/PAData2013#pp_Run_2013

katilp commented 1 year ago

Check Run-1 2013 pPb

  YEAR: 2013
  ERAS: HIRun2013
  TYPE: pPb

The only luminometer type available is hfoc. ( check e.g. for one of the runs with for atype in hfoc hfet bcm1f bcm1fsi bcm1futca pltzero pltslink dt pxl ramses radmon; do brilcalc lumi -c web -r 211532 --type $atype; done)

Compare with https://twiki.cern.ch/twiki/bin/view/CMS/PAData2013#pPb_run_2013

katilp commented 1 year ago

From the discussion on June 6, 2023:

always check the recommendations from
- https://twiki.cern.ch/twiki/bin/viewauth/CMS/TWikiLUM#Recommendations_per_run_period
- https://twiki.cern.ch/twiki/bin/view/CMS/LumiRecommendationsRun1#Run_1_PbPb_2012_and_pPb_2013_run
would make sense to provide lumi values also for muon selection

katilp commented 1 year ago

Check:

2013 pPb 5.02 TeV data (#136)
- https://twiki.cern.ch/twiki/bin/view/CMS/LumiRecommendationsRun1#Run_1_PbPb_2012_and_pPb_2013_run:
  
  For the Run 1 heavy ion runs, the recommended prescription is to use the HF luminosity as above: brilcalc lumi --type hfoc -i [yourjson]
  
  The estimated uncertainty is 3.4%/3.6% for the 2013 pPb/Pbp runs.
- hfoc: https://github.com/cernopendata/data-curation/blob/master/.github/workflows/cms-luminosity-tables.yaml#L62
- http://api-server-cms-release-info.app.cern.ch/years/lumi_uncertainty?year=2013&type=pPb : 3.4
  - TODO: modify lumi value to 3.4/3.6 for lumi values in the server json and pPb/Pbb for the text in https://github.com/cernopendata/data-curation/blob/master/cms-YYYY-luminosity/code/lumi_records.py#L113 (or by hand)
2013 pp 2.76 TeV ref (#140)
- No information in https://twiki.cern.ch/twiki/bin/view/CMS/LumiRecommendationsRun1, however the publication is explicit:
  
  The analysis uses data collected for proton-lead collisions at a nucleon-nucleon centre-of-mass energy of 5.02\TeV and proton-proton at 2.76\TeV to provide absolute normalization factors. The systematic uncertainty is estimated to be 3.4\% (3.6\%) for proton-lead (for reversed beam direction) and 3.7\% for proton-proton data.
- http://api-server-cms-release-info.app.cern.ch/years/?year=2013&type=pphiref
```
year: 2013,
type: "pphiref",
lumi_uncertainty: 3.7,
luminosity_reference: "https://cds.cern.ch/record/1643269",
recid_val: 14218, 
```
2015 pp 5.02 TeV ref (#139)
- https://twiki.cern.ch/twiki/bin/view/CMS/LumiRecommendationsRun2#2015_AN1
For the 2015 5.02 TeV pp run, please use the physics approved normtag as follows: brilcalc lumi --normtag /cvmfs/cms-bril.cern.ch/cms-lumi-pog/Normtags/normtag_PHYSICS.json -u /pb -i [your json]

The corresponding uncertainty is 2.3%. This analysis is documented in LUM-16-001. Please see also the HN thread.

Notes:

The warning when running brilcalc with this normtag signifies the absence of offline luminosity, which is however negligible. See here.
- http://api-server-cms-release-info.app.cern.ch/years/?year=2015&typ
```
year: 2015,
type: "pphiref",
lumi_uncertainty: 1.9,
luminosity_reference: "http://cds.cern.ch/record/2765655",
recid_val: 14212,    
```
- TODO: the reference and lumi value are for 2017 pp ref data, not for those from 2015, change to https://cds.cern.ch/record/2235781 and 2.3 in the release info json

cernopendata / data-curation

CMS - updates to luminosity workflow #171