dmwm / t0wmadatasvc

T0 WMAgent Data Service read-only REST api to monitor the Tier0
0 stars 6 forks source link

Implement reco_config #4

Closed samircury closed 11 years ago

samircury commented 11 years ago

"we might end up replacing it with a call that just returns the GT" @hufnagel , any more details to add?

samircury commented 11 years ago

Should be a port of #1

samircury commented 11 years ago

Very first query yet, but should do :

SELECT reco_config.run_id AS run_id,
                                   primary_dataset.name AS primary_dataset,
                                   reco_config.proc_version AS proc_version,
                                   reco_config.global_tag AS global_tag,
                                   cmssw_version.name AS expversion
                            FROM reco_config
                            INNER JOIN primary_dataset ON
                              primary_dataset.id = reco_config.primds_id
                            INNER JOIN cmssw_version ON
                              cmssw_version.id = reco_config.cmssw_id
                            WHERE reco_config.run_id = 208392 and primary_dataset.name='Cosmics';

Notes :

Anything else is needed here?

hufnagel commented 11 years ago

Looks about right. Requiring dataset in the input is ok, but we should have the usual "pick the latest run with a reco_config record" if no run is specified.

samircury commented 11 years ago

Requirement from PCL -- if nothing specified, show it to the runs which ARE CURRENTLY RUNNING.

samircury commented 11 years ago

One thing that I don't remember from the new system, do we configure RECO only when we release it? (48h later), that meaning that we have no entries in the reco_config table if the run_end+delay was not met yet?

samircury commented 11 years ago

It seems, exactly, we only find runs which are currently running or done as :

SQL> select max(run_id) from reco_config;

MAX(RUN_ID)
-----------
     208519

And latest PR request in WMStats is PromptReco_Run208514_Cosmics, difference might be due to malfunctions of WMstats lately (couch was down just now), but this already answers our question. So the requirement from PCL is automatically fulfilled.

samircury commented 11 years ago

Still need feedback from the users, but basically done :

Nothing (defaults to the latest PromptReco released run) :

curl --insecure -X GET 'https://wmcore-samir.cern.ch/t0wmadatasvc/replay/reco_config'
[{'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'BJetPlusX', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'BTag', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'Commissioning', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'Cosmics', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'DoubleElectron', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'DoubleMu', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'DoubleMuParked', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'DoublePhoton', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'DoublePhotonHighPt', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'ElectronHad', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'FEDMonitor', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'HLTPhysicsParked', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'HTMHT', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'HTMHTParked', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'HcalHPDNoise', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'HcalNZS', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'JetHT', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'JetMon', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'LogMonitor', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'MET', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'METParked', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'MinimumBias', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'MuEG', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'MuHad', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'MuOnia', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'MuOniaParked', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'MultiJet', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'MultiJet1Parked', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'NoBPTX', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'PhotonHad', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'SingleElectron', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'SingleMu', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'SinglePhoton', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'SinglePhotonParked', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'Tau', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'TauParked', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'TauPlusX', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'VBF1Parked', 'run': 208534, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'ZeroBiasParked', 'run': 208534, 'proc_version': 4}]

Specifying only run :

[samir@docms10] ~ $ curl --insecure -X GET 'https://wmcore-samir.cern.ch/t0wmadatasvc/replay/reco_config?run_id=208347'
[{'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'Commissioning', 'run': 208347, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'Cosmics', 'run': 208347, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'FEDMonitor', 'run': 208347, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'HcalHPDNoise', 'run': 208347, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'HcalNZS', 'run': 208347, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'LogMonitor', 'run': 208347, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'MinimumBias', 'run': 208347, 'proc_version': 4}, {'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'NoBPTX', 'run': 208347, 'proc_version': 4}]

Run and PD :

[samir@docms10] ~ $ curl --insecure -X GET 'https://wmcore-samir.cern.ch/t0wmadatasvc/replay/reco_config?run_id=208534&primary_dataset=MuOniaParked'
[{'cmssw_version': 'CMSSW_5_3_6', 'global_tag': 'GR_P_V42::All', 'primary_dataset': 'MuOniaParked', 'run': 208534, 'proc_version': 4}]