Closed heitorPB closed 6 years ago
It is an error in upstream data returned by McM package. The returned data is not a proper JSON document that's why DAS json parser fails. I need to address this issue with McM team to get a fix for their document, it may take a while.
This issue depends on https://github.com/cms-PdmV/cmsPdmV/issues/934
The DAS will be updated in Nov cycle to take advantage of McM API JSON output fix.
Do you know when DAS will be updated in Nov?
22th Oct (Mon): Deadline for sending material to be included in the release; 23th Oct (Tue): Pre-production deployment, validation phase starts; 06th Nov (Tue): Production deployment.
On 0, Heitor notifications@github.com wrote:
Do you know when DAS will be updated in Nov?
-- You are receiving this because you commented. Reply to this email directly or view it on GitHub: https://github.com/dmwm/DAS/issues/4295#issuecomment-433313129
Changes are already on cmsweb testbed, here is your query:
Feel free to check it. Once integration tests are done the changes will be scheduled to production deployment.
Any update in this?
In production :), here is your query:
The results seems fine to me.
dasgoclient
still gives the error:
$ dasgoclient -query "mcm dataset=/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM" -json -verbose 1
Load dasmaps /afs/cern.ch/user/h/hpascoal/.dasmaps/das_maps_dbs_prod.js
mcm dataset=/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM
### unique true
### selected services [mcm:mcm4dataset] [mcm.prepid]
### selected urls map[https://cms-pdmv.cern.ch/mcm/public/restapi/requests/produces/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM:]
### selected localApis []
DAS GET https://cms-pdmv.cern.ch/mcm/public/restapi/requests/produces/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM 112.189542ms
ERRO[0000] McM unable to unmarshal the data Api=mcm4dataset Error="invalid character 'p' after array element" data="{\"results\":{\"total_events\":300300,\"config_id\":[\"6917aa2e79caf45db3687b097ec69367\",\"6917aa2e79caf45db3687b097ec6a636\"],\"_rev\":\"13-6ff56cc3eff719f5b1e9672270120ee4\",\"cmssw_release\":\"CMSSW_5_3_19\",\"mcdb_id\":-1,\"sequences\":[{\"eventcontent\":[\"RAWSIM\"],\"runsScenarioForMC\":\"\",\"donotDropOnInput\":\"\",\"extra\":\"\",\"slhc\":\"\",\"runsAndWeightsForMC\":\"\",\"dropDescendant\":false,\"pileup\":\"2012_Summer_50ns_PoissonOOTPU\",\"hltProcess\":\"\",\"index\":0,\"customise\":[],\"custom_conditions\":\"\",\"datatier\":[\"GEN-SIM-RAW\"],\"processName\":\"\",\"inputCommands\":\"\",\"particle_table\":\"\",\"conditions\":\"START53_V19::All\",\"harvesting\":\"\",\"triggerResultsProcess\":\"\",\"inputEventContent\":\"\",\"beamspot\":\"\",\"restoreRNDSeeds\":\"\",\"filtername\":\"\",\"repacked\":\"\",\"customise_commands\":\"\",\"step\":[\"DIGI\",\"L1\",\"DIGI2RAW\",\"HLT:7E33v2\"],\"gflash\":\"\",\"magField\":\"\",\"himix\":false,\"scenario\":\"\",\"geometry\":\"\",\"datamix\":\"\",\"inline_custom\":false},{\"eventcontent\":[\"AODSIM\",\"DQM\"],\"runsScenarioForMC\":\"\",\"donotDropOnInput\":\"\",\"extra\":\"\",\"slhc\":\"\",\"runsAndWeightsForMC\":\"\",\"dropDescendant\":false,\"pileup\":\"\",\"hltProcess\":\"\",\"index\":0,\"customise\":[],\"custom_conditions\":\"\",\"datatier\":[\"AODSIM\",\"DQM\"],\"processName\":\"\",\"inputCommands\":\"\",\"particle_table\":\"\",\"conditions\":\"START53_V19::All\",\"harvesting\":\"\",\"triggerResultsProcess\":\"\",\"inputEventContent\":\"\",\"beamspot\":\"\",\"restoreRNDSeeds\":\"\",\"filtername\":\"\",\"repacked\":\"\",\"customise_commands\":\"\",\"step\":[\"RAW2DIGI\",\"L1Reco\",\"RECO\",\"VALIDATION:validation_prod\",\"DQM:DQMOfflinePOGMC\"],\"gflash\":\"\",\"magField\":\"\",\"himix\":false,\"scenario\":\"\",\"geometry\":\"\",\"datamix\":\"\",\"inline_custom\":false}],\"block_black_list\":[],\"block_white_list\":[],\"process_string\":\"\",\"fragment_tag\":\"\",\"generator_parameters\":[],\"flown_with\":\"flowS12to53\",\"priority\":85000,\"version\":0,\"generators\":[\"\"pythia6\"\"],\"memory\":2300,\"type\":\"MCReproc\",\"completed_events\":300300,\"status\":\"done\",\"keep_output\":[false,true],\"energy\":8,\"tags\":[],\"fragment\":\"\",\"input_dataset\":\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12-START53_V7C-v1/GEN-SIM\",\"pwg\":\"HIG\",\"reqmgr_name\":[{\"content\":{\"pdmv_type\":\"ReDigi\",\"pdmv_status_from_reqmngr\":\"announced\",\"pdmv_dataset_name\":\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM\",\"pdmv_prep_id\":\"HIG-Summer12DR53X-02150\",\"pdmv_dataset_statuses\":{\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM\":{\"pdmv_evts_in_DAS\":300300,\"pdmv_status_in_DAS\":\"VALID\",\"pdmv_open_evts_in_DAS\":0},\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/DQM\":{\"pdmv_evts_in_DAS\":300300,\"pdmv_status_in_DAS\":\"VALID\",\"pdmv_open_evts_in_DAS\":0}},\"pdmv_evts_in_DAS\":300300,\"pdmv_dataset_list\":[\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM\",\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/DQM\"],\"pdmv_submission_date\":\"140929\",\"pdmv_status_in_DAS\":\"VALID\",\"pdmv_present_priority\":85000,\"pdmv_submission_time\":\"055804\",\"pdmv_open_evts_in_DAS\":0},\"name\":\"pdmvserv_HIG-Summer12DR53X-02150_00324_v0__140929_075804_559\"}],\"approval\":\"submit\",\"name_of_fragment\":\"\",\"pileup_dataset_name\":\"/MinBias_TuneZ2star_8TeV-pythia6/Summer12-START50_V13-v3/GEN-SIM\",\"analysis_id\":[],\"time_event\":[8,8],\"member_of_chain\":[\"HIG-chain_Summer12_flowS12to53-00276\"],\"prepid\":\"HIG-Summer12DR53X-02150\",\"extension\":0,\"size_event\":[225,225],\"notes\":\"\",\"validation\":{},\"output_dataset\":[\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM\",\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/DQM\"],\"member_of_campaign\":\"Summer12DR53X\",\"_id\":\"HIG-Summer12DR53X-02150\",\"dataset_name\":\"BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola\",\"history\":[{\"action\":\"created\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"joinchain\",\"step\":\"HIG-chain_Summer12_flowS12to53-00276\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"flow\",\"step\":\"HIG-chain_Summer12_flowS12to53-00276\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"priority\",\"step\":85000,\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"approve\",\"step\":\"approve\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"setstatus\",\"step\":\"approved\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"approve\",\"step\":\"submit\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"inject\",\"step\":\"flowS12to53_Summer12DR53X-00324\",\"updater\":{\"author_email\":\"\",\"submission_date\":\"2014-09-29-07-58\",\"author_username\":\"automatic\",\"author_name\":\"\"}},{\"action\":\"setstatus\",\"step\":\"submitted\",\"updater\":{\"author_email\":\"\",\"submission_date\":\"2014-09-29-07-58\",\"author_username\":\"automatic\",\"author_name\":\"\"}},{\"action\":\"setstatus\",\"step\":\"done\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-10-10-12-12\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}}]}}"
Received 1 records
[
{"das":{"expire":1541622143,"instance":"prod/global","primary_key":"mcm.prepid","record":1,"services":["mcm:mcm4dataset"]},"mcm":[null],"qhash":"f1a0a0db3b6cff225e5be6e1530cec0c"}
]
piping the data
to json_reformat
gives:
echo "{\"results\":{\"total_events\":300300,\"config_id\":[\"6917aa2e79caf45db3687b097ec69367\",\"6917aa2e79caf45db3687b097ec6a636\"],\"_rev\":\"13-6ff56cc3eff719f5b1e9672270120ee4\",\"cmssw_release\":\"CMSSW_5_3_19\",\"mcdb_id\":-1,\"sequences\":[{\"eventcontent\":[\"RAWSIM\"],\"runsScenarioForMC\":\"\",\"donotDropOnInput\":\"\",\"extra\":\"\",\"slhc\":\"\",\"runsAndWeightsForMC\":\"\",\"dropDescendant\":false,\"pileup\":\"2012_Summer_50ns_PoissonOOTPU\",\"hltProcess\":\"\",\"index\":0,\"customise\":[],\"custom_conditions\":\"\",\"datatier\":[\"GEN-SIM-RAW\"],\"processName\":\"\",\"inputCommands\":\"\",\"particle_table\":\"\",\"conditions\":\"START53_V19::All\",\"harvesting\":\"\",\"triggerResultsProcess\":\"\",\"inputEventContent\":\"\",\"beamspot\":\"\",\"restoreRNDSeeds\":\"\",\"filtername\":\"\",\"repacked\":\"\",\"customise_commands\":\"\",\"step\":[\"DIGI\",\"L1\",\"DIGI2RAW\",\"HLT:7E33v2\"],\"gflash\":\"\",\"magField\":\"\",\"himix\":false,\"scenario\":\"\",\"geometry\":\"\",\"datamix\":\"\",\"inline_custom\":false},{\"eventcontent\":[\"AODSIM\",\"DQM\"],\"runsScenarioForMC\":\"\",\"donotDropOnInput\":\"\",\"extra\":\"\",\"slhc\":\"\",\"runsAndWeightsForMC\":\"\",\"dropDescendant\":false,\"pileup\":\"\",\"hltProcess\":\"\",\"index\":0,\"customise\":[],\"custom_conditions\":\"\",\"datatier\":[\"AODSIM\",\"DQM\"],\"processName\":\"\",\"inputCommands\":\"\",\"particle_table\":\"\",\"conditions\":\"START53_V19::All\",\"harvesting\":\"\",\"triggerResultsProcess\":\"\",\"inputEventContent\":\"\",\"beamspot\":\"\",\"restoreRNDSeeds\":\"\",\"filtername\":\"\",\"repacked\":\"\",\"customise_commands\":\"\",\"step\":[\"RAW2DIGI\",\"L1Reco\",\"RECO\",\"VALIDATION:validation_prod\",\"DQM:DQMOfflinePOGMC\"],\"gflash\":\"\",\"magField\":\"\",\"himix\":false,\"scenario\":\"\",\"geometry\":\"\",\"datamix\":\"\",\"inline_custom\":false}],\"block_black_list\":[],\"block_white_list\":[],\"process_string\":\"\",\"fragment_tag\":\"\",\"generator_parameters\":[],\"flown_with\":\"flowS12to53\",\"priority\":85000,\"version\":0,\"generators\":[\"\"pythia6\"\"],\"memory\":2300,\"type\":\"MCReproc\",\"completed_events\":300300,\"status\":\"done\",\"keep_output\":[false,true],\"energy\":8,\"tags\":[],\"fragment\":\"\",\"input_dataset\":\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12-START53_V7C-v1/GEN-SIM\",\"pwg\":\"HIG\",\"reqmgr_name\":[{\"content\":{\"pdmv_type\":\"ReDigi\",\"pdmv_status_from_reqmngr\":\"announced\",\"pdmv_dataset_name\":\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM\",\"pdmv_prep_id\":\"HIG-Summer12DR53X-02150\",\"pdmv_dataset_statuses\":{\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM\":{\"pdmv_evts_in_DAS\":300300,\"pdmv_status_in_DAS\":\"VALID\",\"pdmv_open_evts_in_DAS\":0},\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/DQM\":{\"pdmv_evts_in_DAS\":300300,\"pdmv_status_in_DAS\":\"VALID\",\"pdmv_open_evts_in_DAS\":0}},\"pdmv_evts_in_DAS\":300300,\"pdmv_dataset_list\":[\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM\",\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/DQM\"],\"pdmv_submission_date\":\"140929\",\"pdmv_status_in_DAS\":\"VALID\",\"pdmv_present_priority\":85000,\"pdmv_submission_time\":\"055804\",\"pdmv_open_evts_in_DAS\":0},\"name\":\"pdmvserv_HIG-Summer12DR53X-02150_00324_v0__140929_075804_559\"}],\"approval\":\"submit\",\"name_of_fragment\":\"\",\"pileup_dataset_name\":\"/MinBias_TuneZ2star_8TeV-pythia6/Summer12-START50_V13-v3/GEN-SIM\",\"analysis_id\":[],\"time_event\":[8,8],\"member_of_chain\":[\"HIG-chain_Summer12_flowS12to53-00276\"],\"prepid\":\"HIG-Summer12DR53X-02150\",\"extension\":0,\"size_event\":[225,225],\"notes\":\"\",\"validation\":{},\"output_dataset\":[\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM\",\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/DQM\"],\"member_of_campaign\":\"Summer12DR53X\",\"_id\":\"HIG-Summer12DR53X-02150\",\"dataset_name\":\"BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola\",\"history\":[{\"action\":\"created\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"joinchain\",\"step\":\"HIG-chain_Summer12_flowS12to53-00276\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"flow\",\"step\":\"HIG-chain_Summer12_flowS12to53-00276\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"priority\",\"step\":85000,\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"approve\",\"step\":\"approve\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"setstatus\",\"step\":\"approved\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"approve\",\"step\":\"submit\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"inject\",\"step\":\"flowS12to53_Summer12DR53X-00324\",\"updater\":{\"author_email\":\"\",\"submission_date\":\"2014-09-29-07-58\",\"author_username\":\"automatic\",\"author_name\":\"\"}},{\"action\":\"setstatus\",\"step\":\"submitted\",\"updater\":{\"author_email\":\"\",\"submission_date\":\"2014-09-29-07-58\",\"author_username\":\"automatic\",\"author_name\":\"\"}},{\"action\":\"setstatus\",\"step\":\"done\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-10-10-12-12\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}}]}}" | json_reformat
lexical error: invalid char in json text.
,"version":0,"generators":[""pythia6""],"memory":2300,"type"
(right here) ------^
If I manually get rid of one of the \"
around pythia
it works nicely.
One at a time. Now when server is updated, I'll schedule new dasgoclient. Will post the update here.
On 0, Heitor notifications@github.com wrote:
dasgoclient
still gives the error:$ dasgoclient -query "mcm dataset=/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM" -json -verbose 1 Load dasmaps /afs/cern.ch/user/h/hpascoal/.dasmaps/das_maps_dbs_prod.js mcm dataset=/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM ### unique true ### selected services [mcm:mcm4dataset] [mcm.prepid] ### selected urls map[https://cms-pdmv.cern.ch/mcm/public/restapi/requests/produces/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM:] ### selected localApis [] DAS GET https://cms-pdmv.cern.ch/mcm/public/restapi/requests/produces/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM 112.189542ms ERRO[0000] McM unable to unmarshal the data Api=mcm4dataset Error="invalid character 'p' after array element" data="{\"results\":{\"total_events\":300300,\"config_id\":[\"6917aa2e79caf45db3687b097ec69367\",\"6917aa2e79caf45db3687b097ec6a636\"],\"_rev\":\"13-6ff56cc3eff719f5b1e9672270120ee4\",\"cmssw_release\":\"CMSSW_5_3_19\",\"mcdb_id\":-1,\"sequences\":[{\"eventcontent\":[\"RAWSIM\"],\"runsScenarioForMC\":\"\",\"donotDropOnInput\":\"\",\"extra\":\"\",\"slhc\":\"\",\"runsAndWeightsForMC\":\"\",\"dropDescendant\":false,\"pileup\":\"2012_Summer_50ns_PoissonOOTPU\",\"hltProcess\":\"\",\"index\":0,\"customise\":[],\"custom_conditions\":\"\",\"datatier\":[\"GEN-SIM-RAW\"],\"processName\":\"\",\"inputCommands\":\"\",\"particle_table\":\"\",\"conditions\":\"START53_V19::All\",\"harvesting\":\"\",\"triggerResultsProcess\":\"\",\"inputEventContent\":\"\",\"beamspot\":\"\",\"restoreRNDSeeds\":\"\",\"filtername\":\"\",\"repacked\":\"\",\"customise_commands\":\"\",\"step\":[\"DIGI\",\"L1\",\"DIGI2RAW\",\"HLT:7E33v2\"],\"gflash\":\"\",\"magField\":\"\",\"himix\":false,\"scenario\":\"\",\"geometry\":\"\",\"datamix\":\"\",\"inline_custom\":false},{\"eventcontent\":[\"AODSIM\",\"DQM\"],\"runsScenarioForMC\":\"\",\"donotDropOnInput\":\"\",\"extra\":\"\",\"slhc\":\"\",\"runsAndWeightsForMC\":\"\",\"dropDescendant\":false,\"pileup\":\"\",\"hltProcess\":\"\",\"index\":0,\"customise\":[],\"custom_conditions\":\"\",\"datatier\":[\"AODSIM\",\"DQM\"],\"processName\":\"\",\"inputCommands\":\"\",\"particle_table\":\"\",\"conditions\":\"START53_V19::All\",\"harvesting\":\"\",\"triggerResultsProcess\":\"\",\"inputEventContent\":\"\",\"beamspot\":\"\",\"restoreRNDSeeds\":\"\",\"filtername\":\"\",\"repacked\":\"\",\"customise_commands\":\"\",\"step\":[\"RAW2DIGI\",\"L1Reco\",\"RECO\",\"VALIDATION:validation_prod\",\"DQM:DQMOfflinePOGMC\"],\"gflash\":\"\",\"magField\":\"\",\"himix\":false,\"scenario\":\"\",\"geometry\":\"\",\"datamix\":\"\",\"inline_custom\":false}],\"block_black_list\":[],\"block_white_list\":[],\"process_string\":\"\",\"fragment_tag\":\"\",\"generator_parameters\":[],\"flown_with\":\"flowS12to53\",\"priority\":85000,\"version\":0,\"generators\":[\"\"pythia6\"\"],\"memory\":2300,\"type\":\"MCReproc\",\"completed_events\":300300,\"status\":\"done\",\"keep_output\":[false,true],\"energy\":8,\"tags\":[],\"fragment\":\"\",\"input_dataset\":\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12-START53_V7C-v1/GEN-SIM\",\"pwg\":\"HIG\",\"reqmgr_name\":[{\"content\":{\"pdmv_type\":\"ReDigi\",\"pdmv_status_from_reqmngr\":\"announced\",\"pdmv_dataset_name\":\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM\",\"pdmv_prep_id\":\"HIG-Summer12DR53X-02150\",\"pdmv_dataset_statuses\":{\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM\":{\"pdmv_evts_in_DAS\":300300,\"pdmv_status_in_DAS\":\"VALID\",\"pdmv_open_evts_in_DAS\":0},\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/DQM\":{\"pdmv_evts_in_DAS\":300300,\"pdmv_status_in_DAS\":\"VALID\",\"pdmv_open_evts_in_DAS\":0}},\"pdmv_evts_in_DAS\":300300,\"pdmv_dataset_list\":[\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM\",\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/DQM\"],\"pdmv_submission_date\":\"140929\",\"pdmv_status_in_DAS\":\"VALID\",\"pdmv_present_priority\":85000,\"pdmv_submission_time\":\"055804\",\"pdmv_open_evts_in_DAS\":0},\"name\":\"pdmvserv_HIG-Summer12DR53X-02150_00324_v0__140929_075804_559\"}],\"approval\":\"submit\",\"name_of_fragment\":\"\",\"pileup_dataset_name\":\"/MinBias_TuneZ2star_8TeV-pythia6/Summer12-START50_V13-v3/GEN-SIM\",\"analysis_id\":[],\"time_event\":[8,8],\"member_of_chain\":[\"HIG-chain_Summer12_flowS12to53-00276\"],\"prepid\":\"HIG-Summer12DR53X-02150\",\"extension\":0,\"size_event\":[225,225],\"notes\":\"\",\"validation\":{},\"output_dataset\":[\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM\",\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/DQM\"],\"member_of_campaign\":\"Summer12DR53X\",\"_id\":\"HIG-Summer12DR53X-02150\",\"dataset_name\":\"BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola\",\"history\":[{\"action\":\"created\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"joinchain\",\"step\":\"HIG-chain_Summer12_flowS12to53-00276\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"flow\",\"step\":\"HIG-chain_Summer12_flowS12to53-00276\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"priority\",\"step\":85000,\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"approve\",\"step\":\"approve\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"setstatus\",\"step\":\"approved\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"approve\",\"step\":\"submit\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"inject\",\"step\":\"flowS12to53_Summer12DR53X-00324\",\"updater\":{\"author_email\":\"\",\"submission_date\":\"2014-09-29-07-58\",\"author_username\":\"automatic\",\"author_name\":\"\"}},{\"action\":\"setstatus\",\"step\":\"submitted\",\"updater\":{\"author_email\":\"\",\"submission_date\":\"2014-09-29-07-58\",\"author_username\":\"automatic\",\"author_name\":\"\"}},{\"action\":\"setstatus\",\"step\":\"done\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-10-10-12-12\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}}]}}" Received 1 records [ {"das":{"expire":1541622143,"instance":"prod/global","primary_key":"mcm.prepid","record":1,"services":["mcm:mcm4dataset"]},"mcm":[null],"qhash":"f1a0a0db3b6cff225e5be6e1530cec0c"} ]
-- You are receiving this because you commented. Reply to this email directly or view it on GitHub: https://github.com/dmwm/DAS/issues/4295#issuecomment-436764632
I know the reason and it is fixed in das server code. The client needs to be update, I'll propagate the change to CMSSW tonight.
On 0, Heitor notifications@github.com wrote:
piping the
data
tojson_reformat
gives:echo "{\"results\":{\"total_events\":300300,\"config_id\":[\"6917aa2e79caf45db3687b097ec69367\",\"6917aa2e79caf45db3687b097ec6a636\"],\"_rev\":\"13-6ff56cc3eff719f5b1e9672270120ee4\",\"cmssw_release\":\"CMSSW_5_3_19\",\"mcdb_id\":-1,\"sequences\":[{\"eventcontent\":[\"RAWSIM\"],\"runsScenarioForMC\":\"\",\"donotDropOnInput\":\"\",\"extra\":\"\",\"slhc\":\"\",\"runsAndWeightsForMC\":\"\",\"dropDescendant\":false,\"pileup\":\"2012_Summer_50ns_PoissonOOTPU\",\"hltProcess\":\"\",\"index\":0,\"customise\":[],\"custom_conditions\":\"\",\"datatier\":[\"GEN-SIM-RAW\"],\"processName\":\"\",\"inputCommands\":\"\",\"particle_table\":\"\",\"conditions\":\"START53_V19::All\",\"harvesting\":\"\",\"triggerResultsProcess\":\"\",\"inputEventContent\":\"\",\"beamspot\":\"\",\"restoreRNDSeeds\":\"\",\"filtername\":\"\",\"repacked\":\"\",\"customise_commands\":\"\",\"step\":[\"DIGI\",\"L1\",\"DIGI2RAW\",\"HLT:7E33v2\"],\"gflash\":\"\",\"magField\":\"\",\"himix\":false,\"scenario\":\"\",\"geometry\":\"\",\"datamix\":\"\",\"inline_custom\":false},{\"eventcontent\":[\"AODSIM\",\"DQM\"],\"runsScenarioForMC\":\"\",\"donotDropOnInput\":\"\",\"extra\":\"\",\"slhc\":\"\",\"runsAndWeightsForMC\":\"\",\"dropDescendant\":false,\"pileup\":\"\",\"hltProcess\":\"\",\"index\":0,\"customise\":[],\"custom_conditions\":\"\",\"datatier\":[\"AODSIM\",\"DQM\"],\"processName\":\"\",\"inputCommands\":\"\",\"particle_table\":\"\",\"conditions\":\"START53_V19::All\",\"harvesting\":\"\",\"triggerResultsProcess\":\"\",\"inputEventContent\":\"\",\"beamspot\":\"\",\"restoreRNDSeeds\":\"\",\"filtername\":\"\",\"repacked\":\"\",\"customise_commands\":\"\",\"step\":[\"RAW2DIGI\",\"L1Reco\",\"RECO\",\"VALIDATION:validation_prod\",\"DQM:DQMOfflinePOGMC\"],\"gflash\":\"\",\"magField\":\"\",\"himix\":false,\"scenario\":\"\",\"geometry\":\"\",\"datamix\":\"\",\"inline_custom\":false}],\"block_black_list\":[],\"block_white_list\":[],\"process_string\":\"\",\"fragment_tag\":\"\",\"generator_parameters\":[],\"flown_with\":\"flowS12to53\",\"priority\":85000,\"version\":0,\"generators\":[\"\"pythia6\"\"],\"memory\":2300,\"type\":\"MCReproc\",\"completed_events\":300300,\"status\":\"done\",\"keep_output\":[false,true],\"energy\":8,\"tags\":[],\"fragment\":\"\",\"input_dataset\":\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12-START53_V7C-v1/GEN-SIM\",\"pwg\":\"HIG\",\"reqmgr_name\":[{\"content\":{\"pdmv_type\":\"ReDigi\",\"pdmv_status_from_reqmngr\":\"announced\",\"pdmv_dataset_name\":\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM\",\"pdmv_prep_id\":\"HIG-Summer12DR53X-02150\",\"pdmv_dataset_statuses\":{\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM\":{\"pdmv_evts_in_DAS\":300300,\"pdmv_status_in_DAS\":\"VALID\",\"pdmv_open_evts_in_DAS\":0},\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/DQM\":{\"pdmv_evts_in_DAS\":300300,\"pdmv_status_in_DAS\":\"VALID\",\"pdmv_open_evts_in_DAS\":0}},\"pdmv_evts_in_DAS\":300300,\"pdmv_dataset_list\":[\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM\",\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/DQM\"],\"pdmv_submission_date\":\"140929\",\"pdmv_status_in_DAS\":\"VALID\",\"pdmv_present_priority\":85000,\"pdmv_submission_time\":\"055804\",\"pdmv_open_evts_in_DAS\":0},\"name\":\"pdmvserv_HIG-Summer12DR53X-02150_00324_v0__140929_075804_559\"}],\"approval\":\"submit\",\"name_of_fragment\":\"\",\"pileup_dataset_name\":\"/MinBias_TuneZ2star_8TeV-pythia6/Summer12-START50_V13-v3/GEN-SIM\",\"analysis_id\":[],\"time_event\":[8,8],\"member_of_chain\":[\"HIG-chain_Summer12_flowS12to53-00276\"],\"prepid\":\"HIG-Summer12DR53X-02150\",\"extension\":0,\"size_event\":[225,225],\"notes\":\"\",\"validation\":{},\"output_dataset\":[\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/AODSIM\",\"/BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola/Summer12_DR53X-PU_S10_START53_V19-v1/DQM\"],\"member_of_campaign\":\"Summer12DR53X\",\"_id\":\"HIG-Summer12DR53X-02150\",\"dataset_name\":\"BBH_HToTauTau_M_125_TuneZ2star_8TeV_pythia6_tauola\",\"history\":[{\"action\":\"created\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"joinchain\",\"step\":\"HIG-chain_Summer12_flowS12to53-00276\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"flow\",\"step\":\"HIG-chain_Summer12_flowS12to53-00276\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"priority\",\"step\":85000,\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"approve\",\"step\":\"approve\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"setstatus\",\"step\":\"approved\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"approve\",\"step\":\"submit\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-09-29-07-57\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}},{\"action\":\"inject\",\"step\":\"flowS12to53_Summer12DR53X-00324\",\"updater\":{\"author_email\":\"\",\"submission_date\":\"2014-09-29-07-58\",\"author_username\":\"automatic\",\"author_name\":\"\"}},{\"action\":\"setstatus\",\"step\":\"submitted\",\"updater\":{\"author_email\":\"\",\"submission_date\":\"2014-09-29-07-58\",\"author_username\":\"automatic\",\"author_name\":\"\"}},{\"action\":\"setstatus\",\"step\":\"done\",\"updater\":{\"author_email\":\"pdmv.service@cern.ch\",\"submission_date\":\"2014-10-10-12-12\",\"author_username\":\"pdmvserv\",\"author_name\":\"PdmVService\"}}]}}" | json_reformat lexical error: invalid char in json text. ,"version":0,"generators":[""pythia6""],"memory":2300,"type" (right here) ------^
If I manually get rid of one of the
\"
aroundpythia
it works nicely.-- You are receiving this because you commented. Reply to this email directly or view it on GitHub: https://github.com/dmwm/DAS/issues/4295#issuecomment-436766561
Request new dasgoclient version in CMSSW, see progress in https://github.com/cms-sw/cmsdist/pull/4485
In production
Some mcm queries using
dasgoclient
provide more information in the error messages than in the return of the function.Example:
and
I'm running the script in lxplus.