Skip to content
This repository has been archived by the owner on May 9, 2020. It is now read-only.

patch to dataset ordering compareDS (miniaod) #18

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

franzoni
Copy link

  • this function compareDS needs scratching and re-writing
  • this PR is intended as a possible pro-tempore solution to assure miniaod are NOT on top of AODSIM,RECO when a single request
  • NOTE: requires processing string to be the same for all data tiers, or, in case of ALCARECO, that processing be a longer string than normal processing string

… requires processing string to be the same for all data tiers, or, in case of ALCARECO, that processing be a longer string than normal processing string
@vlimant
Copy link
Contributor

vlimant commented Oct 31, 2014

In relation to this and an failed attempt at getting this function rationalized, I came to the conclusion that there was no "good" way to present any of the produced dataset (even more with TaskChain involving trees of requests) and that stats should go toward displaying all outputs (with corresponding expected).
On McM side, vlimant/cmsPdmV@eef36f9 as part of cms-PdmV/cmsPdmV#665 offers a way of using the last (sequence) first (tier) for accounting, instead of the one presented by stats, and having the list of output ordered along the sequences of the request.

@anorkus
Copy link
Contributor

anorkus commented Nov 5, 2014

Hi,

for now tested only on pdmserv* serquests with more than 2 output DS. Got a miss match (compared to existing request data in statsDB) for 1 request out of 45.
pdmvserv_task_SUS-Summer12WMLHE-00004__v1_T_141003_120119_9755
produced:
['/DYJetsToLL_M-10to50_HT-400toInf_TuneZ2star_8TeV-madgraph-tauola_TaskChainWithEff/Summer12-START53_V7C-v1/GEN-SIM',
'/DYJetsToLL_M-10to50_HT-400toInf_TuneZ2star_8TeV-madgraph-tauola_TaskChainWithEff/Summer12WMLHE-START53_V7C-v1/GEN',
'/DYJetsToLL_M-10to50_HT-400toInf_TuneZ2star_8TeV-madgraph-tauola_TaskChainWithEff/Summer12DR53X-PU_S10_START53_V19-v1/AODSIM',
'/DYJetsToLL_M-10to50_HT-400toInf_TuneZ2star_8TeV-madgraph-tauola_TaskChainWithEff/Summer12DR53X-PU_S10_START53_V19-v1/DQM',
'/DYJetsToLL_M-10to50_HT-400toInf_TuneZ2star_8TeV-madgraph-tauola_TaskChainWithEff/Summer12DR53X-PU_S10_START53_V19-v1/GEN-SIM-RAW']

in this case the request output_dataset would be set for "GEN-SIM".

While in DB it has:
["///AODSIM",
"///DQM",
"///GEN-SIM-RAW",
"///GEN-SIM",
"///GEN"]
and output_ds is "AODSIM"

# for free to subscribe to this conversation on GitHub. Already have an account? #.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants