Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update workflow json templates #10654

Closed
amaltaro opened this issue Jul 1, 2021 · 1 comment · Fixed by #10761 or #10864
Closed

Update workflow json templates #10654

amaltaro opened this issue Jul 1, 2021 · 1 comment · Fixed by #10761 or #10864

Comments

@amaltaro
Copy link
Contributor

amaltaro commented Jul 1, 2021

Impact of the new feature
WMCore

Is your feature request related to a problem? Please describe.
Some templates are no longer working, likely because data has been removed from the system, or because data has not been fully migrated to Rucio Int.

One example that - apparently - no longer has the input dataset in Rucio Prod is:

2021-07-01 16:16:31,004:WARNING:RequestInfo: Removing workflow that failed processing in MSTransferor: amaltaro_SC_PY3_PURecyc_June2021_ValPY2_210629_142006_5899

Describe the solution you'd like
none

Describe alternatives you've considered
Update problematic workflow json templates (either DMWM or Integration packages) that somehow fail in our system, e.g.:

  • templates that never move beyond MSTransferor, due to no longer existent input data;
  • or workflows with configuration broken
  • or workflows depending on slc5_* scram arch (e.g.: ReRecoSkim.json), which became no longer supported starting in WMCore 1.5.0.pre6

Additional context
none

@amaltaro
Copy link
Contributor Author

amaltaro commented Aug 2, 2021

Quick update. The python3 templates are using a pileup data that no longer exists in the system:

(PY3) AlanNewMacPro:WMCore amaltaro$ grep -rI '/RelValMinBias_14TeV/CMSSW_11_3_0_pre5-113X_mcRun3_2021_realistic_v7-v1/GEN-SIM' test/*
test/data/ReqMgr/requests/Integration/TC_PY3_TTbarPU.json:            "MCPileup": "/RelValMinBias_14TeV/CMSSW_11_3_0_pre5-113X_mcRun3_2021_realistic_v7-v1/GEN-SIM", 
test/data/ReqMgr/requests/Integration/SC_PY3_PURecyc.json:            "MCPileup": "/RelValMinBias_14TeV/CMSSW_11_3_0_pre5-113X_mcRun3_2021_realistic_v7-v1/GEN-SIM", 
test/data/ReqMgr/requests/Integration/SC_PY3_PURecyc.json:            "MCPileup": "/RelValMinBias_14TeV/CMSSW_11_3_0_pre5-113X_mcRun3_2021_realistic_v7-v1/GEN-SIM", 

as one can see from the Rucio list-rules command:

amaltaro@lxplus755:~ $ rucio list-rules cms:/RelValMinBias_14TeV/CMSSW_11_3_0_pre5-113X_mcRun3_2021_realistic_v7-v1/GEN-SIM
ID                                ACCOUNT            SCOPE:NAME                                                                           STATE[OK/REPL/STUCK]    RSE_EXPRESSION      COPIES  EXPIRES (UTC)        CREATED (UTC)
--------------------------------  -----------------  -----------------------------------------------------------------------------------  ----------------------  ----------------  --------  -------------------  -------------------
f73e4c93a5f84d17916965c92b88f555  wmcore_transferor  cms:/RelValMinBias_14TeV/CMSSW_11_3_0_pre5-113X_mcRun3_2021_realistic_v7-v1/GEN-SIM  OK[0/0/0]               T1_US_FNAL_Disk          1  2021-08-05 09:18:01  2021-08-02 09:18:01

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
1 participant