cms-sw / genproductions

Generator fragments for MC production
https://twiki.cern.ch/twiki/bin/view/CMS/GitRepositoryForGenProduction
79 stars 786 forks source link

Compilation issue when generating the diphotonJets gridpack #3418

Open Polly-Chang opened 1 year ago

Polly-Chang commented 1 year ago

Dear experts, I try to generate the gridpack with the cards from cmssw/genproductions/tree/master/bin/MadGraph5_aMCatNLO/cards/production/2017/13TeV/diphotonJets_5f_NLO_FXFX_Mgg80ToInf

The version I use: scram_arch: slc7_amd64_gcc700 cmssw_version: CMSSW_10_6_19 MG5: 2.6.1

However, there are always compilation issues:

WARNING: fct <function compile_dir at 0x7fe2e34c4938> does not return 0. Stopping the code in a clean way. The error was:
A compilation Error occurs when trying to compile /home/pollychang/exercise/root_exercise/VBS_task_mg261/genproductions/bin/MadGraph5_aMCatNLO/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_official/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_official_gridpack/work/processtmp/SubProcesses/P0_uxu_aa.
The compilation fails with the following output message:
    gfortran -O -fno-automatic -ffixed-line-length-300 -c -I. -I../../lib/ cuts.f
    cuts.f:448:21:

           integer maxflow
                         1
    Error: Symbol 'maxflow' at (1) already has basic type of INTEGER
    cuts.f:449:28:

           parameter (maxflow=999)
                                1
    Error: PARAMETER attribute of 'maxflow' conflicts with PARAMETER attribute at (1)
    cuts.f:888:21:

           integer maxflow
                         1
    Error: Symbol 'maxflow' at (1) already has basic type of INTEGER
    cuts.f:889:28:

           parameter (maxflow=999)
                                1
    Error: PARAMETER attribute of 'maxflow' conflicts with PARAMETER attribute at (1)
    cuts.f:907:24:

           integer    maxflow
                            1
    Error: Symbol 'maxflow' at (1) already has basic type of INTEGER
    cuts.f:908:28:

           parameter (maxflow=999)
                                1
    Error: PARAMETER attribute of 'maxflow' conflicts with PARAMETER attribute at (1)
    cuts.f:542:300:

        10 CALL SORTTI (A,INDEX,N)
                                                                                                                                                                                                                                                                                                                1
    Warning: Type mismatch in argument 'a' at (1); passed REAL(4) to INTEGER(4) [-Wargument-mismatch]
    cuts.f:545:300:

        20 CALL SORTTC(A,INDEX,N)
                                                                                                                                                                                                                                                                                                                1
    Warning: Type mismatch in argument 'a' at (1); passed REAL(4) to INTEGER(4) [-Wargument-mismatch]
    make: *** [makefile:73: cuts.o] Error 1

Please find the complete log file in the following link below:

/afs/cern.ch/user/p/pao/public/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_official.log

Could you have a look at it? Maybe I'm missing something.

Thanks a lot.

Best, Polly

menglu21 commented 1 year ago

Hi, I guess the error is the difference of cuts.f between MG261 and the version having the cuts.f in genrepo. could you please try to use the cuts.f of MG261 and re-implement https://github.com/cms-sw/genproductions/blob/master/bin/MadGraph5_aMCatNLO/cards/production/2017/13TeV/diphotonJets_5f_NLO_FXFX_Mgg80ToInf/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_cuts.f#L396-L410 in the default cuts.f of MG261.

btw, you may use MG265 for UL and MG29X for Run3.

Polly-Chang commented 1 year ago

Hello, Sorry, I didn't make it clear enough. I use the cuts.f from genrepo, but I go to gridpack_generation.sh and change the MG5 version into 2.6.1. https://github.com/cms-sw/genproductions/blob/master/bin/MadGraph5_aMCatNLO/gridpack_generation.sh#L138-L141

And I used MG265 to generate it at first; however, it failed with the same error. That's why I tried to use MG261, to see if different version can work.

menglu21 commented 1 year ago

I mean cuts.f of different MG versions may have different contents inside and those difference will cause error. the cuts.f in Genrepo was uploaded six years ago and I don't know what's the MG version for that. you need to use consistent cuts.f and MG version.

Polly-Chang commented 1 year ago

Hello, Unfortunately, I am not the original author of this cut, so I don't know which versions of cuts.f and MG5 are consistent. Do you have any suggestions on modifying this cuts.f to fit the current MG5 (2.6.5 or 2.9.X)? Any suggestion is highly appreciated!

menglu21 commented 1 year ago

could you please try this one with MG29 (master branch), /afs/cern.ch/user/m/melu/public/cuts.f

Polly-Chang commented 1 year ago

Hi, I tried it with the version and the cuts.f you recommended. However, there are other errors.

The versions: scram_arch: slc7_amd64_gcc10 cmssw_version: CMSSW_12_4_8 MG5: 2.9.13

Part of the errors:

WARNING: No active exception to reraise 
Exception in thread Thread-3:
Traceback (most recent call last):
  File "/cvmfs/cms.cern.ch/slc7_amd64_gcc10/external/python3/3.9.6-67e5cf5b4952101922f1d4c8474baa39/lib/python3.9/threading.py", line 973, in _bootstrap_inner
    self.run()
  File "/cvmfs/cms.cern.ch/slc7_amd64_gcc10/external/python3/3.9.6-67e5cf5b4952101922f1d4c8474baa39/lib/python3.9/threading.py", line 910, in run
    self._target(*self._args, **self._kwargs)
  File "/home/pollychang/exercise/root_exercise/VBS_mg29X/genproductions/bin/MadGraph5_aMCatNLO/diphotonJets_5f_NLO_FXFX_Mgg80ToInf/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_gridpack/work/processtmp/bin/internal/cluster.py", line 686, in worker
    six.reraise(self.fail_msg[0], self.fail_msg[1], self.fail_msg[2])
  File "/cvmfs/cms.cern.ch/slc7_amd64_gcc10/external/py3-six/1.16.0-191eaed0649a04458bb2775b1b0a08ae/lib/python3.9/site-packages/six.py", line 719, in reraise
    raise value
  File "/home/pollychang/exercise/root_exercise/VBS_mg29X/genproductions/bin/MadGraph5_aMCatNLO/diphotonJets_5f_NLO_FXFX_Mgg80ToInf/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_gridpack/work/processtmp/bin/internal/cluster.py", line 674, in worker
    returncode = exe(*arg, **opt)
  File "/home/pollychang/exercise/root_exercise/VBS_mg29X/genproductions/bin/MadGraph5_aMCatNLO/diphotonJets_5f_NLO_FXFX_Mgg80ToInf/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_gridpack/work/processtmp/bin/internal/amcatnlo_run_interface.py", line 132, in compile_dir
    misc.compile([test_exe], cwd = this_dir, job_specs = False)
  File "/home/pollychang/exercise/root_exercise/VBS_mg29X/genproductions/bin/MadGraph5_aMCatNLO/diphotonJets_5f_NLO_FXFX_Mgg80ToInf/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_gridpack/work/processtmp/bin/internal/misc.py", line 437, in deco_f_retry
    raise
RuntimeError: No active exception to reraise

Please find the complete log file in the following link below:

/afs/cern.ch/user/p/pao/public/diphotonJets_5f_NLO_FXFX_Mgg80ToInf.log
menglu21 commented 1 year ago

Hi, I found I misplace some code in the cuts.f, I updated it, could you please retry. for simplicity, you may use syntax "generate p p > a a [QCD] " only

Polly-Chang commented 1 year ago

Hello, I used the new cuts.f and simple syntax, but there is RuntimeError:

WARNING: No active exception to reraise 
Exception in thread Thread-3:
Traceback (most recent call last):
  File "/cvmfs/cms.cern.ch/slc7_amd64_gcc10/external/python3/3.9.6-67e5cf5b4952101922f1d4c8474baa39/lib/python3.9/threading.py", line 973, in _bootstrap_inner
    self.run()
  File "/cvmfs/cms.cern.ch/slc7_amd64_gcc10/external/python3/3.9.6-67e5cf5b4952101922f1d4c8474baa39/lib/python3.9/threading.py", line 910, in run
    self._target(*self._args, **self._kwargs)
  File "/home/pollychang/exercise/root_exercise/VBS_mg29X/genproductions/bin/MadGraph5_aMCatNLO/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple_gridpack/work/processtmp/bin/internal/cluster.py", line 686, in worker
WARNING: No active exception to reraise 
Exception in thread Thread-2:
WARNING: No active exception to reraise 
Exception in thread Thread-1:
Traceback (most recent call last):
Traceback (most recent call last):
  File "/cvmfs/cms.cern.ch/slc7_amd64_gcc10/external/python3/3.9.6-67e5cf5b4952101922f1d4c8474baa39/lib/python3.9/threading.py", line 973, in _bootstrap_inner
  File "/cvmfs/cms.cern.ch/slc7_amd64_gcc10/external/python3/3.9.6-67e5cf5b4952101922f1d4c8474baa39/lib/python3.9/threading.py", line 973, in _bootstrap_inner
    self.run()
  File "/cvmfs/cms.cern.ch/slc7_amd64_gcc10/external/python3/3.9.6-67e5cf5b4952101922f1d4c8474baa39/lib/python3.9/threading.py", line 910, in run
    self.run()
  File "/cvmfs/cms.cern.ch/slc7_amd64_gcc10/external/python3/3.9.6-67e5cf5b4952101922f1d4c8474baa39/lib/python3.9/threading.py", line 910, in run
    self._target(*self._args, **self._kwargs)
  File "/home/pollychang/exercise/root_exercise/VBS_mg29X/genproductions/bin/MadGraph5_aMCatNLO/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple_gridpack/work/processtmp/bin/internal/cluster.py", line 686, in worker
    self._target(*self._args, **self._kwargs)
  File "/home/pollychang/exercise/root_exercise/VBS_mg29X/genproductions/bin/MadGraph5_aMCatNLO/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple_gridpack/work/processtmp/bin/internal/cluster.py", line 686, in worker
    six.reraise(self.fail_msg[0], self.fail_msg[1], self.fail_msg[2])
    six.reraise(self.fail_msg[0], self.fail_msg[1], self.fail_msg[2])
  File "/cvmfs/cms.cern.ch/slc7_amd64_gcc10/external/py3-six/1.16.0-191eaed0649a04458bb2775b1b0a08ae/lib/python3.9/site-packages/six.py", line 719, in reraise
  File "/cvmfs/cms.cern.ch/slc7_amd64_gcc10/external/py3-six/1.16.0-191eaed0649a04458bb2775b1b0a08ae/lib/python3.9/site-packages/six.py", line 719, in reraise
    six.reraise(self.fail_msg[0], self.fail_msg[1], self.fail_msg[2])
  File "/cvmfs/cms.cern.ch/slc7_amd64_gcc10/external/py3-six/1.16.0-191eaed0649a04458bb2775b1b0a08ae/lib/python3.9/site-packages/six.py", line 719, in reraise
    raise value
    raise value
  File "/home/pollychang/exercise/root_exercise/VBS_mg29X/genproductions/bin/MadGraph5_aMCatNLO/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple_gridpack/work/processtmp/bin/internal/cluster.py", line 674, in worker
  File "/home/pollychang/exercise/root_exercise/VBS_mg29X/genproductions/bin/MadGraph5_aMCatNLO/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple_gridpack/work/processtmp/bin/internal/cluster.py", line 674, in worker
    raise value
  File "/home/pollychang/exercise/root_exercise/VBS_mg29X/genproductions/bin/MadGraph5_aMCatNLO/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple_gridpack/work/processtmp/bin/internal/cluster.py", line 674, in worker
    returncode = exe(*arg, **opt)
    returncode = exe(*arg, **opt)
    returncode = exe(*arg, **opt)
  File "/home/pollychang/exercise/root_exercise/VBS_mg29X/genproductions/bin/MadGraph5_aMCatNLO/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple_gridpack/work/processtmp/bin/internal/amcatnlo_run_interface.py", line 132, in compile_dir
  File "/home/pollychang/exercise/root_exercise/VBS_mg29X/genproductions/bin/MadGraph5_aMCatNLO/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple_gridpack/work/processtmp/bin/internal/amcatnlo_run_interface.py", line 132, in compile_dir
  File "/home/pollychang/exercise/root_exercise/VBS_mg29X/genproductions/bin/MadGraph5_aMCatNLO/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple_gridpack/work/processtmp/bin/internal/amcatnlo_run_interface.py", line 132, in compile_dir
    misc.compile([test_exe], cwd = this_dir, job_specs = False)
  File "/home/pollychang/exercise/root_exercise/VBS_mg29X/genproductions/bin/MadGraph5_aMCatNLO/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple_gridpack/work/processtmp/bin/internal/misc.py", line 437, in deco_f_retry
    misc.compile([test_exe], cwd = this_dir, job_specs = False)
    misc.compile([test_exe], cwd = this_dir, job_specs = False)
  File "/home/pollychang/exercise/root_exercise/VBS_mg29X/genproductions/bin/MadGraph5_aMCatNLO/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple_gridpack/work/processtmp/bin/internal/misc.py", line 437, in deco_f_retry
  File "/home/pollychang/exercise/root_exercise/VBS_mg29X/genproductions/bin/MadGraph5_aMCatNLO/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple_gridpack/work/processtmp/bin/internal/misc.py", line 437, in deco_f_retry
    raise
RuntimeError: No active exception to reraise
    raise
    raise
RuntimeError: No active exception to reraise
RuntimeError: No active exception to reraise
WARNING: No active exception to reraise 
Exception in thread Thread-4:
Traceback (most recent call last):
  File "/cvmfs/cms.cern.ch/slc7_amd64_gcc10/external/python3/3.9.6-67e5cf5b4952101922f1d4c8474baa39/lib/python3.9/threading.py", line 973, in _bootstrap_inner
    self.run()
  File "/cvmfs/cms.cern.ch/slc7_amd64_gcc10/external/python3/3.9.6-67e5cf5b4952101922f1d4c8474baa39/lib/python3.9/threading.py", line 910, in run
    self._target(*self._args, **self._kwargs)
  File "/home/pollychang/exercise/root_exercise/VBS_mg29X/genproductions/bin/MadGraph5_aMCatNLO/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple_gridpack/work/processtmp/bin/internal/cluster.py", line 686, in worker
    six.reraise(self.fail_msg[0], self.fail_msg[1], self.fail_msg[2])
  File "/cvmfs/cms.cern.ch/slc7_amd64_gcc10/external/py3-six/1.16.0-191eaed0649a04458bb2775b1b0a08ae/lib/python3.9/site-packages/six.py", line 719, in reraise
    raise value
  File "/home/pollychang/exercise/root_exercise/VBS_mg29X/genproductions/bin/MadGraph5_aMCatNLO/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple_gridpack/work/processtmp/bin/internal/cluster.py", line 674, in worker
    returncode = exe(*arg, **opt)
  File "/home/pollychang/exercise/root_exercise/VBS_mg29X/genproductions/bin/MadGraph5_aMCatNLO/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple_gridpack/work/processtmp/bin/internal/amcatnlo_run_interface.py", line 132, in compile_dir
    misc.compile([test_exe], cwd = this_dir, job_specs = False)
  File "/home/pollychang/exercise/root_exercise/VBS_mg29X/genproductions/bin/MadGraph5_aMCatNLO/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple_gridpack/work/processtmp/bin/internal/misc.py", line 437, in deco_f_retry
    raise
RuntimeError: No active exception to reraise

Please find the complete log file in the following link below:

/afs/cern.ch/user/p/pao/public/diphotonJets_5f_NLO_FXFX_Mgg80ToInf_simple.log