search

e4nu / e4nuanalysiscode

Placeholder for all e4nu analyses
1 stars 2 forks source link

Generate Splines #142

Closed jtenavidal closed 1 week ago

jtenavidal commented 10 months ago

Generating files monitoring

jtenavidal commented 10 months ago

Storing the splines here:

/pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Splines

jtenavidal commented 10 months ago

python eAScatteringGridSubmitter.py --git-location https://github.com/GENIE-MC/Generator.git --git-branch master --jobs-topdir /pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Splines/G18_10a/master/ --config-dir /pnfs/genie/persistent/users/jtenavid/e4nu_files/e4nu-GENIE-config --e-tgt-list 1000010010,1000010020,1000080160,1000060120,1000200400,1000200480,1000260560 --E-e-maxsplines 10 --stopping-point 4 --tune G18_10a_00_000 --store-comitinfo

jtenavidal commented 10 months ago

For Caleb Thank you for your presentation and your offer to generate events. The spline I would like to use is "11_1000010020_EM_G18_02a_00_000_Q2_0_4.xml" which you used to generate 1M events previously. If you do not have a copy of it, I can leave it somewhere on ifarm where you can obtain it. I don't know if it needs to be changed, but if you can use it to generate 100M GENIE events with the different model configurations, I can compare how well they predict D(e,e') and D(e,e'pi).

While I would like 100M from that spline, I would also like 100M events from some of the other model configurations you mentioned on Monday's talk (I don't have your slides to say exactly which ones). My thought is to compare them with the 4.244 GeV data I am looking at to see how well they predict cross sections.

I am not certain how best to give me the event files as I do not have access to the fnal grid, but in the past, you moved them to a directory in /u/scratch/jtena/ and I copied them to a more permanent directory for me.

jtenavidal commented 9 months ago

python eAScatteringGridSubmitter.py --git-location https://github.com/e4nu/Generator_Q04.git --git-branch master --jobs-topdir /pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/Carbon/1GeV/G18_10a/ --config-dir /pnfs/genie/persistent/users/jtenavid/e4nu_files/e4nu-config-files/e4nu-GENIE-config --starting-point 4 --tune G18_10a_00_000 --total-xsec /pnfs/genie/persistent/users/jtenavid/e4nu_files/GENIE_Files/2024Splines/G18_10a_Dipole_Q2_04_eNuclei.xml --store-comitinfo --ebeam-energy 2.261 --e-ntotevents 50000000 --e-tgt-list 1000060120 --no-ghep-output --gst-output

jtenavidal commented 9 months ago 
python eAScatteringGridSubmitter.py --git-location https://github.com/e4nu/Generator-Q201.git --git-branch master --jobs-topdir /pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/Carbon/1GeV/G18_10a --config-dir /pnfs/genie/persistent/users/jtenavid/e4nu_files/e4nu-config-files/e4nu-GENIE-config --starting-point 4 --tune G18_10a_00_000 --total-xsec /pnfs/genie/persistent/users/jtenavid/e4nu_files/GENIE_Files/2024Splines/G18_10a_Dipole_Q2_01_eNuclei.xml --store-comitinfo --ebeam-energy 2.261 --e-ntotevents 20000000 --e-tgt-list 1000060120 --no-ghep-output --gst-output

JOBID: 52267169.0@jobsub03.fnal.gov

jtenavidal commented 9 months ago

C+G18_10a_1GeV: Use job id 76137480.0@jobsub02.fnal.gov to retrieve output C+G18_10b_1GeV: 

python eAScatteringGridSubmitter.py --git-location https://github.com/e4nu/Generator-Q201.git --git-branch master --jobs-topdir /pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/Carbon/1GeV/G18_10b/ --config-dir /pnfs/genie/persistent/users/jtenavid/e4nu_files/e4nu-config-files/e4nu-GENIE-config --starting-point 4 --tune G18_10b_00_000 --total-xsec /pnfs/genie/persistent/users/jtenavid/e4nu_files/GENIE_Files/2024Splines/G18_10b_Dipole_Q2_01_eNuclei.xml --store-comitinfo --ebeam-energy 1.161 --e-ntotevents 20000000 --e-tgt-list 1000060120 --no-ghep-output --gst-output

C+G18_10a_RS 1GeV: 7851720.0@jobsub04.fnal.gov C_GEM_RS 1GEV: 7808822.0@jobsub05.fnal.gov C+G18_10d_1GeV: C+GEM21_11a 1GeV: C+G18_10a_CFG 1GeV: C+G18_10a_RFG 1GeV:

jtenavidal commented 9 months ago

/pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/Carbon/1GeV/G18_10a_CFG/: 76160447.0@jobsub02.fnal.gov

/pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/Carbon/1GeV/GEM21_11c: 76158503.0@jobsub02.fnal.gov

GEM21_11d: 7836402.0@jobsub04.fnal.gov

GEM21_11c+CFG: 76158861.0@jobsub02.fnal.gov

jtenavidal commented 9 months ago

Copying 681834 bytes https://fndcadoor.fnal.gov:2880/genie/persistent/users/jtenavid/e4nu_files/GENIE_Files/2024Splines/GEM21_11a_Dipole_Q2_01_eNuclei.xml => file:///srv/no_xfer/0/TRANSFERRED_INPUT_FILES/GEM21_11a_Dipole_Q2_01_eNuclei.xml gevgen: KineUtils.cxx:1067: double genie::utils::kinematics::Q2toQD2(double): Assertion `Q2>0' failed.

jtenavidal commented 9 months ago 
python eAScatteringGridSubmitter.py --git-location https://github.com/e4nu/Generator-Q201.git --git-branch master --jobs-topdir /pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/Iron/1GeV/GEM21_11b --config-dir /pnfs/genie/persistent/users/jtenavid/e4nu_files/e4nu-config-files/e4nu-GENIE-config --starting-point 4 --tune GEM21_11b_00_000 --total-xsec /pnfs/genie/persistent/users/jtenavid/e4nu_files/GENIE_Files/2024Splines/GEM21_11b_Dipole_Q2_01_eNuclei.xml --store-comitinfo --ebeam-energy 1.161 --e-ntotevents 20000000 --e-tgt-list 1000260560 --no-ghep-output --gst-output

DIS IRON MISSING FIXED GEM a: 76208934.0@jobsub02.fnal.gov b: 7841406.0@jobsub05.fnal.gov c: d:

jtenavidal commented 9 months ago

Rad corr with adi's simple:

python eAScatteringGridSubmitter.py --jobs-topdir /pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/AdiSimple/ --total-xsec /pnfs/genie/persistent/users/jtenavid/e4nu_files/GENIE_Files/2024Splines/G18_10a_Dipole_master_eFreeNucleon.xml --config-dir /pnfs/genie/persistent/users/jtenavid/e4nu_files/e4nu-config-files/e4nu-GENIE-config --probe-list 11 --vN-gen-list none --vA-gen-list none --e-ntotevents 10000000 --starting-point 4 --no-ghep-output --gst-output --tune G18_10a_00_000 --e-tgt-list 1000010010 --store-comitinfo --subjob-disk 4GB --subjob-memory 4GB --mainjob-memory 10GB --mainjob-disk 10GB --ebeam-energy 4.325 --git-location https://github.com/e4nu/Generator-Rad --git-branch jtv_radcorr_simple --event-generator-list EMQEradcorr --submit-jobs

52397821.0@jobsub03.fnal.gov

jtenavidal commented 9 months ago

Carbon 1 GeV

python eAScatteringGridSubmitter.py --git-location https://github.com/e4nu/Generator-Q201.git --git-branch master --jobs-topdir /pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/Carbon/1GeV/GEM21_11a_NoFSI/ --config-dir /pnfs/genie/persistent/users/jtenavid/e4nu_files/e4nu-config-files/e4nu-GENIE-config-Susa-NoFSI/ --starting-point 4 --tune GEM21_11a_00_000 --total-xsec /pnfs/genie/persistent/users/jtenavid/e4nu_files/GENIE_Files/2024Splines/GEM21_11a_Dipole_Q2_01_eNuclei.xml --store-comitinfo --ebeam-energy 1.161 --e-ntotevents 20000000 --e-tgt-list 1000060120 --no-ghep-output --gst-output --submit-jobs

GEMc: 7922889.0@jobsub04.fnal.gov - ERRORS GEM+RARITA:

Carbon 2GeV: 

python eAScatteringGridSubmitter.py --git-location https://github.com/e4nu/Generator_Q04.git --git-branch master --jobs-topdir /pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/Carbon/2GeV/G18_10a_NoFSI/ --config-dir /pnfs/genie/persistent/users/jtenavid/e4nu_files/e4nu-config-files/e4nu-GENIE-config-G18-NoFSI/ --starting-point 4 --tune G18_10a_00_000 --total-xsec /pnfs/genie/persistent/users/jtenavid/e4nu_files/GENIE_Files/2024Splines/G18_10a_Dipole_Q2_04_eNuclei.xml --store-comitinfo --ebeam-energy 2.261 --e-ntotevents 20000000 --e-tgt-list 1000060120 --no-ghep-output --gst-output --submit-jobs

Carbon , GEM, 4GeV

python eAScatteringGridSubmitter.py --git-location https://github.com/e4nu/Generator_Q208.git --git-branch master --jobs-topdir /pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/Carbon/4GeV/GEM21_11b --config-dir /pnfs/genie/persistent/users/jtenavid/e4nu_files/e4nu-config-files/e4nu-GENIE-config --starting-point 4 --tune GEM21_11b_00_000 --total-xsec /pnfs/genie/persistent/users/jtenavid/e4nu_files/GENIE_Files/2024Splines/GEM21_11b_Dipole_Q2_08_eNuclei.xml --store-comitinfo --ebeam-energy 4.461 --e-ntotevents 20000000 --e-tgt-list 1000060120 --no-ghep-output --gst-output --submit-jobs

Iron 1GeV:

python eAScatteringGridSubmitter.py --git-location https://github.com/e4nu/Generator-Q201.git --git-branch master --jobs-topdir /pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/Iron/1GeV/G18_10a_NoFSI --config-dir /pnfs/genie/persistent/users/jtenavid/e4nu_files/e4nu-config-files/e4nu-GENIE-config-G18-NoFSI/ --starting-point 4 --tune G18_10a_00_000 --total-xsec /pnfs/genie/persistent/users/jtenavid/e4nu_files/GENIE_Files/2024Splines/G18_10a_Dipole_Q2_01_eNuclei.xml --store-comitinfo --ebeam-energy 1.161 --e-ntotevents 20000000 --e-tgt-list 1000260560 --no-ghep-output --gst-output --submit-jobs

Iron 2GeV:

python eAScatteringGridSubmitter.py --git-location https://github.com/e4nu/Generator_Q04.git --git-branch master --jobs-topdir /pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/Iron/2GeV/G18_10a_NoFSI/ --config-dir /pnfs/genie/persistent/users/jtenavid/e4nu_files/e4nu-config-files/e4nu-GENIE-config-G18-NoFSI/ --starting-point 4 --tune G18_10a_00_000 --total-xsec /pnfs/genie/persistent/users/jtenavid/e4nu_files/GENIE_Files/2024Splines/G18_10a_Dipole_Q2_04_eNuclei.xml --store-comitinfo --ebeam-energy 2.261 --e-ntotevents 20000000 --e-tgt-list 1000260560 --no-ghep-output --gst-output --submit-jobs

GEMd:8025121.0@jobsub04.fnal.gov

Iron 4GeV:

python eAScatteringGridSubmitter.py --git-location https://github.com/e4nu/Generator_Q208.git --git-branch master --jobs-topdir /pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/Iron/4GeV/G18_10a/ --config-dir /pnfs/genie/persistent/users/jtenavid/e4nu_files/e4nu-config-files/e4nu-GENIE-config --starting-point 4 --tune G18_10a_00_000 --total-xsec /pnfs/genie/persistent/users/jtenavid/e4nu_files/GENIE_Files/2024Splines/G18_10a_Dipole_Q2_08_eNuclei.xml --store-comitinfo --ebeam-energy 4.461 --e-ntotevents 20000000 --e-tgt-list 1000260560 --no-ghep-output --gst-output --submit-jobs

GEM21+RS: 8031027.0@jobsub04.fnal.gov

jtenavidal commented 9 months ago

C, 1GeV: GEMc: Running first for master only 8011537.0@jobsub05.fnal.gov RUN FOR EM : G18_10d_Dipole_LFG_Q2_04_2GeV_eCarbon.gst.root Run Iron, GEM, RFG, 2GeV: less GEM21_11a_Dipole_RFG_Q2_04_2GeV_eIron.gst.root

Run EM for G18_10d_Dipole_LFG_Q2_04_2GeV_eIron.gst.rootls Run Rarita EM GEM For 1, 2 GeV Carbon Iron

jtenavidal commented 9 months ago

/pnfs/genie/persistent/users/jtenavid/e4nu_files/GENIE_Files/2024Generation/G18_10a_Dipole_LFG_Q2_04_2GeV_eIron.gst.root Has no events

jtenavidal commented 9 months ago

CFG:

image

LFG:

image
jtenavidal commented 9 months ago

DIPOLE, G18, 0.1

image

RARITA?

image
jtenavidal commented 9 months ago

Caleb Jobs

python eAScatteringGridSubmitter.py --git-location https://github.com/e4nu/Generator-Q204.git --git-branch master --jobs-topdir /pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/Caleb/GEM21_11a/ --config-dir /pnfs/genie/persistent/users/jtenavid/e4nu_files/e4nu-config-files/e4nu-GENIE-config --starting-point 4 --tune GEM21_11a_00_000 --total-xsec /pnfs/genie/persistent/users/jtenavid/e4nu_files/GENIE_Files/2024Splines/GEM21_11a_Dipole_Q2_04_eNuclei.xml --store-comitinfo --ebeam-energy 4.244 --e-ntotevents 20000000 --e-tgt-list 1000010020 --no-ghep-output --gst-output --submit-jobs```

8159233.0@jobsub05.fnal.gov

Rarita:

python eAScatteringGridSubmitter.py --git-location https://github.com/e4nu/Generator-Q204.git --git-branch master --jobs-topdir /pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/Caleb/GEM21_11a_Rarita/ --config-dir /pnfs/genie/persistent/users/jtenavid/e4nu_files/e4nu-config-files/e4nu-GENIE-config-SaritaSchwinger --starting-point 4 --tune GEM21_11a_00_000 --total-xsec /pnfs/genie/persistent/users/jtenavid/e4nu_files/GENIE_Files/2024Splines/GEM21_11a_Rarita_Q2_04_eNuclei.xml --store-comitinfo --ebeam-energy 4.244 --e-ntotevents 20000000 --e-tgt-list 1000010020 --no-ghep-output --gst-output --submit-jobs



8214047.0@jobsub04.fnal.gov
jtenavidal commented 8 months ago

Matan job:

76811349.0@jobsub02.fnal.gov to retrieve output

-bash-4.2$ mkdir /pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/Matan; python eAScatteringGridSubmitter.py --jobs-topdir /pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/Matan --total-xsec /pnfs/genie/persistent/users/apapadop/mySplines/master/v3_2/11_1000060120_EM_G18_02a_00_000.xml --config-dir /pnfs/genie/persistent/users/jtenavid/e4nu_files/e4nu-config-files/e4nu-GENIE-config --probe-list 11 --vN-gen-list none --vA-gen-list none --e-ntotevents 10000000 --ebeam-energy 2.07052 --starting-point 4 --no-ghep-output --gst-output --tune G18_02a_00_000 --e-tgt-list 1000060120 --store-comitinfo --subjob-disk 3GB --subjob-memory 3GB --mainjob-memory 10GB --mainjob-disk 10GB --submit-jobs

jtenavidal commented 8 months ago

Test with small jobs: 53054892.0@jobsub03.fnal.gov

jtenavidal commented 8 months ago 
python eAScatteringGridSubmitter.py --git-location https://github.com/e4nu/Generator-Q204.git --git-branch master --jobs-topdir /pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/GEM21a_CFG/Q2_04/ --config-dir /pnfs/genie/persistent/users/jtenavid/e4nu_files/e4nu-config-files/e4nu-GENIE-config-Susa-CFG/ --starting-point 4 --tune GEM21_11a_00_000 --total-xsec /pnfs/genie/persistent/users/jtenavid/e4nu_files/GENIE_Files/2024Splines/GEM21_11a_Dipole_Q2_04_eNuclei.xml --store-comitinfo --ebeam-energy 2.261 --e-ntotevents 80000000 --e-tgt-list 1000060120 --no-ghep-output --gst-output --seed 230919089

C+2GeV: 53161034.0@jobsub03.fnal.gov

python eAScatteringGridSubmitter.py --git-location https://github.com/e4nu/Generator-Q208.git --git-branch master --jobs-topdir /pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/GEM21a_CFG/Q2_08/ --config-dir /pnfs/genie/persistent/users/jtenavid/e4nu_files/e4nu-config-files/e4nu-GENIE-config-Susa-CFG/ --starting-point 4 --tune GEM21_11a_00_000 --total-xsec /pnfs/genie/persistent/users/jtenavid/e4nu_files/GENIE_Files/2024Splines/GEM21_11a_Dipole_Q2_08_eNuclei.xml --store-comitinfo --ebeam-energy 4.461 --e-ntotevents 80000000 --e-tgt-list 1000060120 --no-ghep-output --gst-output --seed 290391029 --submit-jobs

53274929.0@jobsub03.fnal.gov

jtenavidal commented 8 months ago

HA+LFG, eC, 2GeV: 53472066.0@jobsub03.fnal.gov DONE HB+LFG, eC, 2GeV: 67536255.0@jobsub01.fnal.gov DONE

HA+LFG, eFe, 2GeV: 67536036.0@jobsub01.fnal.gov DONE HB+LFG, eFe, 2GeV: 53494617.0@jobsub03.fnal.gov DONE, less stat finished

HA+LFG, eC, 4GeV: 77196631.0@jobsub02.fnal.gov done HB+LFG, eC, 4GeV: 8722201.0@jobsub04.fnal.gov done

jtenavidal commented 8 months ago

Running splines: 

python eAScatteringGridSubmitter.py  --git-location https://github.com/e4nu/Generator-Q208.git --git-branch Q2-1_8GeV --jobs-topdir /pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/Spline18Q2/ --config-dir /pnfs/genie/persistent/users/jtenavid/e4nu_files/e4nu-config-files/e4nu-GENIE-config --e-tgt-list 1000010010,1000010020,1000080160,1000060120,1000200400,1000200480,1000260560  --E-e-maxsplines 10 --stopping-point 4 --tune GEM21_11a_00_000 --store-comitinfo --submit-job

77211843.0@jobsub02.fnal.gov

jtenavidal commented 8 months ago

Caleb run job again:

python eAScatteringGridSubmitter.py --git-location https://github.com/e4nu/Generator-Q204.git --git-branch master --jobs-topdir /pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/Caleb/ --config-dir /pnfs/genie/persistent/users/jtenavid/e4nu_files/e4nu-config-files/e4nu-GENIE-config --starting-point 0 --tune G18_02a_00_000 --store-comitinfo --ebeam-energy 4.244 --e-ntotevents 100000000 --e-tgt-list 1000010020 --no-ghep-output --gst-output --submit-jobs

Running spline from scratch 8761994.0@jobsub05.fnal.gov

jtenavidal commented 7 months ago

Running splines with rarita: 

python eAScatteringGridSubmitter.py --git-location https://github.com/e4nu/Generator-Q204.git --git-branch master --jobs-topdir /pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/Caleb_Rarita/ --config-dir /pnfs/genie/persistent/users/jtenavid/e4nu_files/e4nu-config-files/e4nu-GENIE-config-SaritaSchwinger --starting-point 0 --tune G18_02a_00_000 --store-comitinfo --ebeam-energy 4.244 --e-ntotevents 100000000 --e-tgt-list 1000010020 --no-ghep-output --gst-output

77848085.0@jobsub02.fnal.gov

Run 2: 10531271.0@jobsub05.fnal.gov Run 3: 

python eAScatteringGridSubmitter.py --git-location https://github.com/e4nu/Generator-Q204.git --git-branch master --jobs-topdir /pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/Caleb_Rarita/ --config-dir /pnfs/genie/persistent/users/jtenavid/e4nu_files/e4nu-config-files/e4nu-GENIE-config-SaritaSchwinger --starting-point 4 --tune G18_02a_00_000 --store-comitinfo --ebeam-energy 4.244 --e-ntotevents 100000000 --e-tgt-list 1000010020 --no-ghep-output --gst-output --seed 292921299
jtenavidal commented 1 month ago

Older version

python eAScatteringGridSubmitter.py --git-location https://github.com/e4nu/Generator-v4-Q2Cuts.git --git-branch v3_00_06_Q2_08 --jobs-topdir /pnfs/genie/scratch/users/jtenavid/GENIE_e4nu_Generations/2024Generation/Splines_v3/G18_10a/Q2_08/ --config-dir /pnfs/genie/persistent/users/jtenavid/e4nu_files/e4nu-config-files/e4nu-GENIE-config --stopping-point 4 --tune G18_10a_00_000 --store-comitinfo --ebeam-energy 4.416 --e-ntotevents 100000000 --e-tgt-list 1000060120 --no-ghep-output --gst-output --seed 292921299