justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 92682.16@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID92682.16@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3965
Stage ID1
User nameimawby@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit43200 (12 hours)
Submitted time2024-11-07 16:00:37
SiteUS_Colorado
EntryCMSHTPC_T3_US_Colorado_heposg01-colorado
Last heartbeat2024-11-07 19:17:41
From worker nodeHostnamelnxfarm344.colorado.edu
cpuinfoIntel(R) Core(TM) i9-7920X CPU @ 2.90GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-07 16:02:15
Input filesfardet-hd:nu_dune10kt_1x2x6_1113_714_20230827T125739Z_gen_g4_detsim_hitreco__20240223T222341Z_reco2.root
JobscriptExit code0
Real time3h (11713s)
CPU time3h (11705s = 99%)
Outputting started2024-11-07 19:17:29
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/ccnuselection_nu_2/03965/1/nu_dune10kt_1x2x6_1113_714_20230827T125739Z_gen_g4_detsim_hitreco__20240223T222341Z_reco2_ccnutree.root
Finished2024-11-07 19:17:41
Saved logsjustin-logs:92682.16-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Justin processors: 1
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/

MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v09_91_02
MRB_QUALS=e26:prof
MRB_TOP=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/c3838ee97bd4cb1ae2d7f7c963e14e65c7635952
MRB_SOURCE=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/c3838ee97bd4cb1ae2d7f7c963e14e65c7635952/srcs
MRB_BUILDDIR=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/c3838ee97bd4cb1ae2d7f7c963e14e65c7635952/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/c3838ee97bd4cb1ae2d7f7c963e14e65c7635952/localProducts_larsoft_v09_91_02_e26_prof

PRODUCTS=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/c3838ee97bd4cb1ae2d7f7c963e14e65c7635952/localProducts_larsoft_v09_91_02_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/c3838ee97bd4cb1ae2d7f7c963e14e65c7635952/localProducts_larsoft_v09_91_02_e26_prof

local product directory is /cvmfs/fifeuser4.opensciencegrid.org/sw/dune/c3838ee97bd4cb1ae2d7f7c963e14e65c7635952/localProducts_larsoft_v09_91_02_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/d0/23/nu_dune10kt_1x2x6_1113_714_20230827T125739Z_gen_g4_detsim_hitreco__20240223T222341Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Output 4: 0.0418228, 0.279459, 0.616577, 0.0621416, 
Output 5: 0.0989962, 0.89046, 0.0104248, 0.000119434, 
Output 6: 0.997141, 0.00277134, 6.44293e-05, 2.35747e-05, 

Boundary wire vector sizes: 966, 1201, 1061
minwire 0: 798
minwire 1: 1599
minwire 2: 249
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.844147, 
Output 1: 0.147374, 0.000124696, 0.0238208, 0.82868, 
Output 2: 0.874522, 0.0474213, 0.0725667, 0.00548977, 
Output 3: 0.999563, 0.000400529, 8.08659e-06, 2.82214e-05, 
Output 4: 0.159577, 0.840113, 0.000224629, 8.52412e-05, 
Output 5: 0.99953, 0.000460152, 8.44681e-06, 1.76427e-06, 
Output 6: 0.999154, 0.000810163, 2.95764e-05, 6.29093e-06, 

Boundary wire vector sizes: 997, 1225, 1225
minwire 0: 2192
minwire 1: 449
minwire 2: 2053
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.053086, 
Output 1: 0.984226, 0.00437266, 0.00718389, 0.0042175, 
Output 2: 0.000312971, 0.0519399, 0.947696, 5.07832e-05, 
Output 3: 0.0737232, 0.171736, 0.396232, 0.358309, 
Output 4: 0.0875973, 0.505265, 0.383392, 0.0237456, 
Output 5: 0.0234313, 0.948521, 0.0276322, 0.000415488, 
Output 6: 0.995195, 0.0046046, 0.000150426, 4.97708e-05, 

Boundary wire vector sizes: 1918, 1789, 2092
minwire 0: 1487
minwire 1: 710
minwire 2: 957
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.143479, 
Output 1: 0.924375, 7.39576e-05, 0.0752386, 0.000312873, 
Output 2: 0.00348332, 0.184635, 0.804732, 0.00715022, 
Output 3: 0.0392534, 0.0503341, 0.05344, 0.856973, 
Output 4: 0.0805442, 0.614938, 0.273872, 0.0306458, 
Output 5: 0.998637, 0.00132762, 3.05201e-05, 5.14339e-06, 
Output 6: 0.995446, 0.00434111, 0.000155352, 5.75591e-05, 

%MSG-w ShowerPCADirection:   LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule  07-Nov-2024 12:16:13 MST run: 1113 subRun: 1 event: 71500
2 spacepoints in shower, not calculating direction
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule  07-Nov-2024 12:16:13 MST run: 1113 subRun: 1 event: 71500
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule  07-Nov-2024 12:16:13 MST run: 1113 subRun: 1 event: 71500
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule  07-Nov-2024 12:16:13 MST run: 1113 subRun: 1 event: 71500
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule  07-Nov-2024 12:16:13 MST run: 1113 subRun: 1 event: 71500
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 1638, 2568, 2415
minwire 0: 1208
minwire 1: 720
minwire 2: 555
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0352295, 
Output 1: 0.969848, 0.00043743, 0.0287016, 0.00101267, 
Output 2: 0.0253474, 0.527184, 0.446557, 0.000911904, 
Output 3: 0.0373089, 0.962651, 3.88067e-05, 9.47038e-07, 
Output 4: 0.998388, 0.00159725, 1.51497e-05, 8.14391e-08, 
Output 5: 0.0263035, 0.0438566, 0.838453, 0.0913871, 
Output 6: 0.999321, 0.000616664, 5.3652e-05, 8.26526e-06, 

07-Nov-2024 12:17:27 MST  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/d0/23/nu_dune10kt_1x2x6_1113_714_20230827T125739Z_gen_g4_detsim_hitreco__20240223T222341Z_reco2.root"
07-Nov-2024 12:17:27 MST  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/d0/23/nu_dune10kt_1x2x6_1113_714_20230827T125739Z_gen_g4_detsim_hitreco__20240223T222341Z_reco2.root"

TrigReport ---------- Event summary -------------
TrigReport Events total = 100 passed = 100 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        100        100          0 ccnuselection

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 11684.189921 Real = 11688.308941

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3967.3 VmHWM = 2379.76

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2024-11-23 07:53:04 UTC       justIN version: 01.01.09