justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 75319.0@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID75319.0@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3303
Stage ID1
User nameimawby@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit43200 (12 hours)
Submitted time2024-09-20 14:25:40
SiteUS_Colorado
EntryCMSHTPC_T3_US_Colorado_heposg01-colorado
Last heartbeat2024-09-20 15:30:56
From worker nodeHostnamelnxfarm136.colorado.edu
cpuinfoIntel(R) Core(TM) i7-4771 CPU @ 3.50GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-20 14:26:20
Input filesfardet-hd:nu_dune10kt_1x2x6_1111_454_20230827T033439Z_gen_g4_detsim_hitreco__20240223T011732Z_reco2.root
JobscriptExit code0
Real time1h (3861s)
CPU time1h (3903s = 101%)
Outputting started2024-09-20 15:30:43
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/ccnuselection_nu_0/03303/1/nu_dune10kt_1x2x6_1111_454_20230827T033439Z_gen_g4_detsim_hitreco__20240223T011732Z_reco2_ccnutree.root
Finished2024-09-20 15:30:56
Saved logsjustin-logs:75319.0-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Justin processors: 1
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/

MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v09_91_02
MRB_QUALS=e26:prof
MRB_TOP=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/9c849f4dc61843b819f3fe35a78fc660d69a0e71
MRB_SOURCE=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/9c849f4dc61843b819f3fe35a78fc660d69a0e71/srcs
MRB_BUILDDIR=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/9c849f4dc61843b819f3fe35a78fc660d69a0e71/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/9c849f4dc61843b819f3fe35a78fc660d69a0e71/localProducts_larsoft_v09_91_02_e26_prof

PRODUCTS=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/9c849f4dc61843b819f3fe35a78fc660d69a0e71/localProducts_larsoft_v09_91_02_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/9c849f4dc61843b819f3fe35a78fc660d69a0e71/localProducts_larsoft_v09_91_02_e26_prof

local product directory is /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/9c849f4dc61843b819f3fe35a78fc660d69a0e71/localProducts_larsoft_v09_91_02_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/d7/62/nu_dune10kt_1x2x6_1111_454_20230827T033439Z_gen_g4_detsim_hitreco__20240223T011732Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Output 3: 0.0282768, 0.441087, 0.516318, 0.0143182, 
Output 4: 0.0319873, 0.257839, 0.703904, 0.00626948, 
Output 5: 0.999834, 0.000147203, 1.69088e-05, 1.99299e-06, 
Output 6: 0.998907, 0.000995668, 7.2945e-05, 2.44619e-05, 

Boundary wire vector sizes: 1373, 1430, 1568
minwire 0: 492
minwire 1: 516
minwire 2: 217
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.115289, 
Output 1: 0.989594, 1.72291e-05, 0.00876131, 0.00162766, 
Output 2: 0.0022162, 0.0589831, 0.938092, 0.000708941, 
Output 3: 0.00507756, 0.0491915, 0.313966, 0.631765, 
Output 4: 0.903649, 0.0945268, 0.00179257, 3.12025e-05, 
Output 5: 0.999908, 8.60714e-05, 4.92723e-06, 1.10073e-06, 
Output 6: 0.999468, 0.000518033, 1.12366e-05, 2.92878e-06, 

ElectronInitialRegionRefinementAlgorithm: unable to find shower pfo list ShowerParticles3D
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule  20-Sep-2024 09:30:21 MDT run: 1111 subRun: 1 event: 45498
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule  20-Sep-2024 09:30:21 MDT run: 1111 subRun: 1 event: 45498
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 936, 1165, 1193
minwire 0: 1353
minwire 1: 345
minwire 2: 923
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.523253, 
Output 1: 0.977602, 9.51278e-05, 0.0212284, 0.00107469, 
Output 2: 0.00270989, 0.655265, 0.337725, 0.00429971, 
Output 3: 0.0144416, 0.487083, 0.49559, 0.00288559, 
Output 4: 0.00716479, 0.699483, 0.291604, 0.00174758, 
Output 5: 0.999979, 1.91725e-05, 1.3216e-06, 2.34442e-07, 
Output 6: 0.997451, 0.00238893, 0.000130559, 2.92292e-05, 

Boundary wire vector sizes: 569, 573, 520
minwire 0: 976
minwire 1: 1014
minwire 2: 644
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2283, 2782
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.28139, 
Output 1: 0.00565619, 0.0317678, 0.0486043, 0.913972, 
Output 2: 0.279757, 0.21669, 0.317204, 0.186348, 
Output 3: 0.183631, 0.601847, 0.196723, 0.0177993, 
Output 4: 0.242063, 0.434248, 0.282324, 0.0413656, 
Output 5: 0.194208, 0.743967, 0.0597271, 0.00209816, 
Output 6: 0.996843, 0.00250849, 0.000416253, 0.000232721, 

%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule  20-Sep-2024 09:30:41 MDT run: 1111 subRun: 1 event: 45500
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule  20-Sep-2024 09:30:41 MDT run: 1111 subRun: 1 event: 45500
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 133, 128, 102
minwire 0: 1489
minwire 1: 686
minwire 2: 1367
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.19985, 
Output 1: 0.00424146, 6.83007e-05, 0.00267892, 0.993011, 
Output 2: 0.111937, 0.534187, 0.203068, 0.150808, 
Output 3: 0.0954321, 0.192649, 0.164657, 0.547262, 
Output 4: 0.378986, 0.518657, 0.0984896, 0.00386775, 
Output 5: 0.999808, 0.00015489, 3.03512e-05, 7.16514e-06, 
Output 6: 0.997239, 0.00250036, 0.00019086, 7.00182e-05, 

20-Sep-2024 09:30:42 MDT  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/d7/62/nu_dune10kt_1x2x6_1111_454_20230827T033439Z_gen_g4_detsim_hitreco__20240223T011732Z_reco2.root"
20-Sep-2024 09:30:42 MDT  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/d7/62/nu_dune10kt_1x2x6_1111_454_20230827T033439Z_gen_g4_detsim_hitreco__20240223T011732Z_reco2.root"

TrigReport ---------- Event summary -------------
TrigReport Events total = 100 passed = 100 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        100        100          0 ccnuselection

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 3873.458222 Real = 3827.864389

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3859.17 VmHWM = 2368.66

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2024-11-17 07:38:40 UTC       justIN version: 01.01.09