justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 92642.40@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID92642.40@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3967
Stage ID1
User nameimawby@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit43200 (12 hours)
Submitted time2024-11-07 12:16:57
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2024-11-07 19:50:58
From worker nodeHostnamedunegli-3991975-0-fnpc7024.fnal.gov
cpuinfoAMD Opteron(tm) Processor 6376
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-07 14:24:46
Input filesfardet-hd:nutau_dune10kt_1x2x6_1433_101_20230828T083319Z_gen_g4_detsim_hitreco__20240219T182957Z_reco2.root
JobscriptExit code0
Real time5h (19554s)
CPU time5h (20028s = 102%)
Outputting started2024-11-07 19:50:41
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/ccnuselection_nutau_2/03967/1/nutau_dune10kt_1x2x6_1433_101_20230828T083319Z_gen_g4_detsim_hitreco__20240219T182957Z_reco2_ccnutree.root
Finished2024-11-07 19:50:58
Saved logsjustin-logs:92642.40-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Justin processors: 1
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/

MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v09_91_02
MRB_QUALS=e26:prof
MRB_TOP=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/c3838ee97bd4cb1ae2d7f7c963e14e65c7635952
MRB_SOURCE=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/c3838ee97bd4cb1ae2d7f7c963e14e65c7635952/srcs
MRB_BUILDDIR=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/c3838ee97bd4cb1ae2d7f7c963e14e65c7635952/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/c3838ee97bd4cb1ae2d7f7c963e14e65c7635952/localProducts_larsoft_v09_91_02_e26_prof

PRODUCTS=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/c3838ee97bd4cb1ae2d7f7c963e14e65c7635952/localProducts_larsoft_v09_91_02_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/c3838ee97bd4cb1ae2d7f7c963e14e65c7635952/localProducts_larsoft_v09_91_02_e26_prof

local product directory is /cvmfs/fifeuser4.opensciencegrid.org/sw/dune/c3838ee97bd4cb1ae2d7f7c963e14e65c7635952/localProducts_larsoft_v09_91_02_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/7f/d3/nutau_dune10kt_1x2x6_1433_101_20230828T083319Z_gen_g4_detsim_hitreco__20240219T182957Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
<ERROR>                          : 0-th variable of the event is NaN --> return MVA value -999, 
<ERROR>                          :  that's all I can do, please fix or remove this event.
<ERROR>                          : 0-th variable of the event is NaN --> return MVA value -999, 
<ERROR>                          :  that's all I can do, please fix or remove this event.
<ERROR>                          : 0-th variable of the event is NaN --> return MVA value -999, 
<ERROR>                          :  that's all I can do, please fix or remove this event.
<ERROR>                          : 0-th variable of the event is NaN --> return MVA value -999, 
<ERROR>                          :  that's all I can do, please fix or remove this event.
<ERROR>                          : 0-th variable of the event is NaN --> return MVA value -999, 
<ERROR>                          :  that's all I can do, please fix or remove this event.
<ERROR>                          : 0-th variable of the event is NaN --> return MVA value -999, 
<ERROR>                          :  that's all I can do, please fix or remove this event.
<ERROR>                          : 0-th variable of the event is NaN --> return MVA value -999, 
<ERROR>                          :  that's all I can do, please fix or remove this event.
<ERROR>                          : 0-th variable of the event is NaN --> return MVA value -999, 
<ERROR>                          :  that's all I can do, please fix or remove this event.
<ERROR>                          : 0-th variable of the event is NaN --> return MVA value -999, 
<ERROR>                          :  that's all I can do, please fix or remove this event.
Boundary wire vector sizes: 1190, 1232, 1175
minwire 0: 521
minwire 1: 1799
minwire 2: 485
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2379, 2878
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0638861, 
Output 1: 0.000668864, 0.847248, 0.0233476, 0.128735, 
Output 2: 0.127642, 0.12296, 0.747082, 0.00231634, 
Output 3: 0.744481, 0.252368, 0.00257117, 0.000580451, 
Output 4: 0.455497, 0.541602, 0.00279213, 0.000108925, 
Output 5: 0.873178, 0.125965, 0.000773522, 8.34673e-05, 
Output 6: 0.999622, 0.000323804, 4.0956e-05, 1.37005e-05, 

Boundary wire vector sizes: 742, 921, 827
minwire 0: 1763
minwire 1: 187
minwire 2: 1940
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.117804, 
Output 1: 0.000515896, 7.92604e-05, 0.064336, 0.935069, 
Output 2: 0.870495, 0.0129857, 0.00985209, 0.106667, 
Output 3: 0.00711119, 0.990171, 0.00253733, 0.000180364, 
Output 4: 0.0334225, 0.965638, 0.000925152, 1.44191e-05, 
Output 5: 0.999719, 0.000272295, 6.69871e-06, 2.18542e-06, 
Output 6: 0.99939, 0.000554486, 4.48326e-05, 1.0583e-05, 

Boundary wire vector sizes: 109, 147, 120
minwire 0: 399
minwire 1: 1665
minwire 2: 274
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.521303, 
Output 1: 0.00255258, 0.00683571, 0.00731724, 0.983294, 
Output 2: 0.158722, 0.551636, 0.0674331, 0.222209, 
Output 3: 0.876721, 0.102287, 0.0181719, 0.00282021, 
Output 4: 0.125877, 0.857115, 0.0165759, 0.000432093, 
Output 5: 0.931128, 0.0686352, 0.000201904, 3.50373e-05, 
Output 6: 0.993907, 0.00522594, 0.000666892, 0.000200317, 

Boundary wire vector sizes: 968, 793, 803
minwire 0: 712
minwire 1: 1784
minwire 2: 395
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.122936, 
Output 1: 0.222249, 0.0964368, 0.0353959, 0.645918, 
Output 2: 0.0169333, 0.191634, 0.778321, 0.0131117, 
Output 3: 0.0549388, 0.0936275, 0.10516, 0.746274, 
Output 4: 0.264675, 0.403899, 0.271915, 0.0595115, 
Output 5: 0.166829, 0.786586, 0.0459363, 0.000648621, 
Output 6: 0.994745, 0.00459914, 0.000418935, 0.000237372, 

07-Nov-2024 19:50:37 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/7f/d3/nutau_dune10kt_1x2x6_1433_101_20230828T083319Z_gen_g4_detsim_hitreco__20240219T182957Z_reco2.root"
07-Nov-2024 19:50:37 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/7f/d3/nutau_dune10kt_1x2x6_1433_101_20230828T083319Z_gen_g4_detsim_hitreco__20240219T182957Z_reco2.root"

TrigReport ---------- Event summary -------------
TrigReport Events total = 100 passed = 100 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        100        100          0 ccnuselection

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 19968.236714 Real = 19478.282933

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 4177.74 VmHWM = 2673.1

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2024-11-23 07:45:08 UTC       justIN version: 01.01.09