justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 295473.2@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID295473.2@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4134
Stage ID1
User nameosbiston@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-19 02:06:03
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce01
Last heartbeat2024-11-19 16:10:10
From worker nodeHostnameccwcondor0540
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit106200 (29 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-19 10:50:01
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193309Z_gen_000232_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time5h (19181s)
CPU time5h (18344s = 95%)
Outputting started2024-11-19 16:09:42
Output files
Finished2024-11-19 16:10:10
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Input PFN = root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-vd/8a/ed/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193309Z_gen_000232_supernova_g4stage1_g4stage2_detsim_reco.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2182, 2681
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.092968, 
Output 1: 0.0682817, 0.0813278, 0.0912649, 0.759126, 
Output 2: 0.0410042, 0.185305, 0.761366, 0.012325, 
Output 3: 0.969764, 0.0234593, 0.00180477, 0.00497195, 
Output 4: 0.511265, 0.4087, 0.0691098, 0.0109258, 
Output 5: 0.366683, 0.512192, 0.104209, 0.0169159, 
Output 6: 0.0256981, 0.0657072, 0.080616, 0.827979, 

Begin processing the 8th record. run: 3799 subRun: 0 event: 2318 at 19-Nov-2024 15:32:59 CET
Boundary wire vector sizes: 6605, 6640, 6634
minwire 0: 33
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2291, 2790
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.140797, 
Output 1: 0.081248, 0.143107, 0.234193, 0.541452, 
Output 2: 0.0282462, 0.0946884, 0.864794, 0.0122717, 
Output 3: 0.976013, 0.0199746, 0.00167823, 0.00233368, 
Output 4: 0.460059, 0.448753, 0.0780135, 0.0131738, 
Output 5: 0.253767, 0.40288, 0.260468, 0.0828856, 
Output 6: 0.0805292, 0.158364, 0.114956, 0.646151, 

Begin processing the 9th record. run: 3799 subRun: 0 event: 2319 at 19-Nov-2024 16:04:17 CET
Boundary wire vector sizes: 6867, 6801, 6652
minwire 0: 29
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1658, 2157
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.100168, 
Output 1: 0.0599805, 0.029225, 0.0847903, 0.826004, 
Output 2: 0.127242, 0.291953, 0.541334, 0.039471, 
Output 3: 0.971442, 0.0217463, 0.0019479, 0.0048633, 
Output 4: 0.303827, 0.634377, 0.0577859, 0.00401029, 
Output 5: 0.741749, 0.237522, 0.0173861, 0.00334295, 
Output 6: 0.0169387, 0.0558284, 0.0709254, 0.856307, 

Begin processing the 10th record. run: 3799 subRun: 0 event: 2320 at 19-Nov-2024 16:36:27 CET
Boundary wire vector sizes: 6853, 6705, 6823
minwire 0: 22
minwire 1: 0
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1708, 2207
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0873886, 
Output 1: 0.0750556, 0.0955749, 0.0944566, 0.734913, 
Output 2: 0.0486089, 0.238317, 0.672182, 0.0408928, 
Output 3: 0.963429, 0.0208412, 0.004642, 0.0110878, 
Output 4: 0.897854, 0.0882765, 0.0112529, 0.00261654, 
Output 5: 0.573133, 0.27911, 0.114186, 0.0335703, 
Output 6: 0.0149617, 0.0390949, 0.0524503, 0.893493, 

19-Nov-2024 17:09:40 CET  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193309Z_gen_000232_supernova_g4stage1_g4stage2_detsim_reco_matt_2024-11-19T_105005Z.root"
19-Nov-2024 17:09:40 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-vd/8a/ed/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193309Z_gen_000232_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1793.38       1906.78       1987.36       1925.49       54.0029        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000971895   0.00485375     0.0361796    0.00143752     0.0104468       10     
reco:pandora:StandardPandora                            1791.47       1904.52       1985.35       1922.28       53.9453        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00028103    0.00449707     0.0399951    0.000386625    0.0118377       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000247828   0.000767859   0.00469103    0.000342702   0.00130864       10     
reco:pandoracalo:Calorimetry                          0.00224381     0.0279942     0.0361143     0.0292108    0.00908105       10     
reco:pandorapid:Chi2ParticleID                        7.5723e-05    0.000180319   0.00102478    8.66735e-05   0.000281642      10     
reco:cvnmap:CVNMapper                                  0.0738094     0.103983      0.147343      0.100937      0.0239532       10     
reco:cvneva:CVNEvaluator                                1.24045       1.52687       3.44848       1.29083      0.647054        10     
reco:energyrecnumu:EnergyReco                          0.0621641     0.0888273     0.132437      0.0844928     0.0201936       10     
reco:energyrecnue:EnergyReco                           0.0105683     0.0111869     0.0131222     0.0108434    0.000774289      10     
reco:energyrecnc:EnergyReco                            0.0079427     0.0118831     0.0200285     0.0113754    0.00295417       10     
[art]:TriggerResults:TriggerResultInserter            2.0017e-05    3.59965e-05   0.000141404    2.396e-05    3.53565e-05      10     
end_path:out1:RootOutput                               8.867e-06    1.36298e-05   4.2169e-05    1.02245e-05   9.60042e-06      10     
end_path:out1:RootOutput(write)                        0.400076      0.469082      0.590642      0.453865      0.0567036       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12978 MB
  Peak resident set size usage (VmHWM): 2700.21 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2024-11-24 05:06:21 UTC       justIN version: 01.01.09