justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108625.56@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108625.56@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4199
Stage ID1
User nameosbiston@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-23 00:28:34
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce506
Last heartbeat2024-11-23 07:06:00
From worker nodeHostnameb9p05p5810.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-23 04:30:38
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193346Z_gen_000353_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time2h (9301s)
CPU time2h (9081s = 97%)
Outputting started2024-11-23 07:05:40
Output files
Finished2024-11-23 07:06:00
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Input PFN = root://eospublic.cern.ch:1094//eos/experiment/neutplatform/protodune/dune/fardet-vd/16/5d/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193346Z_gen_000353_supernova_g4stage1_g4stage2_detsim_reco.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
minwire 0: 35
minwire 1: 0
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1273, 1772
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.1044, 
Output 1: 0.0699984, 0.0863835, 0.0908618, 0.752756, 
Output 2: 0.0389007, 0.217247, 0.721715, 0.0221374, 
Output 3: 0.971263, 0.0170379, 0.00265347, 0.00904603, 
Output 4: 0.649027, 0.310356, 0.0358576, 0.00475871, 
Output 5: 0.334996, 0.472795, 0.161641, 0.0305679, 
Output 6: 0.0193413, 0.0514688, 0.0686993, 0.860491, 

Begin processing the 8th record. run: 3799 subRun: 0 event: 3528 at 23-Nov-2024 07:07:33 CET
Boundary wire vector sizes: 6952, 6930, 6741
minwire 0: 50
minwire 1: 0
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2363, 2862
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0727737, 
Output 1: 0.051731, 0.0789651, 0.107381, 0.761923, 
Output 2: 0.103328, 0.261426, 0.57846, 0.0567864, 
Output 3: 0.950623, 0.0360332, 0.00599888, 0.00734517, 
Output 4: 0.84365, 0.134029, 0.0183405, 0.0039807, 
Output 5: 0.803114, 0.163908, 0.0255274, 0.00744985, 
Output 6: 0.0222883, 0.0654576, 0.0681974, 0.844057, 

Begin processing the 9th record. run: 3799 subRun: 0 event: 3529 at 23-Nov-2024 07:26:30 CET
Boundary wire vector sizes: 6537, 6492, 6450
minwire 0: 21
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1801, 2300
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0930718, 
Output 1: 0.0731893, 0.0414046, 0.0558787, 0.829527, 
Output 2: 0.118733, 0.310966, 0.536769, 0.0335327, 
Output 3: 0.983601, 0.0101745, 0.000792782, 0.0054321, 
Output 4: 0.38634, 0.565761, 0.0444054, 0.0034938, 
Output 5: 0.752887, 0.225009, 0.0177053, 0.00439956, 
Output 6: 0.0209649, 0.0524672, 0.0692829, 0.857285, 

Begin processing the 10th record. run: 3799 subRun: 0 event: 3530 at 23-Nov-2024 07:45:47 CET
Boundary wire vector sizes: 6553, 6537, 6585
minwire 0: 52
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.167656, 
Output 1: 0.111238, 0.0585498, 0.100468, 0.729744, 
Output 2: 0.111993, 0.248651, 0.594927, 0.0444289, 
Output 3: 0.982551, 0.00607812, 0.00100266, 0.010368, 
Output 4: 0.373511, 0.579842, 0.0424641, 0.00418272, 
Output 5: 0.496343, 0.418957, 0.0660742, 0.018626, 
Output 6: 0.0325146, 0.0696621, 0.0841934, 0.81363, 

23-Nov-2024 08:05:39 CET  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193346Z_gen_000353_supernova_g4stage1_g4stage2_detsim_reco_matt_2024-11-23T_043043Z.root"
23-Nov-2024 08:05:39 CET  Closed input file "root://eospublic.cern.ch:1094//eos/experiment/neutplatform/protodune/dune/fardet-vd/16/5d/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193346Z_gen_000353_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              719.549       920.77        1187.86       865.236       166.453        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000471396   0.00218464    0.00950023    0.000856904   0.00301254       10     
reco:pandora:StandardPandora                            717.232       919.131       1186.22       863.658       166.443        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000164562    0.0021237     0.0165653    0.000524011   0.00482729       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000169821   0.000477762   0.00287309    0.000179457   0.000800864      10     
reco:pandoracalo:Calorimetry                          0.00106023     0.0182903     0.0400607     0.0177293    0.00897832       10     
reco:pandorapid:Chi2ParticleID                         4.391e-05    0.000100236   0.000531876   4.92755e-05   0.000144129      10     
reco:cvnmap:CVNMapper                                  0.0295922     0.035835      0.0422282     0.0341662    0.00487335       10     
reco:cvneva:CVNEvaluator                               0.912304       1.15514       1.86801       1.10152      0.248455        10     
reco:energyrecnumu:EnergyReco                          0.0619434     0.0821136     0.107343      0.0816951     0.0118445       10     
reco:energyrecnue:EnergyReco                          0.00518917    0.00826468    0.00986576    0.00850339     0.0011537       10     
reco:energyrecnc:EnergyReco                           0.00510084    0.00781422    0.00969796    0.00831902    0.00146152       10     
[art]:TriggerResults:TriggerResultInserter             9.26e-06     1.66372e-05    4.576e-05     1.346e-05    9.94601e-06      10     
end_path:out1:RootOutput                               7.38e-06     9.7163e-06    1.9941e-05     8.88e-06     3.46923e-06      10     
end_path:out1:RootOutput(write)                        0.232404      0.325323      0.401358      0.338399      0.0625018       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21557.6 MB
  Peak resident set size usage (VmHWM): 2758.49 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2024-11-23 14:11:06 UTC       justIN version: 01.01.09