justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108630.2@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108630.2@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4199
Stage ID1
User nameosbiston@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-23 00:34:49
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce506
Last heartbeat2024-11-23 06:47:44
From worker nodeHostnameb9p08p3365.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-23 04:31:06
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T225914Z_gen_003751_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time2h (8179s)
CPU time2h (7744s = 94%)
Outputting started2024-11-23 06:47:26
Output files
Finished2024-11-23 06:47:44
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Input PFN = root://eospublic.cern.ch:1094//eos/experiment/neutplatform/protodune/dune/fardet-vd/85/37/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T225914Z_gen_003751_supernova_g4stage1_g4stage2_detsim_reco.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
Boundary wire vector sizes: 6900, 6782, 6721
minwire 0: 53
minwire 1: 0
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.134032, 
Output 1: 0.0557928, 0.0764394, 0.141058, 0.72671, 
Output 2: 0.108976, 0.25172, 0.601275, 0.0380299, 
Output 3: 0.978844, 0.015421, 0.00139989, 0.00433551, 
Output 4: 0.284141, 0.660503, 0.0519757, 0.00338073, 
Output 5: 0.677138, 0.283318, 0.0318469, 0.00769661, 
Output 6: 0.0188361, 0.0495555, 0.0636792, 0.867929, 

Begin processing the 8th record. run: 3799 subRun: 0 event: 37508 at 23-Nov-2024 07:03:51 CET
Boundary wire vector sizes: 6871, 6767, 6678
minwire 0: 55
minwire 1: 0
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2182, 2681
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.125517, 
Output 1: 0.0601169, 0.0961764, 0.0971559, 0.746551, 
Output 2: 0.0491971, 0.300835, 0.623164, 0.0268043, 
Output 3: 0.971131, 0.0159821, 0.00267885, 0.010208, 
Output 4: 0.334693, 0.576364, 0.0826942, 0.00624841, 
Output 5: 0.595956, 0.337432, 0.0565075, 0.0101038, 
Output 6: 0.0171282, 0.0400446, 0.0613443, 0.881483, 

Begin processing the 9th record. run: 3799 subRun: 0 event: 37509 at 23-Nov-2024 07:16:53 CET
Boundary wire vector sizes: 6792, 6788, 6759
minwire 0: 72
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1765, 2264
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0883184, 
Output 1: 0.0600127, 0.0975346, 0.0856178, 0.756835, 
Output 2: 0.0581779, 0.270828, 0.64749, 0.0235043, 
Output 3: 0.974376, 0.019426, 0.00153467, 0.0046635, 
Output 4: 0.501776, 0.455671, 0.0394205, 0.00313192, 
Output 5: 0.607621, 0.325924, 0.0547502, 0.011704, 
Output 6: 0.0155275, 0.0460639, 0.0634622, 0.874946, 

Begin processing the 10th record. run: 3799 subRun: 0 event: 37510 at 23-Nov-2024 07:31:02 CET
Boundary wire vector sizes: 6582, 6627, 6583
minwire 0: 22
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.117902, 
Output 1: 0.0799725, 0.0829292, 0.146984, 0.690114, 
Output 2: 0.0374198, 0.128908, 0.817564, 0.0161079, 
Output 3: 0.974456, 0.0186368, 0.00185362, 0.00505313, 
Output 4: 0.386847, 0.547494, 0.058752, 0.00690674, 
Output 5: 0.285054, 0.439191, 0.21237, 0.0633858, 
Output 6: 0.0413166, 0.107235, 0.10331, 0.748138, 

23-Nov-2024 07:47:25 CET  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T225914Z_gen_003751_supernova_g4stage1_g4stage2_detsim_reco_matt_2024-11-23T_043110Z.root"
23-Nov-2024 07:47:25 CET  Closed input file "root://eospublic.cern.ch:1094//eos/experiment/neutplatform/protodune/dune/fardet-vd/85/37/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T225914Z_gen_003751_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              688.846       782.308       978.575       755.663       87.5343        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000536415   0.00219703     0.0126301    0.000749676   0.00360077       10     
reco:pandora:StandardPandora                            687.578       780.805       977.202       754.09        87.548         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000175492    0.0022139     0.0187861    0.000247942   0.00553147       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000160641   0.000555169   0.00399218    0.000174121    0.0011457       10     
reco:pandoracalo:Calorimetry                          0.00147639     0.0130391     0.0185857     0.0139349    0.00498341       10     
reco:pandorapid:Chi2ParticleID                         4.55e-05     0.000116585   0.000717466   4.84655e-05   0.000200339      10     
reco:cvnmap:CVNMapper                                  0.0337354     0.0398192     0.0491671     0.0398912    0.00435405       10     
reco:cvneva:CVNEvaluator                               0.757412       1.04906       1.93821      0.992384      0.321638        10     
reco:energyrecnumu:EnergyReco                          0.0588007     0.0846917     0.118318      0.0845883     0.0142754       10     
reco:energyrecnue:EnergyReco                          0.00564807    0.00782969    0.00975567     0.0080182    0.00177073       10     
reco:energyrecnc:EnergyReco                           0.00556671    0.00764522    0.00992536    0.00766881    0.00183377       10     
[art]:TriggerResults:TriggerResultInserter             1.035e-05    1.76722e-05   4.3781e-05     1.64e-05     9.15654e-06      10     
end_path:out1:RootOutput                               5.91e-06     9.3871e-06     1.978e-05     8.365e-06    3.73914e-06      10     
end_path:out1:RootOutput(write)                        0.217833      0.294991      0.399396      0.255881      0.0752284       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21566.1 MB
  Peak resident set size usage (VmHWM): 2808.9 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2024-11-23 13:49:09 UTC       justIN version: 01.01.09