justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 295249.6@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID295249.6@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4135
Stage ID1
User nameosbiston@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-19 00:14:20
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce01
Last heartbeat2024-11-19 03:20:44
From worker nodeHostnameccwcondor0362
cpuinfoAMD EPYC 9334 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit106200 (29 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-19 00:15:14
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193212Z_gen_000075_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time3h (11111s)
CPU time2h (10753s = 96%)
Outputting started2024-11-19 03:20:26
Output files
Finished2024-11-19 03:20:44
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Input PFN = root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-vd/62/28/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193212Z_gen_000075_supernova_g4stage1_g4stage2_detsim_reco.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
minwire 0: 27
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.106034, 
Output 1: 0.072372, 0.0918577, 0.169863, 0.665908, 
Output 2: 0.0466933, 0.143737, 0.790018, 0.0195517, 
Output 3: 0.950782, 0.0391037, 0.00395012, 0.00616395, 
Output 4: 0.304357, 0.610462, 0.077021, 0.00815984, 
Output 5: 0.387716, 0.401809, 0.161207, 0.0492673, 
Output 6: 0.0658735, 0.140876, 0.117173, 0.676077, 

Begin processing the 8th record. run: 3799 subRun: 0 event: 748 at 19-Nov-2024 03:27:42 CET
Boundary wire vector sizes: 6595, 6567, 6652
minwire 0: 16
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 909, 1408
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0885159, 
Output 1: 0.105083, 0.0844903, 0.103311, 0.707117, 
Output 2: 0.0411031, 0.169267, 0.778643, 0.0109875, 
Output 3: 0.972081, 0.0246468, 0.0010821, 0.00219006, 
Output 4: 0.369472, 0.547729, 0.0745863, 0.00821326, 
Output 5: 0.454342, 0.424322, 0.0982292, 0.0231064, 
Output 6: 0.0498658, 0.139934, 0.123788, 0.686412, 

Begin processing the 9th record. run: 3799 subRun: 0 event: 749 at 19-Nov-2024 03:45:36 CET
Boundary wire vector sizes: 6682, 6586, 6599
minwire 0: 41
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 530, 1029
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0863312, 
Output 1: 0.0293788, 0.132643, 0.109789, 0.728189, 
Output 2: 0.051518, 0.25858, 0.66635, 0.0235515, 
Output 3: 0.945673, 0.0444257, 0.00402593, 0.00587584, 
Output 4: 0.265477, 0.637916, 0.0905981, 0.00600951, 
Output 5: 0.712575, 0.232546, 0.0440377, 0.0108413, 
Output 6: 0.0184026, 0.0566745, 0.0748404, 0.850083, 

Begin processing the 10th record. run: 3799 subRun: 0 event: 750 at 19-Nov-2024 04:03:58 CET
Boundary wire vector sizes: 6611, 6573, 6676
minwire 0: 25
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1639, 2138
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.157665, 
Output 1: 0.08311, 0.144408, 0.288506, 0.483976, 
Output 2: 0.0300101, 0.119951, 0.828744, 0.0212943, 
Output 3: 0.964591, 0.0249919, 0.0046631, 0.00575391, 
Output 4: 0.636712, 0.321427, 0.0364077, 0.0054532, 
Output 5: 0.184317, 0.446967, 0.301012, 0.0677037, 
Output 6: 0.0367057, 0.0868228, 0.0818997, 0.794572, 

19-Nov-2024 04:20:25 CET  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193212Z_gen_000075_supernova_g4stage1_g4stage2_detsim_reco_matt_2024-11-19T_001522Z.root"
19-Nov-2024 04:20:25 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-vd/62/28/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193212Z_gen_000075_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              984.027       1101.01       1145.88       1105.69       44.7207        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00064275    0.00184587    0.00559972    0.000915827   0.00174469       10     
reco:pandora:StandardPandora                            982.814       1099.43       1144.38       1104.39       44.4782        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000182365    0.0046386     0.0405191    0.000260073    0.0119827       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000165851   0.000505352   0.00304153    0.000234034   0.000845887      10     
reco:pandoracalo:Calorimetry                          0.00143002      0.02186      0.0293544     0.0246752    0.00835679       10     
reco:pandorapid:Chi2ParticleID                        4.8203e-05    0.000123774   0.000664352   6.59145e-05   0.000180429      10     
reco:cvnmap:CVNMapper                                  0.0497222     0.0661743     0.127292      0.0616158     0.0210033       10     
reco:cvneva:CVNEvaluator                               0.722135      0.992649       2.76641      0.784777      0.593901        10     
reco:energyrecnumu:EnergyReco                          0.053794      0.0726924     0.113276      0.0588093     0.0206572       10     
reco:energyrecnue:EnergyReco                          0.00794437    0.00822333    0.00899806    0.00820314    0.000282896      10     
reco:energyrecnc:EnergyReco                           0.00784182     0.0110871     0.0241501    0.00830141     0.0058279       10     
[art]:TriggerResults:TriggerResultInserter            1.2359e-05    2.57819e-05   0.000122345   1.49275e-05   3.22346e-05      10     
end_path:out1:RootOutput                               6.871e-06    1.14583e-05   3.4562e-05     8.032e-06    8.23901e-06      10     
end_path:out1:RootOutput(write)                        0.356029      0.396497       0.50576       0.38172      0.0427743       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21685.7 MB
  Peak resident set size usage (VmHWM): 2889.5 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2024-11-24 05:06:09 UTC       justIN version: 01.01.09