justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297901.29@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID297901.29@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4159
Stage ID1
User nameosbiston@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-20 15:13:55
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2024-11-20 15:16:00
From worker nodeHostnamedunegli-4220205-0-fnpc7542.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-20 15:14:48
Input filesfardet-hd:prodmarley_nue_cc_flat_dune10kt_1x2x6_20241023T150949Z_gen_000282_supernova_g4_detsim_reco.root
JobscriptExit code0
Real time1m (61s)
CPU time0m (57s = 93%)
Outputting started2024-11-20 15:15:51
Output files
Finished2024-11-20 15:16:00
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
Begin processing the 27th record. run: 3786 subRun: 0 event: 28127 at 20-Nov-2024 15:15:47 UTC
Begin processing the 28th record. run: 3786 subRun: 0 event: 28128 at 20-Nov-2024 15:15:47 UTC
Begin processing the 29th record. run: 3786 subRun: 0 event: 28129 at 20-Nov-2024 15:15:47 UTC
Begin processing the 30th record. run: 3786 subRun: 0 event: 28130 at 20-Nov-2024 15:15:47 UTC
Begin processing the 31st record. run: 3786 subRun: 0 event: 28131 at 20-Nov-2024 15:15:47 UTC
Begin processing the 32nd record. run: 3786 subRun: 0 event: 28132 at 20-Nov-2024 15:15:47 UTC
Begin processing the 33rd record. run: 3786 subRun: 0 event: 28133 at 20-Nov-2024 15:15:47 UTC
Begin processing the 34th record. run: 3786 subRun: 0 event: 28134 at 20-Nov-2024 15:15:47 UTC
Begin processing the 35th record. run: 3786 subRun: 0 event: 28135 at 20-Nov-2024 15:15:47 UTC
Begin processing the 36th record. run: 3786 subRun: 0 event: 28136 at 20-Nov-2024 15:15:47 UTC
Begin processing the 37th record. run: 3786 subRun: 0 event: 28137 at 20-Nov-2024 15:15:47 UTC
Begin processing the 38th record. run: 3786 subRun: 0 event: 28138 at 20-Nov-2024 15:15:47 UTC
Begin processing the 39th record. run: 3786 subRun: 0 event: 28139 at 20-Nov-2024 15:15:47 UTC
Begin processing the 40th record. run: 3786 subRun: 0 event: 28140 at 20-Nov-2024 15:15:47 UTC
Begin processing the 41st record. run: 3786 subRun: 0 event: 28141 at 20-Nov-2024 15:15:47 UTC
Begin processing the 42nd record. run: 3786 subRun: 0 event: 28142 at 20-Nov-2024 15:15:47 UTC
Begin processing the 43rd record. run: 3786 subRun: 0 event: 28143 at 20-Nov-2024 15:15:47 UTC
Begin processing the 44th record. run: 3786 subRun: 0 event: 28144 at 20-Nov-2024 15:15:47 UTC
Begin processing the 45th record. run: 3786 subRun: 0 event: 28145 at 20-Nov-2024 15:15:47 UTC
Begin processing the 46th record. run: 3786 subRun: 0 event: 28146 at 20-Nov-2024 15:15:47 UTC
Begin processing the 47th record. run: 3786 subRun: 0 event: 28147 at 20-Nov-2024 15:15:47 UTC
Begin processing the 48th record. run: 3786 subRun: 0 event: 28148 at 20-Nov-2024 15:15:47 UTC
Begin processing the 49th record. run: 3786 subRun: 0 event: 28149 at 20-Nov-2024 15:15:47 UTC
Begin processing the 50th record. run: 3786 subRun: 0 event: 28150 at 20-Nov-2024 15:15:47 UTC
Begin processing the 51st record. run: 3786 subRun: 0 event: 28151 at 20-Nov-2024 15:15:47 UTC
Begin processing the 52nd record. run: 3786 subRun: 0 event: 28152 at 20-Nov-2024 15:15:47 UTC
Begin processing the 53rd record. run: 3786 subRun: 0 event: 28153 at 20-Nov-2024 15:15:47 UTC
Begin processing the 54th record. run: 3786 subRun: 0 event: 28154 at 20-Nov-2024 15:15:47 UTC
Begin processing the 55th record. run: 3786 subRun: 0 event: 28155 at 20-Nov-2024 15:15:47 UTC
Begin processing the 56th record. run: 3786 subRun: 0 event: 28156 at 20-Nov-2024 15:15:47 UTC
Begin processing the 57th record. run: 3786 subRun: 0 event: 28157 at 20-Nov-2024 15:15:47 UTC
Begin processing the 58th record. run: 3786 subRun: 0 event: 28158 at 20-Nov-2024 15:15:47 UTC
Begin processing the 59th record. run: 3786 subRun: 0 event: 28159 at 20-Nov-2024 15:15:47 UTC
Begin processing the 60th record. run: 3786 subRun: 0 event: 28160 at 20-Nov-2024 15:15:47 UTC
Begin processing the 61st record. run: 3786 subRun: 0 event: 28161 at 20-Nov-2024 15:15:47 UTC
Begin processing the 62nd record. run: 3786 subRun: 0 event: 28162 at 20-Nov-2024 15:15:48 UTC
Begin processing the 63rd record. run: 3786 subRun: 0 event: 28163 at 20-Nov-2024 15:15:48 UTC
Begin processing the 64th record. run: 3786 subRun: 0 event: 28164 at 20-Nov-2024 15:15:48 UTC
Begin processing the 65th record. run: 3786 subRun: 0 event: 28165 at 20-Nov-2024 15:15:48 UTC
Begin processing the 66th record. run: 3786 subRun: 0 event: 28166 at 20-Nov-2024 15:15:48 UTC
Begin processing the 67th record. run: 3786 subRun: 0 event: 28167 at 20-Nov-2024 15:15:48 UTC
Begin processing the 68th record. run: 3786 subRun: 0 event: 28168 at 20-Nov-2024 15:15:48 UTC
Begin processing the 69th record. run: 3786 subRun: 0 event: 28169 at 20-Nov-2024 15:15:48 UTC
Begin processing the 70th record. run: 3786 subRun: 0 event: 28170 at 20-Nov-2024 15:15:48 UTC
Begin processing the 71st record. run: 3786 subRun: 0 event: 28171 at 20-Nov-2024 15:15:48 UTC
Begin processing the 72nd record. run: 3786 subRun: 0 event: 28172 at 20-Nov-2024 15:15:48 UTC
Begin processing the 73rd record. run: 3786 subRun: 0 event: 28173 at 20-Nov-2024 15:15:48 UTC
Begin processing the 74th record. run: 3786 subRun: 0 event: 28174 at 20-Nov-2024 15:15:48 UTC
Begin processing the 75th record. run: 3786 subRun: 0 event: 28175 at 20-Nov-2024 15:15:48 UTC
Begin processing the 76th record. run: 3786 subRun: 0 event: 28176 at 20-Nov-2024 15:15:48 UTC
Begin processing the 77th record. run: 3786 subRun: 0 event: 28177 at 20-Nov-2024 15:15:48 UTC
Begin processing the 78th record. run: 3786 subRun: 0 event: 28178 at 20-Nov-2024 15:15:48 UTC
Begin processing the 79th record. run: 3786 subRun: 0 event: 28179 at 20-Nov-2024 15:15:48 UTC
Begin processing the 80th record. run: 3786 subRun: 0 event: 28180 at 20-Nov-2024 15:15:48 UTC
Begin processing the 81st record. run: 3786 subRun: 0 event: 28181 at 20-Nov-2024 15:15:48 UTC
Begin processing the 82nd record. run: 3786 subRun: 0 event: 28182 at 20-Nov-2024 15:15:48 UTC
Begin processing the 83rd record. run: 3786 subRun: 0 event: 28183 at 20-Nov-2024 15:15:48 UTC
Begin processing the 84th record. run: 3786 subRun: 0 event: 28184 at 20-Nov-2024 15:15:48 UTC
Begin processing the 85th record. run: 3786 subRun: 0 event: 28185 at 20-Nov-2024 15:15:48 UTC
Begin processing the 86th record. run: 3786 subRun: 0 event: 28186 at 20-Nov-2024 15:15:48 UTC
Begin processing the 87th record. run: 3786 subRun: 0 event: 28187 at 20-Nov-2024 15:15:48 UTC
Begin processing the 88th record. run: 3786 subRun: 0 event: 28188 at 20-Nov-2024 15:15:48 UTC
Begin processing the 89th record. run: 3786 subRun: 0 event: 28189 at 20-Nov-2024 15:15:48 UTC
Begin processing the 90th record. run: 3786 subRun: 0 event: 28190 at 20-Nov-2024 15:15:48 UTC
Begin processing the 91st record. run: 3786 subRun: 0 event: 28191 at 20-Nov-2024 15:15:48 UTC
Begin processing the 92nd record. run: 3786 subRun: 0 event: 28192 at 20-Nov-2024 15:15:48 UTC
Begin processing the 93rd record. run: 3786 subRun: 0 event: 28193 at 20-Nov-2024 15:15:48 UTC
Begin processing the 94th record. run: 3786 subRun: 0 event: 28194 at 20-Nov-2024 15:15:48 UTC
Begin processing the 95th record. run: 3786 subRun: 0 event: 28195 at 20-Nov-2024 15:15:48 UTC
Begin processing the 96th record. run: 3786 subRun: 0 event: 28196 at 20-Nov-2024 15:15:48 UTC
Begin processing the 97th record. run: 3786 subRun: 0 event: 28197 at 20-Nov-2024 15:15:48 UTC
Begin processing the 98th record. run: 3786 subRun: 0 event: 28198 at 20-Nov-2024 15:15:48 UTC
Begin processing the 99th record. run: 3786 subRun: 0 event: 28199 at 20-Nov-2024 15:15:48 UTC
Begin processing the 100th record. run: 3786 subRun: 0 event: 28200 at 20-Nov-2024 15:15:48 UTC
20-Nov-2024 15:15:50 UTC  Closed output file "prodmarley_nue_cc_flat_dune10kt_1x2x6_20241023T150949Z_gen_000282_supernova_g4_detsim_reco_matt_2024-11-20T_151452Z.root"
20-Nov-2024 15:15:50 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/e5/2c/prodmarley_nue_cc_flat_dune10kt_1x2x6_20241023T150949Z_gen_000282_supernova_g4_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.0120779     0.0139712     0.0384256     0.0130384    0.00303141       100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000500431   0.000620436   0.00114854    0.000566113   0.000132009      100    
reco:pandora:StandardPandora                           0.0087894     0.0103384     0.0242079    0.00959697    0.00197809       100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000128573   0.000149889   0.00121654    0.000132867   0.000108643      100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000180874   0.000208886   0.00143228    0.000187097   0.000125725      100    
reco:pandoracalo:Calorimetry                          0.00010624    0.000123204   0.000898577   0.000109895   7.94065e-05      100    
reco:pandorapid:Chi2ParticleID                         4.305e-05    5.08652e-05   0.000420725   4.50465e-05   3.76668e-05      100    
[art]:TriggerResults:TriggerResultInserter            1.2797e-05    1.48007e-05   5.0119e-05    1.3517e-05    4.46794e-06      100    
end_path:out1:RootOutput                               3.176e-06    3.65413e-06   1.3913e-05    3.4325e-06    1.11573e-06      100    
end_path:out1:RootOutput(write)                       0.00194473    0.00219144    0.00848768    0.00202491    0.000709897      100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 6233.82 MB
  Peak resident set size usage (VmHWM): 999.723 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2024-11-24 03:18:21 UTC       justIN version: 01.01.09