justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 105104.102@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID105104.102@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4159
Stage ID1
User nameosbiston@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-20 15:07:39
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2024-11-20 15:09:52
From worker nodeHostnamedunegli-3998863-0-fnpc19111.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-20 15:09:03
Input filesfardet-hd:prodmarley_nue_cc_flat_dune10kt_1x2x6_20241023T133355Z_gen_000496_supernova_g4_detsim_reco.root
JobscriptExit code0
Real time0m (38s)
CPU time0m (34s = 89%)
Outputting started2024-11-20 15:09:42
Output files
Finished2024-11-20 15:09:52
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
Begin processing the 27th record. run: 3786 subRun: 0 event: 49527 at 20-Nov-2024 15:09:39 UTC
Begin processing the 28th record. run: 3786 subRun: 0 event: 49528 at 20-Nov-2024 15:09:39 UTC
Begin processing the 29th record. run: 3786 subRun: 0 event: 49529 at 20-Nov-2024 15:09:39 UTC
Begin processing the 30th record. run: 3786 subRun: 0 event: 49530 at 20-Nov-2024 15:09:39 UTC
Begin processing the 31st record. run: 3786 subRun: 0 event: 49531 at 20-Nov-2024 15:09:39 UTC
Begin processing the 32nd record. run: 3786 subRun: 0 event: 49532 at 20-Nov-2024 15:09:39 UTC
Begin processing the 33rd record. run: 3786 subRun: 0 event: 49533 at 20-Nov-2024 15:09:39 UTC
Begin processing the 34th record. run: 3786 subRun: 0 event: 49534 at 20-Nov-2024 15:09:39 UTC
Begin processing the 35th record. run: 3786 subRun: 0 event: 49535 at 20-Nov-2024 15:09:39 UTC
Begin processing the 36th record. run: 3786 subRun: 0 event: 49536 at 20-Nov-2024 15:09:39 UTC
Begin processing the 37th record. run: 3786 subRun: 0 event: 49537 at 20-Nov-2024 15:09:39 UTC
Begin processing the 38th record. run: 3786 subRun: 0 event: 49538 at 20-Nov-2024 15:09:39 UTC
Begin processing the 39th record. run: 3786 subRun: 0 event: 49539 at 20-Nov-2024 15:09:39 UTC
Begin processing the 40th record. run: 3786 subRun: 0 event: 49540 at 20-Nov-2024 15:09:39 UTC
Begin processing the 41st record. run: 3786 subRun: 0 event: 49541 at 20-Nov-2024 15:09:39 UTC
Begin processing the 42nd record. run: 3786 subRun: 0 event: 49542 at 20-Nov-2024 15:09:39 UTC
Begin processing the 43rd record. run: 3786 subRun: 0 event: 49543 at 20-Nov-2024 15:09:39 UTC
Begin processing the 44th record. run: 3786 subRun: 0 event: 49544 at 20-Nov-2024 15:09:39 UTC
Begin processing the 45th record. run: 3786 subRun: 0 event: 49545 at 20-Nov-2024 15:09:39 UTC
Begin processing the 46th record. run: 3786 subRun: 0 event: 49546 at 20-Nov-2024 15:09:39 UTC
Begin processing the 47th record. run: 3786 subRun: 0 event: 49547 at 20-Nov-2024 15:09:39 UTC
Begin processing the 48th record. run: 3786 subRun: 0 event: 49548 at 20-Nov-2024 15:09:39 UTC
Begin processing the 49th record. run: 3786 subRun: 0 event: 49549 at 20-Nov-2024 15:09:39 UTC
Begin processing the 50th record. run: 3786 subRun: 0 event: 49550 at 20-Nov-2024 15:09:39 UTC
Begin processing the 51st record. run: 3786 subRun: 0 event: 49551 at 20-Nov-2024 15:09:39 UTC
Begin processing the 52nd record. run: 3786 subRun: 0 event: 49552 at 20-Nov-2024 15:09:39 UTC
Begin processing the 53rd record. run: 3786 subRun: 0 event: 49553 at 20-Nov-2024 15:09:39 UTC
Begin processing the 54th record. run: 3786 subRun: 0 event: 49554 at 20-Nov-2024 15:09:39 UTC
Begin processing the 55th record. run: 3786 subRun: 0 event: 49555 at 20-Nov-2024 15:09:39 UTC
Begin processing the 56th record. run: 3786 subRun: 0 event: 49556 at 20-Nov-2024 15:09:39 UTC
Begin processing the 57th record. run: 3786 subRun: 0 event: 49557 at 20-Nov-2024 15:09:39 UTC
Begin processing the 58th record. run: 3786 subRun: 0 event: 49558 at 20-Nov-2024 15:09:40 UTC
Begin processing the 59th record. run: 3786 subRun: 0 event: 49559 at 20-Nov-2024 15:09:40 UTC
Begin processing the 60th record. run: 3786 subRun: 0 event: 49560 at 20-Nov-2024 15:09:40 UTC
Begin processing the 61st record. run: 3786 subRun: 0 event: 49561 at 20-Nov-2024 15:09:40 UTC
Begin processing the 62nd record. run: 3786 subRun: 0 event: 49562 at 20-Nov-2024 15:09:40 UTC
Begin processing the 63rd record. run: 3786 subRun: 0 event: 49563 at 20-Nov-2024 15:09:40 UTC
Begin processing the 64th record. run: 3786 subRun: 0 event: 49564 at 20-Nov-2024 15:09:40 UTC
Begin processing the 65th record. run: 3786 subRun: 0 event: 49565 at 20-Nov-2024 15:09:40 UTC
Begin processing the 66th record. run: 3786 subRun: 0 event: 49566 at 20-Nov-2024 15:09:40 UTC
Begin processing the 67th record. run: 3786 subRun: 0 event: 49567 at 20-Nov-2024 15:09:40 UTC
Begin processing the 68th record. run: 3786 subRun: 0 event: 49568 at 20-Nov-2024 15:09:40 UTC
Begin processing the 69th record. run: 3786 subRun: 0 event: 49569 at 20-Nov-2024 15:09:40 UTC
Begin processing the 70th record. run: 3786 subRun: 0 event: 49570 at 20-Nov-2024 15:09:40 UTC
Begin processing the 71st record. run: 3786 subRun: 0 event: 49571 at 20-Nov-2024 15:09:40 UTC
Begin processing the 72nd record. run: 3786 subRun: 0 event: 49572 at 20-Nov-2024 15:09:40 UTC
Begin processing the 73rd record. run: 3786 subRun: 0 event: 49573 at 20-Nov-2024 15:09:40 UTC
Begin processing the 74th record. run: 3786 subRun: 0 event: 49574 at 20-Nov-2024 15:09:40 UTC
Begin processing the 75th record. run: 3786 subRun: 0 event: 49575 at 20-Nov-2024 15:09:40 UTC
Begin processing the 76th record. run: 3786 subRun: 0 event: 49576 at 20-Nov-2024 15:09:40 UTC
Begin processing the 77th record. run: 3786 subRun: 0 event: 49577 at 20-Nov-2024 15:09:40 UTC
Begin processing the 78th record. run: 3786 subRun: 0 event: 49578 at 20-Nov-2024 15:09:40 UTC
Begin processing the 79th record. run: 3786 subRun: 0 event: 49579 at 20-Nov-2024 15:09:40 UTC
Begin processing the 80th record. run: 3786 subRun: 0 event: 49580 at 20-Nov-2024 15:09:40 UTC
Begin processing the 81st record. run: 3786 subRun: 0 event: 49581 at 20-Nov-2024 15:09:40 UTC
Begin processing the 82nd record. run: 3786 subRun: 0 event: 49582 at 20-Nov-2024 15:09:40 UTC
Begin processing the 83rd record. run: 3786 subRun: 0 event: 49583 at 20-Nov-2024 15:09:40 UTC
Begin processing the 84th record. run: 3786 subRun: 0 event: 49584 at 20-Nov-2024 15:09:40 UTC
Begin processing the 85th record. run: 3786 subRun: 0 event: 49585 at 20-Nov-2024 15:09:40 UTC
Begin processing the 86th record. run: 3786 subRun: 0 event: 49586 at 20-Nov-2024 15:09:40 UTC
Begin processing the 87th record. run: 3786 subRun: 0 event: 49587 at 20-Nov-2024 15:09:40 UTC
Begin processing the 88th record. run: 3786 subRun: 0 event: 49588 at 20-Nov-2024 15:09:40 UTC
Begin processing the 89th record. run: 3786 subRun: 0 event: 49589 at 20-Nov-2024 15:09:40 UTC
Begin processing the 90th record. run: 3786 subRun: 0 event: 49590 at 20-Nov-2024 15:09:40 UTC
Begin processing the 91st record. run: 3786 subRun: 0 event: 49591 at 20-Nov-2024 15:09:40 UTC
Begin processing the 92nd record. run: 3786 subRun: 0 event: 49592 at 20-Nov-2024 15:09:40 UTC
Begin processing the 93rd record. run: 3786 subRun: 0 event: 49593 at 20-Nov-2024 15:09:40 UTC
Begin processing the 94th record. run: 3786 subRun: 0 event: 49594 at 20-Nov-2024 15:09:40 UTC
Begin processing the 95th record. run: 3786 subRun: 0 event: 49595 at 20-Nov-2024 15:09:40 UTC
Begin processing the 96th record. run: 3786 subRun: 0 event: 49596 at 20-Nov-2024 15:09:40 UTC
Begin processing the 97th record. run: 3786 subRun: 0 event: 49597 at 20-Nov-2024 15:09:40 UTC
Begin processing the 98th record. run: 3786 subRun: 0 event: 49598 at 20-Nov-2024 15:09:40 UTC
Begin processing the 99th record. run: 3786 subRun: 0 event: 49599 at 20-Nov-2024 15:09:40 UTC
Begin processing the 100th record. run: 3786 subRun: 0 event: 49600 at 20-Nov-2024 15:09:40 UTC
20-Nov-2024 15:09:41 UTC  Closed output file "prodmarley_nue_cc_flat_dune10kt_1x2x6_20241023T133355Z_gen_000496_supernova_g4_detsim_reco_matt_2024-11-20T_150907Z.root"
20-Nov-2024 15:09:41 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/b8/04/prodmarley_nue_cc_flat_dune10kt_1x2x6_20241023T133355Z_gen_000496_supernova_g4_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                            0.00952076     0.0113202     0.0294551     0.0108046    0.00216394       100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000380964   0.000579796   0.00168555    0.000527431   0.000186358      100    
reco:pandora:StandardPandora                          0.00689183    0.00850059     0.0196286    0.00805039    0.00150224       100    
reco:pandoraTrack:LArPandoraTrackCreation             8.4391e-05    0.000105872   0.000934209   9.25305e-05   8.42716e-05      100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000135231   0.000163608   0.00107537    0.000146337   9.40655e-05      100    
reco:pandoracalo:Calorimetry                          7.1821e-05    8.67452e-05   0.000715327   7.7096e-05    6.37092e-05      100    
reco:pandorapid:Chi2ParticleID                        2.6111e-05    3.30687e-05   0.000309573   2.88405e-05   2.81226e-05      100    
[art]:TriggerResults:TriggerResultInserter             7.52e-06     9.61401e-06    3.911e-05     9.025e-06    3.32071e-06      100    
end_path:out1:RootOutput                               2.41e-06     2.98482e-06    1.513e-05     2.82e-06     1.26928e-06      100    
end_path:out1:RootOutput(write)                        0.001359     0.00161628    0.00480449    0.00153215    0.000367075      100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19118.8 MB
  Peak resident set size usage (VmHWM): 996.925 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2024-11-21 18:12:47 UTC       justIN version: 01.01.09