justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 105107.22@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID105107.22@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4159
Stage ID1
User nameosbiston@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-20 15:12:52
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2024-11-20 15:14:56
From worker nodeHostnamedunegli-3998863-0-fnpc19111.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-20 15:14:08
Input filesfardet-hd:prodmarley_nue_cc_flat_dune10kt_1x2x6_20241023T132728Z_gen_000265_supernova_g4_detsim_reco.root
JobscriptExit code0
Real time0m (38s)
CPU time0m (34s = 89%)
Outputting started2024-11-20 15:14:46
Output files
Finished2024-11-20 15:14:56
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
Begin processing the 27th record. run: 3786 subRun: 0 event: 26427 at 20-Nov-2024 15:14:44 UTC
Begin processing the 28th record. run: 3786 subRun: 0 event: 26428 at 20-Nov-2024 15:14:44 UTC
Begin processing the 29th record. run: 3786 subRun: 0 event: 26429 at 20-Nov-2024 15:14:44 UTC
Begin processing the 30th record. run: 3786 subRun: 0 event: 26430 at 20-Nov-2024 15:14:44 UTC
Begin processing the 31st record. run: 3786 subRun: 0 event: 26431 at 20-Nov-2024 15:14:44 UTC
Begin processing the 32nd record. run: 3786 subRun: 0 event: 26432 at 20-Nov-2024 15:14:44 UTC
Begin processing the 33rd record. run: 3786 subRun: 0 event: 26433 at 20-Nov-2024 15:14:44 UTC
Begin processing the 34th record. run: 3786 subRun: 0 event: 26434 at 20-Nov-2024 15:14:44 UTC
Begin processing the 35th record. run: 3786 subRun: 0 event: 26435 at 20-Nov-2024 15:14:44 UTC
Begin processing the 36th record. run: 3786 subRun: 0 event: 26436 at 20-Nov-2024 15:14:44 UTC
Begin processing the 37th record. run: 3786 subRun: 0 event: 26437 at 20-Nov-2024 15:14:44 UTC
Begin processing the 38th record. run: 3786 subRun: 0 event: 26438 at 20-Nov-2024 15:14:44 UTC
Begin processing the 39th record. run: 3786 subRun: 0 event: 26439 at 20-Nov-2024 15:14:44 UTC
Begin processing the 40th record. run: 3786 subRun: 0 event: 26440 at 20-Nov-2024 15:14:44 UTC
Begin processing the 41st record. run: 3786 subRun: 0 event: 26441 at 20-Nov-2024 15:14:44 UTC
Begin processing the 42nd record. run: 3786 subRun: 0 event: 26442 at 20-Nov-2024 15:14:44 UTC
Begin processing the 43rd record. run: 3786 subRun: 0 event: 26443 at 20-Nov-2024 15:14:44 UTC
Begin processing the 44th record. run: 3786 subRun: 0 event: 26444 at 20-Nov-2024 15:14:44 UTC
Begin processing the 45th record. run: 3786 subRun: 0 event: 26445 at 20-Nov-2024 15:14:44 UTC
Begin processing the 46th record. run: 3786 subRun: 0 event: 26446 at 20-Nov-2024 15:14:44 UTC
Begin processing the 47th record. run: 3786 subRun: 0 event: 26447 at 20-Nov-2024 15:14:44 UTC
Begin processing the 48th record. run: 3786 subRun: 0 event: 26448 at 20-Nov-2024 15:14:44 UTC
Begin processing the 49th record. run: 3786 subRun: 0 event: 26449 at 20-Nov-2024 15:14:44 UTC
Begin processing the 50th record. run: 3786 subRun: 0 event: 26450 at 20-Nov-2024 15:14:44 UTC
Begin processing the 51st record. run: 3786 subRun: 0 event: 26451 at 20-Nov-2024 15:14:44 UTC
Begin processing the 52nd record. run: 3786 subRun: 0 event: 26452 at 20-Nov-2024 15:14:44 UTC
Begin processing the 53rd record. run: 3786 subRun: 0 event: 26453 at 20-Nov-2024 15:14:44 UTC
Begin processing the 54th record. run: 3786 subRun: 0 event: 26454 at 20-Nov-2024 15:14:44 UTC
Begin processing the 55th record. run: 3786 subRun: 0 event: 26455 at 20-Nov-2024 15:14:44 UTC
Begin processing the 56th record. run: 3786 subRun: 0 event: 26456 at 20-Nov-2024 15:14:44 UTC
Begin processing the 57th record. run: 3786 subRun: 0 event: 26457 at 20-Nov-2024 15:14:44 UTC
Begin processing the 58th record. run: 3786 subRun: 0 event: 26458 at 20-Nov-2024 15:14:45 UTC
Begin processing the 59th record. run: 3786 subRun: 0 event: 26459 at 20-Nov-2024 15:14:45 UTC
Begin processing the 60th record. run: 3786 subRun: 0 event: 26460 at 20-Nov-2024 15:14:45 UTC
Begin processing the 61st record. run: 3786 subRun: 0 event: 26461 at 20-Nov-2024 15:14:45 UTC
Begin processing the 62nd record. run: 3786 subRun: 0 event: 26462 at 20-Nov-2024 15:14:45 UTC
Begin processing the 63rd record. run: 3786 subRun: 0 event: 26463 at 20-Nov-2024 15:14:45 UTC
Begin processing the 64th record. run: 3786 subRun: 0 event: 26464 at 20-Nov-2024 15:14:45 UTC
Begin processing the 65th record. run: 3786 subRun: 0 event: 26465 at 20-Nov-2024 15:14:45 UTC
Begin processing the 66th record. run: 3786 subRun: 0 event: 26466 at 20-Nov-2024 15:14:45 UTC
Begin processing the 67th record. run: 3786 subRun: 0 event: 26467 at 20-Nov-2024 15:14:45 UTC
Begin processing the 68th record. run: 3786 subRun: 0 event: 26468 at 20-Nov-2024 15:14:45 UTC
Begin processing the 69th record. run: 3786 subRun: 0 event: 26469 at 20-Nov-2024 15:14:45 UTC
Begin processing the 70th record. run: 3786 subRun: 0 event: 26470 at 20-Nov-2024 15:14:45 UTC
Begin processing the 71st record. run: 3786 subRun: 0 event: 26471 at 20-Nov-2024 15:14:45 UTC
Begin processing the 72nd record. run: 3786 subRun: 0 event: 26472 at 20-Nov-2024 15:14:45 UTC
Begin processing the 73rd record. run: 3786 subRun: 0 event: 26473 at 20-Nov-2024 15:14:45 UTC
Begin processing the 74th record. run: 3786 subRun: 0 event: 26474 at 20-Nov-2024 15:14:45 UTC
Begin processing the 75th record. run: 3786 subRun: 0 event: 26475 at 20-Nov-2024 15:14:45 UTC
Begin processing the 76th record. run: 3786 subRun: 0 event: 26476 at 20-Nov-2024 15:14:45 UTC
Begin processing the 77th record. run: 3786 subRun: 0 event: 26477 at 20-Nov-2024 15:14:45 UTC
Begin processing the 78th record. run: 3786 subRun: 0 event: 26478 at 20-Nov-2024 15:14:45 UTC
Begin processing the 79th record. run: 3786 subRun: 0 event: 26479 at 20-Nov-2024 15:14:45 UTC
Begin processing the 80th record. run: 3786 subRun: 0 event: 26480 at 20-Nov-2024 15:14:45 UTC
Begin processing the 81st record. run: 3786 subRun: 0 event: 26481 at 20-Nov-2024 15:14:45 UTC
Begin processing the 82nd record. run: 3786 subRun: 0 event: 26482 at 20-Nov-2024 15:14:45 UTC
Begin processing the 83rd record. run: 3786 subRun: 0 event: 26483 at 20-Nov-2024 15:14:45 UTC
Begin processing the 84th record. run: 3786 subRun: 0 event: 26484 at 20-Nov-2024 15:14:45 UTC
Begin processing the 85th record. run: 3786 subRun: 0 event: 26485 at 20-Nov-2024 15:14:45 UTC
Begin processing the 86th record. run: 3786 subRun: 0 event: 26486 at 20-Nov-2024 15:14:45 UTC
Begin processing the 87th record. run: 3786 subRun: 0 event: 26487 at 20-Nov-2024 15:14:45 UTC
Begin processing the 88th record. run: 3786 subRun: 0 event: 26488 at 20-Nov-2024 15:14:45 UTC
Begin processing the 89th record. run: 3786 subRun: 0 event: 26489 at 20-Nov-2024 15:14:45 UTC
Begin processing the 90th record. run: 3786 subRun: 0 event: 26490 at 20-Nov-2024 15:14:45 UTC
Begin processing the 91st record. run: 3786 subRun: 0 event: 26491 at 20-Nov-2024 15:14:45 UTC
Begin processing the 92nd record. run: 3786 subRun: 0 event: 26492 at 20-Nov-2024 15:14:45 UTC
Begin processing the 93rd record. run: 3786 subRun: 0 event: 26493 at 20-Nov-2024 15:14:45 UTC
Begin processing the 94th record. run: 3786 subRun: 0 event: 26494 at 20-Nov-2024 15:14:45 UTC
Begin processing the 95th record. run: 3786 subRun: 0 event: 26495 at 20-Nov-2024 15:14:45 UTC
Begin processing the 96th record. run: 3786 subRun: 0 event: 26496 at 20-Nov-2024 15:14:45 UTC
Begin processing the 97th record. run: 3786 subRun: 0 event: 26497 at 20-Nov-2024 15:14:45 UTC
Begin processing the 98th record. run: 3786 subRun: 0 event: 26498 at 20-Nov-2024 15:14:45 UTC
Begin processing the 99th record. run: 3786 subRun: 0 event: 26499 at 20-Nov-2024 15:14:45 UTC
Begin processing the 100th record. run: 3786 subRun: 0 event: 26500 at 20-Nov-2024 15:14:45 UTC
20-Nov-2024 15:14:46 UTC  Closed output file "prodmarley_nue_cc_flat_dune10kt_1x2x6_20241023T132728Z_gen_000265_supernova_g4_detsim_reco_matt_2024-11-20T_151412Z.root"
20-Nov-2024 15:14:46 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/4f/4e/prodmarley_nue_cc_flat_dune10kt_1x2x6_20241023T132728Z_gen_000265_supernova_g4_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                            0.00786997    0.00937903     0.0246091    0.00905435    0.00174161       100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000323263   0.000436213   0.000830478   0.000407254   0.000104107      100    
reco:pandora:StandardPandora                          0.00606997    0.00711781     0.0171727    0.00680211    0.00127189       100    
reco:pandoraTrack:LArPandoraTrackCreation             6.3661e-05    8.66529e-05   0.00089086    7.8746e-05    8.09918e-05      100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000102381   0.000137134   0.00110553    0.000128277   9.75747e-05      100    
reco:pandoracalo:Calorimetry                           5.161e-05    7.43818e-05   0.000707138   6.66405e-05   6.69284e-05      100    
reco:pandorapid:Chi2ParticleID                         2.104e-05    2.86165e-05   0.000328453   2.58805e-05   3.01771e-05      100    
[art]:TriggerResults:TriggerResultInserter             5.86e-06     7.86464e-06    3.254e-05     7.72e-06     2.5392e-06       100    
end_path:out1:RootOutput                               1.24e-06     2.24517e-06   1.0951e-05     2.19e-06     9.61255e-07      100    
end_path:out1:RootOutput(write)                       0.00107791    0.00131507    0.00308776    0.00129775    0.000196513      100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19118.8 MB
  Peak resident set size usage (VmHWM): 999.129 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2024-11-24 02:16:13 UTC       justIN version: 01.01.09