justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297901.16@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID297901.16@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4159
Stage ID1
User nameosbiston@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-20 15:13:55
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2024-11-20 15:16:08
From worker nodeHostnamedunegli-3998870-0-fnpc17105.fnal.gov
cpuinfoIntel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-20 15:14:52
Input filesfardet-hd:prodmarley_nue_cc_flat_dune10kt_1x2x6_20241025T132926Z_gen_000495_supernova_g4_detsim_reco.root
JobscriptExit code0
Real time1m (64s)
CPU time1m (60s = 93%)
Outputting started2024-11-20 15:15:57
Output files
Finished2024-11-20 15:16:08
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
Begin processing the 27th record. run: 3786 subRun: 0 event: 49427 at 20-Nov-2024 15:15:52 UTC
Begin processing the 28th record. run: 3786 subRun: 0 event: 49428 at 20-Nov-2024 15:15:52 UTC
Begin processing the 29th record. run: 3786 subRun: 0 event: 49429 at 20-Nov-2024 15:15:52 UTC
Begin processing the 30th record. run: 3786 subRun: 0 event: 49430 at 20-Nov-2024 15:15:53 UTC
Begin processing the 31st record. run: 3786 subRun: 0 event: 49431 at 20-Nov-2024 15:15:53 UTC
Begin processing the 32nd record. run: 3786 subRun: 0 event: 49432 at 20-Nov-2024 15:15:53 UTC
Begin processing the 33rd record. run: 3786 subRun: 0 event: 49433 at 20-Nov-2024 15:15:53 UTC
Begin processing the 34th record. run: 3786 subRun: 0 event: 49434 at 20-Nov-2024 15:15:53 UTC
Begin processing the 35th record. run: 3786 subRun: 0 event: 49435 at 20-Nov-2024 15:15:53 UTC
Begin processing the 36th record. run: 3786 subRun: 0 event: 49436 at 20-Nov-2024 15:15:53 UTC
Begin processing the 37th record. run: 3786 subRun: 0 event: 49437 at 20-Nov-2024 15:15:53 UTC
Begin processing the 38th record. run: 3786 subRun: 0 event: 49438 at 20-Nov-2024 15:15:53 UTC
Begin processing the 39th record. run: 3786 subRun: 0 event: 49439 at 20-Nov-2024 15:15:53 UTC
Begin processing the 40th record. run: 3786 subRun: 0 event: 49440 at 20-Nov-2024 15:15:53 UTC
Begin processing the 41st record. run: 3786 subRun: 0 event: 49441 at 20-Nov-2024 15:15:53 UTC
Begin processing the 42nd record. run: 3786 subRun: 0 event: 49442 at 20-Nov-2024 15:15:53 UTC
Begin processing the 43rd record. run: 3786 subRun: 0 event: 49443 at 20-Nov-2024 15:15:53 UTC
Begin processing the 44th record. run: 3786 subRun: 0 event: 49444 at 20-Nov-2024 15:15:53 UTC
Begin processing the 45th record. run: 3786 subRun: 0 event: 49445 at 20-Nov-2024 15:15:53 UTC
Begin processing the 46th record. run: 3786 subRun: 0 event: 49446 at 20-Nov-2024 15:15:53 UTC
Begin processing the 47th record. run: 3786 subRun: 0 event: 49447 at 20-Nov-2024 15:15:53 UTC
Begin processing the 48th record. run: 3786 subRun: 0 event: 49448 at 20-Nov-2024 15:15:53 UTC
Begin processing the 49th record. run: 3786 subRun: 0 event: 49449 at 20-Nov-2024 15:15:53 UTC
Begin processing the 50th record. run: 3786 subRun: 0 event: 49450 at 20-Nov-2024 15:15:53 UTC
Begin processing the 51st record. run: 3786 subRun: 0 event: 49451 at 20-Nov-2024 15:15:53 UTC
Begin processing the 52nd record. run: 3786 subRun: 0 event: 49452 at 20-Nov-2024 15:15:53 UTC
Begin processing the 53rd record. run: 3786 subRun: 0 event: 49453 at 20-Nov-2024 15:15:53 UTC
Begin processing the 54th record. run: 3786 subRun: 0 event: 49454 at 20-Nov-2024 15:15:53 UTC
Begin processing the 55th record. run: 3786 subRun: 0 event: 49455 at 20-Nov-2024 15:15:53 UTC
Begin processing the 56th record. run: 3786 subRun: 0 event: 49456 at 20-Nov-2024 15:15:53 UTC
Begin processing the 57th record. run: 3786 subRun: 0 event: 49457 at 20-Nov-2024 15:15:53 UTC
Begin processing the 58th record. run: 3786 subRun: 0 event: 49458 at 20-Nov-2024 15:15:53 UTC
Begin processing the 59th record. run: 3786 subRun: 0 event: 49459 at 20-Nov-2024 15:15:53 UTC
Begin processing the 60th record. run: 3786 subRun: 0 event: 49460 at 20-Nov-2024 15:15:53 UTC
Begin processing the 61st record. run: 3786 subRun: 0 event: 49461 at 20-Nov-2024 15:15:53 UTC
Begin processing the 62nd record. run: 3786 subRun: 0 event: 49462 at 20-Nov-2024 15:15:53 UTC
Begin processing the 63rd record. run: 3786 subRun: 0 event: 49463 at 20-Nov-2024 15:15:53 UTC
Begin processing the 64th record. run: 3786 subRun: 0 event: 49464 at 20-Nov-2024 15:15:54 UTC
Begin processing the 65th record. run: 3786 subRun: 0 event: 49465 at 20-Nov-2024 15:15:54 UTC
Begin processing the 66th record. run: 3786 subRun: 0 event: 49466 at 20-Nov-2024 15:15:54 UTC
Begin processing the 67th record. run: 3786 subRun: 0 event: 49467 at 20-Nov-2024 15:15:54 UTC
Begin processing the 68th record. run: 3786 subRun: 0 event: 49468 at 20-Nov-2024 15:15:54 UTC
Begin processing the 69th record. run: 3786 subRun: 0 event: 49469 at 20-Nov-2024 15:15:54 UTC
Begin processing the 70th record. run: 3786 subRun: 0 event: 49470 at 20-Nov-2024 15:15:54 UTC
Begin processing the 71st record. run: 3786 subRun: 0 event: 49471 at 20-Nov-2024 15:15:54 UTC
Begin processing the 72nd record. run: 3786 subRun: 0 event: 49472 at 20-Nov-2024 15:15:54 UTC
Begin processing the 73rd record. run: 3786 subRun: 0 event: 49473 at 20-Nov-2024 15:15:54 UTC
Begin processing the 74th record. run: 3786 subRun: 0 event: 49474 at 20-Nov-2024 15:15:54 UTC
Begin processing the 75th record. run: 3786 subRun: 0 event: 49475 at 20-Nov-2024 15:15:54 UTC
Begin processing the 76th record. run: 3786 subRun: 0 event: 49476 at 20-Nov-2024 15:15:54 UTC
Begin processing the 77th record. run: 3786 subRun: 0 event: 49477 at 20-Nov-2024 15:15:54 UTC
Begin processing the 78th record. run: 3786 subRun: 0 event: 49478 at 20-Nov-2024 15:15:54 UTC
Begin processing the 79th record. run: 3786 subRun: 0 event: 49479 at 20-Nov-2024 15:15:54 UTC
Begin processing the 80th record. run: 3786 subRun: 0 event: 49480 at 20-Nov-2024 15:15:54 UTC
Begin processing the 81st record. run: 3786 subRun: 0 event: 49481 at 20-Nov-2024 15:15:54 UTC
Begin processing the 82nd record. run: 3786 subRun: 0 event: 49482 at 20-Nov-2024 15:15:54 UTC
Begin processing the 83rd record. run: 3786 subRun: 0 event: 49483 at 20-Nov-2024 15:15:54 UTC
Begin processing the 84th record. run: 3786 subRun: 0 event: 49484 at 20-Nov-2024 15:15:54 UTC
Begin processing the 85th record. run: 3786 subRun: 0 event: 49485 at 20-Nov-2024 15:15:54 UTC
Begin processing the 86th record. run: 3786 subRun: 0 event: 49486 at 20-Nov-2024 15:15:54 UTC
Begin processing the 87th record. run: 3786 subRun: 0 event: 49487 at 20-Nov-2024 15:15:54 UTC
Begin processing the 88th record. run: 3786 subRun: 0 event: 49488 at 20-Nov-2024 15:15:54 UTC
Begin processing the 89th record. run: 3786 subRun: 0 event: 49489 at 20-Nov-2024 15:15:54 UTC
Begin processing the 90th record. run: 3786 subRun: 0 event: 49490 at 20-Nov-2024 15:15:54 UTC
Begin processing the 91st record. run: 3786 subRun: 0 event: 49491 at 20-Nov-2024 15:15:54 UTC
Begin processing the 92nd record. run: 3786 subRun: 0 event: 49492 at 20-Nov-2024 15:15:54 UTC
Begin processing the 93rd record. run: 3786 subRun: 0 event: 49493 at 20-Nov-2024 15:15:54 UTC
Begin processing the 94th record. run: 3786 subRun: 0 event: 49494 at 20-Nov-2024 15:15:54 UTC
Begin processing the 95th record. run: 3786 subRun: 0 event: 49495 at 20-Nov-2024 15:15:54 UTC
Begin processing the 96th record. run: 3786 subRun: 0 event: 49496 at 20-Nov-2024 15:15:55 UTC
Begin processing the 97th record. run: 3786 subRun: 0 event: 49497 at 20-Nov-2024 15:15:55 UTC
Begin processing the 98th record. run: 3786 subRun: 0 event: 49498 at 20-Nov-2024 15:15:55 UTC
Begin processing the 99th record. run: 3786 subRun: 0 event: 49499 at 20-Nov-2024 15:15:55 UTC
Begin processing the 100th record. run: 3786 subRun: 0 event: 49500 at 20-Nov-2024 15:15:55 UTC
20-Nov-2024 15:15:56 UTC  Closed output file "prodmarley_nue_cc_flat_dune10kt_1x2x6_20241025T132926Z_gen_000495_supernova_g4_detsim_reco_matt_2024-11-20T_151456Z.root"
20-Nov-2024 15:15:56 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/73/ca/prodmarley_nue_cc_flat_dune10kt_1x2x6_20241025T132926Z_gen_000495_supernova_g4_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.0126482     0.0178941     0.0483985     0.0179798    0.00379683       100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000541025   0.000872542   0.00189471    0.000845819   0.000180995      100    
reco:pandora:StandardPandora                          0.00940271     0.0135444     0.0336365     0.0133997    0.00274699       100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000108984   0.000174964   0.00186201    0.000159618   0.000171962      100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000167209   0.000261435   0.00220103    0.000253033   0.000198686      100    
reco:pandoracalo:Calorimetry                          8.9055e-05    0.000148051   0.00146195    0.00013431    0.000134187      100    
reco:pandorapid:Chi2ParticleID                        3.3301e-05    5.51813e-05   0.000633896   5.05935e-05   5.88694e-05      100    
[art]:TriggerResults:TriggerResultInserter            1.0206e-05    1.53846e-05   5.7097e-05    1.50315e-05   5.28206e-06      100    
end_path:out1:RootOutput                               3.185e-06    4.42551e-06   2.2106e-05    4.1975e-06    1.97088e-06      100    
end_path:out1:RootOutput(write)                       0.00168349    0.00248538    0.00573622     0.0025325    0.000491529      100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11602.6 MB
  Peak resident set size usage (VmHWM): 1000.57 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2024-11-24 04:18:54 UTC       justIN version: 01.01.09