justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 416015.10@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID416015.10@justin-prod-sched01.dune.hep.ac.uk
Workflow ID7664
Stage ID1
User namehsouza@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes3145728000 (3000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-17 18:23:41
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce4
Last heartbeat2025-06-17 19:00:50
From worker nodeHostnamen263.dur.scotgrid.ac.uk
cpuinfoAMD EPYC 9534 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes3145728000 (3000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-17 18:30:49
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6171714_442_20231126T014826Z_gen_g4_detsim_hitreco__20240507T182808Z_reco2.root
JobscriptExit code0
Real time29m (1762s)
CPU time0m (43s = 2%)
Max RSS bytes1517207552 (1446 MiB)
Outputting started2025-06-17 19:00:12
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/hsouza/07664/1/010/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6171714_442_20231126T014826Z_gen_g4_detsim_hitreco__20240507T182808Z_reco2_pida_2025-06-17T_183053Z.root
Finished2025-06-17 19:00:47
Saved logsjustin-logs:416015.10-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

4 subRun: 1 event: 88530 at 17-Jun-2025 19:48:03 BST
Begin processing the 131st record. run: 6171714 subRun: 1 event: 88531 at 17-Jun-2025 19:48:12 BST
Begin processing the 132nd record. run: 6171714 subRun: 1 event: 88532 at 17-Jun-2025 19:48:23 BST
Begin processing the 133rd record. run: 6171714 subRun: 1 event: 88533 at 17-Jun-2025 19:48:30 BST
Begin processing the 134th record. run: 6171714 subRun: 1 event: 88534 at 17-Jun-2025 19:48:39 BST
Begin processing the 135th record. run: 6171714 subRun: 1 event: 88535 at 17-Jun-2025 19:48:46 BST
Begin processing the 136th record. run: 6171714 subRun: 1 event: 88536 at 17-Jun-2025 19:48:55 BST
Begin processing the 137th record. run: 6171714 subRun: 1 event: 88537 at 17-Jun-2025 19:49:02 BST
Begin processing the 138th record. run: 6171714 subRun: 1 event: 88538 at 17-Jun-2025 19:49:10 BST
Begin processing the 139th record. run: 6171714 subRun: 1 event: 88539 at 17-Jun-2025 19:49:19 BST
Begin processing the 140th record. run: 6171714 subRun: 1 event: 88540 at 17-Jun-2025 19:49:25 BST
Begin processing the 141st record. run: 6171714 subRun: 1 event: 88541 at 17-Jun-2025 19:49:33 BST
Begin processing the 142nd record. run: 6171714 subRun: 1 event: 88542 at 17-Jun-2025 19:49:42 BST
Begin processing the 143rd record. run: 6171714 subRun: 1 event: 88543 at 17-Jun-2025 19:49:50 BST
Begin processing the 144th record. run: 6171714 subRun: 1 event: 88544 at 17-Jun-2025 19:49:56 BST
Begin processing the 145th record. run: 6171714 subRun: 1 event: 88545 at 17-Jun-2025 19:50:03 BST
Begin processing the 146th record. run: 6171714 subRun: 1 event: 88546 at 17-Jun-2025 19:50:10 BST
Begin processing the 147th record. run: 6171714 subRun: 1 event: 88547 at 17-Jun-2025 19:50:19 BST
Begin processing the 148th record. run: 6171714 subRun: 1 event: 88548 at 17-Jun-2025 19:50:30 BST
Begin processing the 149th record. run: 6171714 subRun: 1 event: 88549 at 17-Jun-2025 19:50:41 BST
Begin processing the 150th record. run: 6171714 subRun: 1 event: 88550 at 17-Jun-2025 19:50:50 BST
Begin processing the 151st record. run: 6171714 subRun: 1 event: 88551 at 17-Jun-2025 19:50:58 BST
Begin processing the 152nd record. run: 6171714 subRun: 1 event: 88552 at 17-Jun-2025 19:51:10 BST
Begin processing the 153rd record. run: 6171714 subRun: 1 event: 88553 at 17-Jun-2025 19:51:20 BST
Begin processing the 154th record. run: 6171714 subRun: 1 event: 88554 at 17-Jun-2025 19:51:29 BST
Begin processing the 155th record. run: 6171714 subRun: 1 event: 88555 at 17-Jun-2025 19:51:39 BST
Begin processing the 156th record. run: 6171714 subRun: 1 event: 88556 at 17-Jun-2025 19:51:53 BST
Begin processing the 157th record. run: 6171714 subRun: 1 event: 88557 at 17-Jun-2025 19:51:59 BST
Begin processing the 158th record. run: 6171714 subRun: 1 event: 88558 at 17-Jun-2025 19:52:03 BST
Begin processing the 159th record. run: 6171714 subRun: 1 event: 88559 at 17-Jun-2025 19:52:07 BST
Begin processing the 160th record. run: 6171714 subRun: 1 event: 88560 at 17-Jun-2025 19:52:18 BST
Begin processing the 161st record. run: 6171714 subRun: 1 event: 88561 at 17-Jun-2025 19:52:44 BST
Begin processing the 162nd record. run: 6171714 subRun: 1 event: 88562 at 17-Jun-2025 19:53:03 BST
Begin processing the 163rd record. run: 6171714 subRun: 1 event: 88563 at 17-Jun-2025 19:53:10 BST
Begin processing the 164th record. run: 6171714 subRun: 1 event: 88564 at 17-Jun-2025 19:53:23 BST
Begin processing the 165th record. run: 6171714 subRun: 1 event: 88565 at 17-Jun-2025 19:53:36 BST
Begin processing the 166th record. run: 6171714 subRun: 1 event: 88566 at 17-Jun-2025 19:53:44 BST
Begin processing the 167th record. run: 6171714 subRun: 1 event: 88567 at 17-Jun-2025 19:53:49 BST
Begin processing the 168th record. run: 6171714 subRun: 1 event: 88568 at 17-Jun-2025 19:53:53 BST
Begin processing the 169th record. run: 6171714 subRun: 1 event: 88569 at 17-Jun-2025 19:53:58 BST
Begin processing the 170th record. run: 6171714 subRun: 1 event: 88570 at 17-Jun-2025 19:54:08 BST
Begin processing the 171st record. run: 6171714 subRun: 1 event: 88571 at 17-Jun-2025 19:54:19 BST
Begin processing the 172nd record. run: 6171714 subRun: 1 event: 88572 at 17-Jun-2025 19:54:34 BST
Begin processing the 173rd record. run: 6171714 subRun: 1 event: 88573 at 17-Jun-2025 19:54:53 BST
Begin processing the 174th record. run: 6171714 subRun: 1 event: 88574 at 17-Jun-2025 19:55:04 BST
Begin processing the 175th record. run: 6171714 subRun: 1 event: 88575 at 17-Jun-2025 19:55:25 BST
Begin processing the 176th record. run: 6171714 subRun: 1 event: 88576 at 17-Jun-2025 19:55:48 BST
Begin processing the 177th record. run: 6171714 subRun: 1 event: 88577 at 17-Jun-2025 19:56:00 BST
Begin processing the 178th record. run: 6171714 subRun: 1 event: 88578 at 17-Jun-2025 19:56:11 BST
Begin processing the 179th record. run: 6171714 subRun: 1 event: 88579 at 17-Jun-2025 19:56:23 BST
Begin processing the 180th record. run: 6171714 subRun: 1 event: 88580 at 17-Jun-2025 19:56:36 BST
Begin processing the 181st record. run: 6171714 subRun: 1 event: 88581 at 17-Jun-2025 19:56:44 BST
Begin processing the 182nd record. run: 6171714 subRun: 1 event: 88582 at 17-Jun-2025 19:56:54 BST
Begin processing the 183rd record. run: 6171714 subRun: 1 event: 88583 at 17-Jun-2025 19:57:07 BST
Begin processing the 184th record. run: 6171714 subRun: 1 event: 88584 at 17-Jun-2025 19:57:16 BST
Begin processing the 185th record. run: 6171714 subRun: 1 event: 88585 at 17-Jun-2025 19:57:32 BST
Begin processing the 186th record. run: 6171714 subRun: 1 event: 88586 at 17-Jun-2025 19:57:41 BST
Begin processing the 187th record. run: 6171714 subRun: 1 event: 88587 at 17-Jun-2025 19:57:52 BST
Begin processing the 188th record. run: 6171714 subRun: 1 event: 88588 at 17-Jun-2025 19:58:09 BST
Begin processing the 189th record. run: 6171714 subRun: 1 event: 88589 at 17-Jun-2025 19:58:19 BST
Begin processing the 190th record. run: 6171714 subRun: 1 event: 88590 at 17-Jun-2025 19:58:29 BST
Begin processing the 191st record. run: 6171714 subRun: 1 event: 88591 at 17-Jun-2025 19:58:42 BST
Begin processing the 192nd record. run: 6171714 subRun: 1 event: 88592 at 17-Jun-2025 19:58:56 BST
Begin processing the 193rd record. run: 6171714 subRun: 1 event: 88593 at 17-Jun-2025 19:59:05 BST
Begin processing the 194th record. run: 6171714 subRun: 1 event: 88594 at 17-Jun-2025 19:59:14 BST
Begin processing the 195th record. run: 6171714 subRun: 1 event: 88595 at 17-Jun-2025 19:59:26 BST
Begin processing the 196th record. run: 6171714 subRun: 1 event: 88596 at 17-Jun-2025 19:59:32 BST
Begin processing the 197th record. run: 6171714 subRun: 1 event: 88597 at 17-Jun-2025 19:59:39 BST
Begin processing the 198th record. run: 6171714 subRun: 1 event: 88598 at 17-Jun-2025 19:59:49 BST
Begin processing the 199th record. run: 6171714 subRun: 1 event: 88599 at 17-Jun-2025 19:59:55 BST
Begin processing the 200th record. run: 6171714 subRun: 1 event: 88600 at 17-Jun-2025 20:00:02 BST
17-Jun-2025 20:00:11 BST  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/ff/c1/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6171714_442_20231126T014826Z_gen_g4_detsim_hitreco__20240507T182808Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      1.22949        5.691        15.8825       5.24649       2.31457        200    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.017322      0.0546603     0.879266      0.0353487     0.101891        200    
prod:pandorapid:Chi2ParticleID                 0.104007      0.170472      0.420913      0.164232      0.0413809       200    
prod:energyreconue:EnergyReco                  0.698574       2.41183       9.29614       2.10209       1.23422        200    
prod:energyreconumu:EnergyReco                0.00100523     0.465645       4.00993      0.279867      0.597618        200    
prod:energyreconc:EnergyReco                  0.00204552     0.366759       3.99086      0.302679      0.476191        200    
[art]:TriggerResults:TriggerResultInserter     9.21e-06     1.21475e-05    9.263e-05    1.1375e-05    5.93103e-06      200    
end_path:ana:PIDASelectionAna                 0.00183313      2.22124       12.4458       1.96321       1.32755        200    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 37085.7 MB
  Peak resident set size usage (VmHWM): 1517.21 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
.:
total 164
-rw-r--r--. 1 dune001 dune 115123 Jun 17 20:00 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6171714_442_20231126T014826Z_gen_g4_detsim_hitreco__20240507T182808Z_reco2_pida_2025-06-17T_183053Z.root
-rw-r--r--. 1 dune001 dune  24051 Jun 17 20:00 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6171714_442_20231126T014826Z_gen_g4_detsim_hitreco__20240507T182808Z_reco2_reco_2025-06-17T_183053Z.log
-rw-r--r--. 1 dune001 dune  11994 Jun 17 20:00 jobscript.log
-rw-r--r--. 1 dune001 dune    198 Jun 17 20:00 justin-processed-pfns.txt
-rw-r--r--. 1 dune001 dune    137 Jun 17 19:30 all-input-dids.txt
-rw-r--r--. 1 dune001 dune      0 Jun 17 19:30 debugprod.log
justIN time: 2025-08-14 21:50:48 UTC       justIN version: 01.03.02