justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 226650.25@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID226650.25@justin-prod-sched02.dune.hep.ac.uk
Workflow ID7801
Stage ID1
User namehsouza@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes3145728000 (3000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-20 17:07:09
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce03
Last heartbeat2025-06-20 17:46:02
From worker nodeHostnamedune001-7041984.0-lcg2697.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes3145728000 (3000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-20 17:30:04
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006611_775_20231203T050211Z_gen_g4_detsim_hitreco__20240508T072128Z_reco2.root
JobscriptExit code0
Real time3m (199s)
CPU time0m (39s = 19%)
Max RSS bytes1150459904 (1097 MiB)
Outputting started2025-06-20 17:33:23
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/hsouza/07801/1/010/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006611_775_20231203T050211Z_gen_g4_detsim_hitreco__20240508T072128Z_reco2_pida_2025-06-20T_173009Z.root
Finished2025-06-20 17:46:02
Saved logsjustin-logs:226650.25-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

th record. run: 66006611 subRun: 1 event: 77530 at 20-Jun-2025 17:31:19 UTC
Begin processing the 31st record. run: 66006611 subRun: 1 event: 77531 at 20-Jun-2025 17:31:21 UTC
Begin processing the 32nd record. run: 66006611 subRun: 1 event: 77532 at 20-Jun-2025 17:31:22 UTC
Begin processing the 33rd record. run: 66006611 subRun: 1 event: 77533 at 20-Jun-2025 17:31:25 UTC
Begin processing the 34th record. run: 66006611 subRun: 1 event: 77534 at 20-Jun-2025 17:31:27 UTC
Begin processing the 35th record. run: 66006611 subRun: 1 event: 77535 at 20-Jun-2025 17:31:28 UTC
Begin processing the 36th record. run: 66006611 subRun: 1 event: 77536 at 20-Jun-2025 17:31:29 UTC
Begin processing the 37th record. run: 66006611 subRun: 1 event: 77537 at 20-Jun-2025 17:31:31 UTC
Begin processing the 38th record. run: 66006611 subRun: 1 event: 77538 at 20-Jun-2025 17:31:34 UTC
Begin processing the 39th record. run: 66006611 subRun: 1 event: 77539 at 20-Jun-2025 17:31:36 UTC
Begin processing the 40th record. run: 66006611 subRun: 1 event: 77540 at 20-Jun-2025 17:31:37 UTC
Begin processing the 41st record. run: 66006611 subRun: 1 event: 77541 at 20-Jun-2025 17:31:40 UTC
Begin processing the 42nd record. run: 66006611 subRun: 1 event: 77542 at 20-Jun-2025 17:31:41 UTC
Begin processing the 43rd record. run: 66006611 subRun: 1 event: 77543 at 20-Jun-2025 17:31:41 UTC
Begin processing the 44th record. run: 66006611 subRun: 1 event: 77544 at 20-Jun-2025 17:31:44 UTC
Begin processing the 45th record. run: 66006611 subRun: 1 event: 77545 at 20-Jun-2025 17:31:45 UTC
Begin processing the 46th record. run: 66006611 subRun: 1 event: 77546 at 20-Jun-2025 17:31:46 UTC
Begin processing the 47th record. run: 66006611 subRun: 1 event: 77547 at 20-Jun-2025 17:31:48 UTC
Begin processing the 48th record. run: 66006611 subRun: 1 event: 77548 at 20-Jun-2025 17:31:49 UTC
Begin processing the 49th record. run: 66006611 subRun: 1 event: 77549 at 20-Jun-2025 17:31:51 UTC
Begin processing the 50th record. run: 66006611 subRun: 1 event: 77550 at 20-Jun-2025 17:31:53 UTC
Begin processing the 51st record. run: 66006611 subRun: 1 event: 77551 at 20-Jun-2025 17:31:54 UTC
Begin processing the 52nd record. run: 66006611 subRun: 1 event: 77552 at 20-Jun-2025 17:31:56 UTC
Begin processing the 53rd record. run: 66006611 subRun: 1 event: 77553 at 20-Jun-2025 17:31:57 UTC
Begin processing the 54th record. run: 66006611 subRun: 1 event: 77554 at 20-Jun-2025 17:31:58 UTC
Begin processing the 55th record. run: 66006611 subRun: 1 event: 77555 at 20-Jun-2025 17:32:00 UTC
Begin processing the 56th record. run: 66006611 subRun: 1 event: 77556 at 20-Jun-2025 17:32:02 UTC
Begin processing the 57th record. run: 66006611 subRun: 1 event: 77557 at 20-Jun-2025 17:32:04 UTC
Begin processing the 58th record. run: 66006611 subRun: 1 event: 77558 at 20-Jun-2025 17:32:05 UTC
Begin processing the 59th record. run: 66006611 subRun: 1 event: 77559 at 20-Jun-2025 17:32:06 UTC
Begin processing the 60th record. run: 66006611 subRun: 1 event: 77560 at 20-Jun-2025 17:32:08 UTC
Begin processing the 61st record. run: 66006611 subRun: 1 event: 77561 at 20-Jun-2025 17:32:09 UTC
Begin processing the 62nd record. run: 66006611 subRun: 1 event: 77562 at 20-Jun-2025 17:32:10 UTC
Begin processing the 63rd record. run: 66006611 subRun: 1 event: 77563 at 20-Jun-2025 17:32:12 UTC
Begin processing the 64th record. run: 66006611 subRun: 1 event: 77564 at 20-Jun-2025 17:32:15 UTC
Begin processing the 65th record. run: 66006611 subRun: 1 event: 77565 at 20-Jun-2025 17:32:16 UTC
Begin processing the 66th record. run: 66006611 subRun: 1 event: 77566 at 20-Jun-2025 17:32:17 UTC
Begin processing the 67th record. run: 66006611 subRun: 1 event: 77567 at 20-Jun-2025 17:32:18 UTC
Begin processing the 68th record. run: 66006611 subRun: 1 event: 77568 at 20-Jun-2025 17:32:21 UTC
Begin processing the 69th record. run: 66006611 subRun: 1 event: 77569 at 20-Jun-2025 17:32:22 UTC
Begin processing the 70th record. run: 66006611 subRun: 1 event: 77570 at 20-Jun-2025 17:32:24 UTC
Begin processing the 71st record. run: 66006611 subRun: 1 event: 77571 at 20-Jun-2025 17:32:25 UTC
Begin processing the 72nd record. run: 66006611 subRun: 1 event: 77572 at 20-Jun-2025 17:32:27 UTC
Begin processing the 73rd record. run: 66006611 subRun: 1 event: 77573 at 20-Jun-2025 17:32:30 UTC
Begin processing the 74th record. run: 66006611 subRun: 1 event: 77574 at 20-Jun-2025 17:32:33 UTC
Begin processing the 75th record. run: 66006611 subRun: 1 event: 77575 at 20-Jun-2025 17:32:34 UTC
Begin processing the 76th record. run: 66006611 subRun: 1 event: 77576 at 20-Jun-2025 17:32:36 UTC
Begin processing the 77th record. run: 66006611 subRun: 1 event: 77577 at 20-Jun-2025 17:32:36 UTC
Begin processing the 78th record. run: 66006611 subRun: 1 event: 77578 at 20-Jun-2025 17:32:38 UTC
Begin processing the 79th record. run: 66006611 subRun: 1 event: 77579 at 20-Jun-2025 17:32:40 UTC
Begin processing the 80th record. run: 66006611 subRun: 1 event: 77580 at 20-Jun-2025 17:32:42 UTC
Begin processing the 81st record. run: 66006611 subRun: 1 event: 77581 at 20-Jun-2025 17:32:43 UTC
Begin processing the 82nd record. run: 66006611 subRun: 1 event: 77582 at 20-Jun-2025 17:32:45 UTC
Begin processing the 83rd record. run: 66006611 subRun: 1 event: 77583 at 20-Jun-2025 17:32:46 UTC
Begin processing the 84th record. run: 66006611 subRun: 1 event: 77584 at 20-Jun-2025 17:32:47 UTC
Begin processing the 85th record. run: 66006611 subRun: 1 event: 77585 at 20-Jun-2025 17:32:50 UTC
Begin processing the 86th record. run: 66006611 subRun: 1 event: 77586 at 20-Jun-2025 17:32:51 UTC
Begin processing the 87th record. run: 66006611 subRun: 1 event: 77587 at 20-Jun-2025 17:32:55 UTC
Begin processing the 88th record. run: 66006611 subRun: 1 event: 77588 at 20-Jun-2025 17:32:57 UTC
Begin processing the 89th record. run: 66006611 subRun: 1 event: 77589 at 20-Jun-2025 17:32:58 UTC
Begin processing the 90th record. run: 66006611 subRun: 1 event: 77590 at 20-Jun-2025 17:32:59 UTC
Begin processing the 91st record. run: 66006611 subRun: 1 event: 77591 at 20-Jun-2025 17:33:01 UTC
Begin processing the 92nd record. run: 66006611 subRun: 1 event: 77592 at 20-Jun-2025 17:33:07 UTC
Begin processing the 93rd record. run: 66006611 subRun: 1 event: 77593 at 20-Jun-2025 17:33:09 UTC
Begin processing the 94th record. run: 66006611 subRun: 1 event: 77594 at 20-Jun-2025 17:33:10 UTC
Begin processing the 95th record. run: 66006611 subRun: 1 event: 77595 at 20-Jun-2025 17:33:11 UTC
Begin processing the 96th record. run: 66006611 subRun: 1 event: 77596 at 20-Jun-2025 17:33:13 UTC
Begin processing the 97th record. run: 66006611 subRun: 1 event: 77597 at 20-Jun-2025 17:33:15 UTC
Begin processing the 98th record. run: 66006611 subRun: 1 event: 77598 at 20-Jun-2025 17:33:17 UTC
Begin processing the 99th record. run: 66006611 subRun: 1 event: 77599 at 20-Jun-2025 17:33:18 UTC
Begin processing the 100th record. run: 66006611 subRun: 1 event: 77600 at 20-Jun-2025 17:33:20 UTC
20-Jun-2025 17:33:22 UTC  Closed input file "root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/5c/1e/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006611_775_20231203T050211Z_gen_g4_detsim_hitreco__20240508T072128Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.536255       1.34328       3.73025       1.21533      0.495384        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0280028     0.0522061      0.11284      0.0555511     0.0157695       100    
prod:pandorapid:Chi2ParticleID                 0.164528      0.256143      0.355322      0.266266      0.0400593       100    
prod:energyreconue:EnergyReco                  0.293803      0.628883       1.09347      0.595016      0.150792        100    
prod:energyreconumu:EnergyReco                0.00138881     0.126072      0.938807      0.101046       0.1159         100    
prod:energyreconc:EnergyReco                  0.00309415     0.0400623     0.542046      0.0389368     0.0583232       100    
[art]:TriggerResults:TriggerResultInserter     9.885e-06    1.6136e-05    0.000105689   1.4447e-05    9.61885e-06      100    
end_path:ana:PIDASelectionAna                 0.00287513     0.239358       1.1221       0.0645162     0.290066        100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 36818 MB
  Peak resident set size usage (VmHWM): 1150.46 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
.:
total 64
-rw-r--r-- 1 dune001 dune 25033 Jun 20 17:33 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006611_775_20231203T050211Z_gen_g4_detsim_hitreco__20240508T072128Z_reco2_pida_2025-06-20T_173009Z.root
-rw-r--r-- 1 dune001 dune 14216 Jun 20 17:33 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006611_775_20231203T050211Z_gen_g4_detsim_hitreco__20240508T072128Z_reco2_reco_2025-06-20T_173009Z.log
-rw-r--r-- 1 dune001 dune 11971 Jun 20 17:33 jobscript.log
-rw-r--r-- 1 dune001 dune   187 Jun 20 17:33 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune   138 Jun 20 17:30 all-input-dids.txt
-rw-r--r-- 1 dune001 dune     0 Jun 20 17:30 debugprod.log
justIN time: 2025-08-15 08:46:13 UTC       justIN version: 01.03.02