justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 420711.40@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID420711.40@justin-prod-sched01.dune.hep.ac.uk
Workflow ID7875
Stage ID1
User namehiguera@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-24 10:22:38
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2025-06-24 22:51:21
From worker nodeHostnamewn1208240.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-24 10:24:37
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_749_20231202T160947Z_gen_g4_detsim_hitreco.root
JobscriptExit code0
Real time24m (1448s)
CPU time11m (680s = 46%)
Max RSS bytes1955307520 (1864 MiB)
Outputting started2025-06-24 10:48:46
Output filesusertests:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_749_20231202T160947Z_gen_g4_detsim_hitreco_reco2.root
Finished2025-06-24 22:51:21
Saved logsjustin-logs:420711.40-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
Justin processors: 1
/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/cdba6e7604dd8b049ed4282aee20b939a4b77fad/atmo_reco2_lbl_model.fcl
Input PFN = root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/25/0d/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_749_20231202T160947Z_gen_g4_detsim_hitreco.root
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
526
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1906!
Begin processing the 98th record. run: 66004350 subRun: 1 event: 74998 at 24-Jun-2025 11:48:26 BST
Boundary wire vector sizes: 1010, 1190, 605
minwire 0: 687
minwire 1: 2513
minwire 2: 17
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.996992, 0.00054107, 0.00246705, 
Output 1: 0.282424, 0.506587, 0.128158, 0.0828319, 
Output 2: 0.739085, 0.216138, 0.0387238, 0.00605231, 

588
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1991!
Begin processing the 99th record. run: 66004350 subRun: 1 event: 74999 at 24-Jun-2025 11:48:32 BST
Boundary wire vector sizes: 1400, 1171, 1016
minwire 0: 1397
minwire 1: 874
minwire 2: 1309
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.964648, 0.00416661, 0.0311856, 
Output 1: 0.854218, 0.1369, 0.00699414, 0.00188816, 
Output 2: 0.140539, 0.70121, 0.135683, 0.0225675, 

780
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 3172!
Begin processing the 100th record. run: 66004350 subRun: 1 event: 75000 at 24-Jun-2025 11:48:40 BST
Boundary wire vector sizes: 55, 56, 48
minwire 0: 579
minwire 1: 944
minwire 2: 399
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max wires due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.0730981, 0.886472, 0.0404303, 
Output 1: 0.794613, 0.204083, 0.00123053, 7.3155e-05, 
Output 2: 0.985324, 0.0142425, 0.000408529, 2.48174e-05, 

%MSG-e DUNEAna:  EnergyReco:energyrecnumumcs@BeginModule  24-Jun-2025 11:48:42 BST run: 66004350 subRun: 1 event: 75000
 Failed to find product with label wclsmcnfsp:gauss ... returning empty vector
%MSG
380
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1101!
24-Jun-2025 11:48:45 BST  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_749_20231202T160947Z_gen_g4_detsim_hitreco_reco2.root"
24-Jun-2025 11:48:45 BST  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/25/0d/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_749_20231202T160947Z_gen_g4_detsim_hitreco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1.83831       6.76069       146.059       4.50853       14.4949        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0228753     0.0285391     0.070362      0.0244197     0.0094774       100    
reco:pandora:StandardPandora                            1.21791       3.37898       134.111       1.36196       13.4239        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000107994   0.00833511     0.317543     0.00167212     0.0327759       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000159891    0.0156847     0.302232     0.00361638     0.0365822       100    
reco:pandoracalo:Calorimetry                          8.5672e-05     0.0319951      1.25449     0.00155261     0.145193        100    
reco:pandorapid:Chi2ParticleID                        3.2822e-05    0.000153186   0.00200878    0.000102909   0.000222417      100    
reco:cvnmap:CVNMapper                                 2.0599e-05    0.00795755     0.0528396    0.00926054    0.00675961       100    
reco:cvneva:CVNEvaluator                               1.577e-05     0.342003       4.44766      0.368049      0.456883        100    
reco:energyrecnumu:EnergyReco                          0.0662948     0.188191       2.3604       0.129626      0.281888        100    
reco:energyrecnue:EnergyReco                          0.000166102    0.0154257     0.116166     0.00130069     0.0282104       100    
reco:energyrecnc:EnergyReco                           0.00204787     0.109105      0.474689      0.127238      0.0704205       100    
reco:energyrecnumurange:EnergyReco                    0.000141005    0.0639571      2.06138     0.00174165     0.249382        100    
reco:energyrecnumumcs:EnergyReco                      0.00010097     0.0620648      2.08483     0.00172195     0.242599        100    
reco:opdec:Deconvolution                               0.0844847     0.279835      0.564671      0.275402      0.0846201       100    
reco:ophitspe:OpHitFinderDeco                          0.330226       1.96764       4.35624       1.91622      0.788693        100    
reco:opflash:OpFlashFinder                            0.000263496   0.00131102    0.00355126    0.00125873    0.000594458      100    
reco:rns:RandomNumberSaver                             1.585e-05    2.18326e-05    0.0002444     1.865e-05    2.26801e-05      100    
reco:anglereconue:NuAngularReco                       0.000131768   0.00203076     0.0937222    0.000290552   0.00953549       100    
reco:anglereconumu:NuAngularReco                      7.0543e-05    0.00196534     0.097249     0.000191491   0.00988203       100    
reco:anglereconuepfps:NuAngularReco                   0.00010632    0.00205111     0.0959365    0.000288257   0.00975852       100    
reco:anglereconumupfps:NuAngularReco                  9.6422e-05    0.00199325     0.0934536    0.000251603   0.00952455       100    
[art]:TriggerResults:TriggerResultInserter             9.057e-06    1.13649e-05    4.25e-05     1.0029e-05    4.80724e-06      100    
end_path:out1:RootOutput                               2.725e-06    3.4184e-06    1.4828e-05     3.216e-06    1.19606e-06      100    
end_path:out1:RootOutput(write)                        0.0100471      0.25047      0.715008      0.290551      0.141757        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3628.76 MB
  Peak resident set size usage (VmHWM): 1955.31 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2025-08-14 21:52:45 UTC       justIN version: 01.03.02