justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 420720.108@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID420720.108@justin-prod-sched01.dune.hep.ac.uk
Workflow ID7875
Stage ID1
User namehiguera@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-24 10:33:53
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2025-06-24 22:28:00
From worker nodeHostnamewn1206081.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-24 10:47:03
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74505925_671_20231202T162509Z_gen_g4_detsim_hitreco.root
JobscriptExit code0
Real time11m (681s)
CPU time7m (436s = 64%)
Max RSS bytes1823490048 (1739 MiB)
Outputting started2025-06-24 10:58:24
Output filesusertests:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74505925_671_20231202T162509Z_gen_g4_detsim_hitreco_reco2.root
Finished2025-06-24 22:28:00
Saved logsjustin-logs:420720.108-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ry
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
Justin processors: 1
/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/cdba6e7604dd8b049ed4282aee20b939a4b77fad/atmo_reco2_lbl_model.fcl
Input PFN = root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/bb/ea/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74505925_671_20231202T162509Z_gen_g4_detsim_hitreco.root
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
Boundary wire vector sizes: 62, 44, 41
minwire 0: 363
minwire 1: 2584
minwire 2: 4
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.00339596, 0.99301, 0.00359454, 
Output 1: 0.483549, 0.505626, 0.0100887, 0.000736177, 
Output 2: 0.997095, 0.00281641, 8.31831e-05, 5.20911e-06, 

%MSG-e DUNEAna:  EnergyReco:energyrecnumumcs@BeginModule  24-Jun-2025 11:58:08 BST run: 74505925 subRun: 1 event: 67198
 Failed to find product with label wclsmcnfsp:gauss ... returning empty vector
%MSG
252
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 576!
Begin processing the 99th record. run: 74505925 subRun: 1 event: 67199 at 24-Jun-2025 11:58:10 BST
Boundary wire vector sizes: 1299, 1120, 1111
minwire 0: 750
minwire 1: 1215
minwire 2: 449
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.000944152, 0.99684, 0.00221567, 
Output 1: 0.0621744, 0.578467, 0.336689, 0.0226704, 
Output 2: 0.0432814, 0.608182, 0.332944, 0.0155928, 

%MSG-e DUNEAna:  EnergyReco:energyrecnumumcs@BeginModule  24-Jun-2025 11:58:13 BST run: 74505925 subRun: 1 event: 67199
 Failed to find product with label wclsmcnfsp:gauss ... returning empty vector
%MSG
724
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2826!
Begin processing the 100th record. run: 74505925 subRun: 1 event: 67200 at 24-Jun-2025 11:58:17 BST
Boundary wire vector sizes: 168, 143, 157
minwire 0: 1214
minwire 1: 1770
minwire 2: 1080
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.000255277, 0.998349, 0.00139569, 
Output 1: 0.00339967, 0.992363, 0.00410604, 0.000131088, 
Output 2: 0.998086, 0.00186295, 4.96979e-05, 1.57734e-06, 

%MSG-e DUNEAna:  EnergyReco:energyrecnumumcs@BeginModule  24-Jun-2025 11:58:20 BST run: 74505925 subRun: 1 event: 67200
 Failed to find product with label wclsmcnfsp:gauss ... returning empty vector
%MSG
513
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1736!
24-Jun-2025 11:58:23 BST  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74505925_671_20231202T162509Z_gen_g4_detsim_hitreco_reco2.root"
24-Jun-2025 11:58:23 BST  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/bb/ea/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74505925_671_20231202T162509Z_gen_g4_detsim_hitreco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.540561       4.35482       12.1017       4.02662       1.77839        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0223379     0.027184      0.0611837     0.022993     0.00926562       100    
reco:pandora:StandardPandora                           0.138823       1.53654       7.41322       1.32478      0.761767        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000106581   0.00306134     0.0357996     0.0007224    0.00570112       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000150945    0.0114247     0.199686     0.00206076     0.0301815       100    
reco:pandoracalo:Calorimetry                          8.3998e-05    0.00672289      0.15232     0.000546567    0.0197681       100    
reco:pandorapid:Chi2ParticleID                        3.2371e-05    0.000117536   0.00123881    8.77855e-05   0.000128883      100    
reco:cvnmap:CVNMapper                                 1.6932e-05    0.00674733     0.0199028    0.00890738    0.00494403       100    
reco:cvneva:CVNEvaluator                              1.4818e-05     0.289593       2.11813      0.363558      0.268908        100    
reco:energyrecnumu:EnergyReco                          0.0660095     0.142341       1.49475      0.0971016      0.17518        100    
reco:energyrecnue:EnergyReco                          0.000135025    0.0132866     0.0874711    0.000839324    0.0259298       100    
reco:energyrecnc:EnergyReco                           0.00199625     0.103218       0.20558      0.124778      0.0579392       100    
reco:energyrecnumurange:EnergyReco                    0.000138001    0.0342631      1.22452     0.000809207    0.147489        100    
reco:energyrecnumumcs:EnergyReco                      9.8435e-05      0.03498       1.24491     0.000811267    0.150222        100    
reco:opdec:Deconvolution                               0.0696596     0.250195      0.575583      0.246588      0.0789897       100    
reco:ophitspe:OpHitFinderDeco                          0.200973       1.6766        3.37591       1.57669      0.662452        100    
reco:opflash:OpFlashFinder                            0.000125547   0.00104817    0.00379719    0.000978062   0.00050948       100    
reco:rns:RandomNumberSaver                            1.6601e-05    2.12094e-05   0.000240865   1.8335e-05    2.2345e-05       100    
reco:anglereconue:NuAngularReco                       0.000126229   0.000639791    0.0102402    0.000215442   0.00135872       100    
reco:anglereconumu:NuAngularReco                      6.2668e-05    0.000551682    0.0101354    0.000132926   0.00136362       100    
reco:anglereconuepfps:NuAngularReco                   0.00010038    0.000645848    0.010209     0.00021955    0.00137216       100    
reco:anglereconumupfps:NuAngularReco                  8.8908e-05    0.00060117     0.0100742    0.000183151   0.00136881       100    
[art]:TriggerResults:TriggerResultInserter             8.597e-06    1.0587e-05    4.5355e-05     9.624e-06    4.93526e-06      100    
end_path:out1:RootOutput                               2.605e-06    3.31925e-06   1.4798e-05     3.186e-06    1.18728e-06      100    
end_path:out1:RootOutput(write)                       0.00348406     0.214112       0.42905       0.26323      0.123252        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3582.08 MB
  Peak resident set size usage (VmHWM): 1823.49 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2025-08-15 06:44:31 UTC       justIN version: 01.03.02