justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 420720.99@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID420720.99@justin-prod-sched01.dune.hep.ac.uk
Workflow ID7875
Stage ID1
User namehiguera@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-24 10:33:53
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2025-06-24 22:00:52
From worker nodeHostnamewn1904250.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7513 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-24 10:47:06
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74505925_673_20231202T162510Z_gen_g4_detsim_hitreco.root
JobscriptExit code0
Real time11m (697s)
CPU time7m (435s = 62%)
Max RSS bytes1980952576 (1889 MiB)
Outputting started2025-06-24 10:58:43
Output filesusertests:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74505925_673_20231202T162510Z_gen_g4_detsim_hitreco_reco2.root
Finished2025-06-24 22:00:52
Saved logsjustin-logs:420720.99-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
WARNING:  '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory
Justin processors: 1
/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/cdba6e7604dd8b049ed4282aee20b939a4b77fad/atmo_reco2_lbl_model.fcl
Input PFN = root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/52/63/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74505925_673_20231202T162510Z_gen_g4_detsim_hitreco.root
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  24-Jun-2025 11:58:32 BST run: 74505925 subRun: 1 event: 67398
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 1024, 1355, 1176
minwire 0: 952
minwire 1: 1034
minwire 2: 878
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.102277, 0.312118, 0.585605, 
Output 1: 0.116252, 0.494326, 0.300605, 0.0888169, 
Output 2: 0.0467563, 0.197371, 0.453777, 0.302095, 

692
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2625!
Begin processing the 99th record. run: 74505925 subRun: 1 event: 67399 at 24-Jun-2025 11:58:36 BST
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  24-Jun-2025 11:58:37 BST run: 74505925 subRun: 1 event: 67399
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  24-Jun-2025 11:58:37 BST run: 74505925 subRun: 1 event: 67399
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 352, 157, 276
minwire 0: 1627
minwire 1: 568
minwire 2: 1913
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.00417872, 0.383859, 0.611962, 
Output 1: 0.94102, 0.0583667, 0.000563904, 4.9231e-05, 
Output 2: 0.983522, 0.0161592, 0.000292074, 2.70044e-05, 

%MSG-e DUNEAna:  EnergyReco:energyrecnumumcs@BeginModule  24-Jun-2025 11:58:38 BST run: 74505925 subRun: 1 event: 67399
 Failed to find product with label wclsmcnfsp:gauss ... returning empty vector
%MSG
486
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1605!
Begin processing the 100th record. run: 74505925 subRun: 1 event: 67400 at 24-Jun-2025 11:58:40 BST
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  24-Jun-2025 11:58:41 BST run: 74505925 subRun: 1 event: 67400
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e DUNEAna:  EnergyReco:energyrecnumurange@BeginModule  24-Jun-2025 11:58:41 BST run: 74505925 subRun: 1 event: 67400
 Failed to find product with label wclsmcnfsp:gauss ... returning empty vector
%MSG
%MSG-e DUNEAna:  EnergyReco:energyrecnumumcs@BeginModule  24-Jun-2025 11:58:41 BST run: 74505925 subRun: 1 event: 67400
 Failed to find product with label wclsmcnfsp:gauss ... returning empty vector
%MSG
151
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 281!
24-Jun-2025 11:58:42 BST  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74505925_673_20231202T162510Z_gen_g4_detsim_hitreco_reco2.root"
24-Jun-2025 11:58:42 BST  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/52/63/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74505925_673_20231202T162510Z_gen_g4_detsim_hitreco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1.64611       4.42626       43.1252       3.45205       5.1713         100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.022493      0.028193      0.0666321     0.0236021    0.00960549       100    
reco:pandora:StandardPandora                           0.919082       1.86719       32.0952       1.01844       4.16475        100    
reco:pandoraTrack:LArPandoraTrackCreation             8.2646e-05    0.00509712     0.174824     0.000987692    0.0189486       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000126739    0.0126507     0.324288     0.00192798     0.0440733       100    
reco:pandoracalo:Calorimetry                          7.2947e-05     0.0179906     0.531699     0.000779545    0.0721434       100    
reco:pandorapid:Chi2ParticleID                        2.7141e-05    0.000125292   0.000926512   8.5837e-05    0.000131846      100    
reco:cvnmap:CVNMapper                                 1.7042e-05    0.00824846     0.0433523    0.00821037    0.00733357       100    
reco:cvneva:CVNEvaluator                              1.3004e-05     0.239466       1.64346      0.308619      0.199515        100    
reco:energyrecnumu:EnergyReco                          0.0664534      0.15504       2.19109      0.104845      0.236882        100    
reco:energyrecnue:EnergyReco                          0.000152287    0.013589      0.0740181    0.000827786    0.0259469       100    
reco:energyrecnc:EnergyReco                           0.00142271     0.0986087      0.34185      0.119174      0.0606139       100    
reco:energyrecnumurange:EnergyReco                    0.000129383    0.0379478      1.68981     0.000832605    0.184969        100    
reco:energyrecnumumcs:EnergyReco                      8.8998e-05     0.0378267      1.66135     0.00075285     0.182457        100    
reco:opdec:Deconvolution                               0.0904563     0.215607       0.41959      0.217084      0.0624771       100    
reco:ophitspe:OpHitFinderDeco                          0.412426       1.50277       2.71247        1.439       0.599915        100    
reco:opflash:OpFlashFinder                            0.000295154   0.00108008     0.0037439     0.0010236    0.00054444       100    
reco:rns:RandomNumberSaver                            1.7863e-05    3.59477e-05   0.000317467   2.81975e-05   3.22594e-05      100    
reco:anglereconue:NuAngularReco                       0.000130936   0.00123046     0.0461871    0.000302318   0.00487081       100    
reco:anglereconumu:NuAngularReco                      5.4232e-05     0.0010482     0.0441979    0.000164409   0.00469029       100    
reco:anglereconuepfps:NuAngularReco                   8.5621e-05     0.0011733     0.0442049    0.000263611   0.00469163       100    
reco:anglereconumupfps:NuAngularReco                  7.3939e-05    0.00108875     0.044259     0.000198428   0.00469372       100    
[art]:TriggerResults:TriggerResultInserter             8.285e-06    1.15075e-05   4.9533e-05    1.0129e-05    5.11949e-06      100    
end_path:out1:RootOutput                               3.407e-06    6.58574e-06   2.8654e-05     5.485e-06    3.80017e-06      100    
end_path:out1:RootOutput(write)                        0.0164677     0.179247      0.424681      0.210347      0.0992486       100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3649.75 MB
  Peak resident set size usage (VmHWM): 1980.95 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2025-08-14 21:50:49 UTC       justIN version: 01.03.02