justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 167868.80@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID167868.80@justin-prod-sched02.dune.hep.ac.uk
Workflow ID5799
Stage ID1
User namepgranger@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit10800 (3 hours)
Submitted time2025-03-31 17:31:37
SiteUK_Glasgow
EntryCLAS12_T3_UK_ScotGrid_GLA_ce04_scitok
Last heartbeat2025-03-31 17:43:41
From worker nodeHostnamewn-d21-017.beowulf.cluster
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-03-31 17:39:42
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6410210_764_20231203T082425Z_gen_g4_detsim_hitreco__20240508T060603Z_reco2.root
JobscriptExit code0
Real time3m (212s)
CPU time0m (57s = 26%)
Max RSS bytes1287548928 (1227 MiB)
Outputting started2025-03-31 17:43:15
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pgranger/05799/1/005/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6410210_764_20231203T082425Z_gen_g4_detsim_hitreco__20240508T060603Z_reco2_ana_2025-03-31T_173949Z.root
Finished2025-03-31 17:43:41
Saved logsjustin-logs:167868.80-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

trigger_ana/localProducts_larsoft_v10_04_07_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune/testproducts:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/2e65a52f75a809374d0c6186ed903ef86d6f1fff/trigger_ana/localProducts_larsoft_v10_04_07_e26_prof

local product directory is /cvmfs/fifeuser4.opensciencegrid.org/sw/dune/2e65a52f75a809374d0c6186ed903ef86d6f1fff/trigger_ana/localProducts_larsoft_v10_04_07_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
lar exit code 0
=== Start last 100 lines of lar log file ===
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  EnergyReco:energyrecnumurange@BeginModule  31-Mar-2025 18:43:14 BST run: 6410210 subRun: 1 event: 76500
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  EnergyReco:energyrecnumumcs@BeginModule  31-Mar-2025 18:43:14 BST run: 6410210 subRun: 1 event: 76500
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  EnergyReco:energyrecnumumcs@BeginModule  31-Mar-2025 18:43:14 BST run: 6410210 subRun: 1 event: 76500
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  EnergyReco:energyrecnc@BeginModule 31-Mar-2025 18:43:14 BST  run: 6410210 subRun: 1 event: 76500
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  EnergyReco:energyrecnc@BeginModule 31-Mar-2025 18:43:14 BST  run: 6410210 subRun: 1 event: 76500
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglerecohits@BeginModule  31-Mar-2025 18:43:14 BST run: 6410210 subRun: 1 event: 76500
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglerecohits@BeginModule  31-Mar-2025 18:43:14 BST run: 6410210 subRun: 1 event: 76500
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
=============== EVENT ID 76500 == RUN ID 6410210 == SUBRUN ID 1 ================
%MSG-w AtmoAnalysis:  AtmoAnalysis:analysistree@BeginModule  31-Mar-2025 18:43:14 BST run: 6410210 subRun: 1 event: 76500
No TriggerPrimitive found with label 'tpmakerTPC'
%MSG
Number of spacepoints outside fiducial volume: 172
Number of spacepoints outside fiducial volume (pandora): 279
31-Mar-2025 18:43:14 BST  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/3b/3e/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6410210_764_20231203T082425Z_gen_g4_detsim_hitreco__20240508T060603Z_reco2.root"
31-Mar-2025 18:43:14 BST  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/3b/3e/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6410210_764_20231203T082425Z_gen_g4_detsim_hitreco__20240508T060603Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.339374       1.16656       8.08074      0.856809       1.15284        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0127331     0.0363944     0.273559      0.0259039     0.0469481       100    
prod:energyrecnue:EnergyReco                   0.136971      0.338701       1.34577       0.24421       0.20597        100    
prod:energyrecnumu:EnergyReco                 0.00302754     0.159898       1.73299      0.118931      0.244297        100    
prod:energyrecnumurange:EnergyReco            0.000301035    0.0544205      1.53775     0.00328024     0.220984        100    
prod:energyrecnumumcs:EnergyReco              0.00237299     0.0779777      1.65595      0.0257993     0.232517        100    
prod:energyrecnc:EnergyReco                   0.00279795     0.0252005     0.619762     0.00366865     0.0755612       100    
prod:anglerecohits:NuAngularReco               0.0757786     0.0876465     0.407172      0.0790127     0.0352071       100    
[art]:TriggerResults:TriggerResultInserter    1.3005e-05    1.74432e-05   8.3858e-05    1.55495e-05   9.47793e-06      100    
end_path:analysistree:AtmoAnalysis             0.0784046     0.385662       2.56803      0.284563      0.377972        100    
================================================================================================================================

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.339374       1.16656       8.08074      0.856809       1.15284        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0127331     0.0363944     0.273559      0.0259039     0.0469481       100    
prod:energyrecnue:EnergyReco                   0.136971      0.338701       1.34577       0.24421       0.20597        100    
prod:energyrecnumu:EnergyReco                 0.00302754     0.159898       1.73299      0.118931      0.244297        100    
prod:energyrecnumurange:EnergyReco            0.000301035    0.0544205      1.53775     0.00328024     0.220984        100    
prod:energyrecnumumcs:EnergyReco              0.00237299     0.0779777      1.65595      0.0257993     0.232517        100    
prod:energyrecnc:EnergyReco                   0.00279795     0.0252005     0.619762     0.00366865     0.0755612       100    
prod:anglerecohits:NuAngularReco               0.0757786     0.0876465     0.407172      0.0790127     0.0352071       100    
[art]:TriggerResults:TriggerResultInserter    1.3005e-05    1.74432e-05   8.3858e-05    1.55495e-05   9.47793e-06      100    
end_path:analysistree:AtmoAnalysis             0.0784046     0.385662       2.56803      0.284563      0.377972        100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19644.1 MB
  Peak resident set size usage (VmHWM): 1287.55 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19644.1 MB
  Peak resident set size usage (VmHWM): 1287.55 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 100 passed = 100 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        100        100          0 analysistree

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 35.231974 Real = 184.690995

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 19644.1 VmHWM = 1287.55

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
.:
total 1012
-rw-r--r--. 1 dune401 dune 470480 Mar 31 18:43 debug.log
-rw-r--r--. 1 dune401 dune 463855 Mar 31 18:43 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6410210_764_20231203T082425Z_gen_g4_detsim_hitreco__20240508T060603Z_reco2_reco_2025-03-31T_173949Z.log
-rw-r--r--. 1 dune401 dune  76280 Mar 31 18:43 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6410210_764_20231203T082425Z_gen_g4_detsim_hitreco__20240508T060603Z_reco2_ana_2025-03-31T_173949Z.root
-rw-r--r--. 1 dune401 dune  10455 Mar 31 18:43 jobscript.log
-rw-r--r--. 1 dune401 dune    188 Mar 31 18:43 justin-processed-pfns.txt
-rw-r--r--. 1 dune401 dune    137 Mar 31 18:39 all-input-dids.txt
justIN time: 2025-04-03 08:27:37 UTC       justIN version: 01.03.00