justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 421595.27@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID421595.27@justin-prod-sched01.dune.hep.ac.uk
Workflow ID7918
Stage ID1
User namepgranger@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit15000 (4 hours)
Submitted time2025-06-25 09:18:14
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2025-06-25 14:41:08
From worker nodeHostnamewn1207091.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-25 12:43:30
Input filesusertests:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65996932_990_20231202T074111Z_gen_g4_detsim_hitreco_reco2.root
JobscriptExit code0
Real time18m (1100s)
CPU time0m (56s = 5%)
Max RSS bytes1245831168 (1188 MiB)
Outputting started2025-06-25 13:01:51
Output files
Finished2025-06-25 14:41:08
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Input PFN = root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/usertests/6c/80/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65996932_990_20231202T074111Z_gen_g4_detsim_hitreco_reco2.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
lar exit code 0
=== Start last 100 lines of lar log file ===
%MSG-w DUNEAna:  NuAngularReco:anglereconumu@BeginModule  25-Jun-2025 14:01:49 BST run: 65996932 subRun: 1 event: 99100
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconumu@BeginModule  25-Jun-2025 14:01:49 BST run: 65996932 subRun: 1 event: 99100
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconuepfps@BeginModule  25-Jun-2025 14:01:49 BST run: 65996932 subRun: 1 event: 99100
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconuepfps@BeginModule  25-Jun-2025 14:01:49 BST run: 65996932 subRun: 1 event: 99100
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconumupfps@BeginModule  25-Jun-2025 14:01:49 BST run: 65996932 subRun: 1 event: 99100
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconumupfps@BeginModule  25-Jun-2025 14:01:49 BST run: 65996932 subRun: 1 event: 99100
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconumupfps@BeginModule  25-Jun-2025 14:01:49 BST run: 65996932 subRun: 1 event: 99100
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
=============== EVENT ID 99100 == RUN ID 65996932 == SUBRUN ID 1 ================
Number of spacepoints outside fiducial volume: 0
Number of spacepoints outside fiducial volume (pandora): 0
25-Jun-2025 14:01:50 BST  Closed input file "root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/usertests/6c/80/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65996932_990_20231202T074111Z_gen_g4_detsim_hitreco_reco2.root"
25-Jun-2025 14:01:50 BST  Closed input file "root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/usertests/6c/80/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65996932_990_20231202T074111Z_gen_g4_detsim_hitreco_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.634042       5.30702       44.0321       3.22558       6.13973        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.00992304     0.543653       9.12373      0.071663       1.2016         100    
prod:energyrecnue:EnergyReco                   0.105317       1.5781        15.5632      0.617671       2.37098        100    
prod:energyrecnumu:EnergyReco                 0.00232187     0.908336       13.5788      0.153707       2.36173        100    
prod:energyrecnumurange:EnergyReco            0.000458155    0.0448512      1.85644     0.00287953     0.221688        100    
prod:energyrecnumumcs:EnergyReco              0.000961925    0.219029       1.97244      0.0196784     0.468776        100    
prod:energyrecnc:EnergyReco                   0.00186715     0.0729737      2.77442     0.00336549      0.29573        100    
prod:anglerecohits:NuAngularReco               0.0531198      0.30357       3.72586      0.086717      0.627864        100    
prod:anglereconumu:NuAngularReco              0.000263817   0.00164944     0.0395713    0.00054042    0.00455374       100    
prod:anglereconuepfps:NuAngularReco            0.0548345     0.567302       8.67301      0.167725       1.09272        100    
prod:anglereconumupfps:NuAngularReco          0.000326186   0.00220885     0.0389984    0.00098256    0.00504849       100    
[art]:TriggerResults:TriggerResultInserter    1.2865e-05    1.92334e-05   0.000110709   1.66515e-05   1.07599e-05      100    
end_path:analysistree:AtmoAnalysis             0.0621333      1.06413       8.15171       0.44725       1.55141        100    
================================================================================================================================

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.634042       5.30702       44.0321       3.22558       6.13973        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.00992304     0.543653       9.12373      0.071663       1.2016         100    
prod:energyrecnue:EnergyReco                   0.105317       1.5781        15.5632      0.617671       2.37098        100    
prod:energyrecnumu:EnergyReco                 0.00232187     0.908336       13.5788      0.153707       2.36173        100    
prod:energyrecnumurange:EnergyReco            0.000458155    0.0448512      1.85644     0.00287953     0.221688        100    
prod:energyrecnumumcs:EnergyReco              0.000961925    0.219029       1.97244      0.0196784     0.468776        100    
prod:energyrecnc:EnergyReco                   0.00186715     0.0729737      2.77442     0.00336549      0.29573        100    
prod:anglerecohits:NuAngularReco               0.0531198      0.30357       3.72586      0.086717      0.627864        100    
prod:anglereconumu:NuAngularReco              0.000263817   0.00164944     0.0395713    0.00054042    0.00455374       100    
prod:anglereconuepfps:NuAngularReco            0.0548345     0.567302       8.67301      0.167725       1.09272        100    
prod:anglereconumupfps:NuAngularReco          0.000326186   0.00220885     0.0389984    0.00098256    0.00504849       100    
[art]:TriggerResults:TriggerResultInserter    1.2865e-05    1.92334e-05   0.000110709   1.66515e-05   1.07599e-05      100    
end_path:analysistree:AtmoAnalysis             0.0621333      1.06413       8.15171       0.44725       1.55141        100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19613 MB
  Peak resident set size usage (VmHWM): 1245.83 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19613 MB
  Peak resident set size usage (VmHWM): 1245.83 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 100 passed = 100 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        100        100          0 analysistree

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 35.601970 Real = 926.943061

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 19613 VmHWM = 1245.83

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
.:
total 1480
-rw-r--r-- 1 dune01 dune01 707829 Jun 25 14:01 debug.log
-rw-r--r-- 1 dune01 dune01 701507 Jun 25 14:01 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65996932_990_20231202T074111Z_gen_g4_detsim_hitreco_reco2_reco_2025-06-25T_124336Z.log
-rw-r--r-- 1 dune01 dune01  71708 Jun 25 14:01 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65996932_990_20231202T074111Z_gen_g4_detsim_hitreco_reco2_ana_2025-06-25T_124336Z.root
-rw-r--r-- 1 dune01 dune01   9320 Jun 25 14:01 jobscript.log
-rw-r--r-- 1 dune01 dune01    182 Jun 25 14:01 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01    120 Jun 25 13:43 all-input-dids.txt
justIN time: 2025-08-14 11:53:53 UTC       justIN version: 01.03.02