justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 410691.175@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID410691.175@justin-prod-sched01.dune.hep.ac.uk
Workflow ID7557
Stage ID1
User namepgranger@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit15000 (4 hours)
Submitted time2025-06-11 09:21:05
SiteCA_SFU
EntryDUNE_CA_SFU_lcg-ce3
Last heartbeat2025-06-11 09:46:40
From worker nodeHostnamecdr2130.int.cedar.computecanada.ca
cpuinfoIntel(R) Xeon(R) Platinum 8260 CPU @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit84598 (23 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-11 09:24:42
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50649927_294_20231208T045104Z_gen_g4_detsim_hitreco__20240510T065353Z_reco2.root
JobscriptExit code0
Real time21m (1298s)
CPU time1m (70s = 5%)
Max RSS bytes1438814208 (1372 MiB)
Outputting started2025-06-11 09:46:22
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pgranger/07557/1/003/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50649927_294_20231208T045104Z_gen_g4_detsim_hitreco__20240510T065353Z_reco2_ana_2025-06-11T_092446Z.root
Finished2025-06-11 09:46:40
Saved logsjustin-logs:410691.175-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

hd/f7/f1/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50649927_294_20231208T045104Z_gen_g4_detsim_hitreco__20240510T065353Z_reco2.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
lar exit code 0
=== Start last 100 lines of lar log file ===
%MSG-w DUNEAna:  NuAngularReco:anglereconumu@BeginModule  11-Jun-2025 02:46:11 PDT run: 50649927 subRun: 1 event: 29500
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconumu@BeginModule  11-Jun-2025 02:46:11 PDT run: 50649927 subRun: 1 event: 29500
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconuepfps@BeginModule  11-Jun-2025 02:46:11 PDT run: 50649927 subRun: 1 event: 29500
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconuepfps@BeginModule  11-Jun-2025 02:46:11 PDT run: 50649927 subRun: 1 event: 29500
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconumupfps@BeginModule  11-Jun-2025 02:46:13 PDT run: 50649927 subRun: 1 event: 29500
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconumupfps@BeginModule  11-Jun-2025 02:46:13 PDT run: 50649927 subRun: 1 event: 29500
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconumupfps@BeginModule  11-Jun-2025 02:46:13 PDT run: 50649927 subRun: 1 event: 29500
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
=============== EVENT ID 29500 == RUN ID 50649927 == SUBRUN ID 1 ================
Number of spacepoints outside fiducial volume: 17
Number of spacepoints outside fiducial volume (pandora): 70
11-Jun-2025 02:46:21 PDT  Closed input file "root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/f7/f1/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50649927_294_20231208T045104Z_gen_g4_detsim_hitreco__20240510T065353Z_reco2.root"
11-Jun-2025 02:46:21 PDT  Closed input file "root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/f7/f1/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50649927_294_20231208T045104Z_gen_g4_detsim_hitreco__20240510T065353Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      4.07079       9.1837        75.1895       8.2298        7.58705        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.133751      0.213503      0.387604      0.209734      0.0716013       100    
prod:energyrecnue:EnergyReco                    1.37488       2.3795        6.36798       2.43974      0.576251        100    
prod:energyrecnumu:EnergyReco                 0.00247939      0.97003       5.02632       1.20421      0.850834        100    
prod:energyrecnumurange:EnergyReco            0.000289861    0.0898867      3.60398     0.00262803     0.434032        100    
prod:energyrecnumumcs:EnergyReco              0.00240466      0.20283       3.63787     0.00791138     0.465176        100    
prod:energyrecnc:EnergyReco                   0.00232585     0.152584       5.2843      0.00280352     0.577303        100    
prod:anglerecohits:NuAngularReco               0.799203      0.844635       1.54305      0.801899      0.124117        100    
prod:anglereconumu:NuAngularReco              0.000206365    0.003417      0.155388     0.000379759    0.0161425       100    
prod:anglereconuepfps:NuAngularReco            0.799029       1.60061       3.37464       1.62425      0.535802        100    
prod:anglereconumupfps:NuAngularReco          0.00027501    0.00363252     0.154511     0.000548628    0.0161187       100    
[art]:TriggerResults:TriggerResultInserter    1.2365e-05    1.53487e-05   6.3443e-05     1.405e-05    5.67531e-06      100    
end_path:analysistree:AtmoAnalysis             0.810753       2.72226       49.111        1.72504       5.08944        100    
================================================================================================================================

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      4.07079       9.1837        75.1895       8.2298        7.58705        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.133751      0.213503      0.387604      0.209734      0.0716013       100    
prod:energyrecnue:EnergyReco                    1.37488       2.3795        6.36798       2.43974      0.576251        100    
prod:energyrecnumu:EnergyReco                 0.00247939      0.97003       5.02632       1.20421      0.850834        100    
prod:energyrecnumurange:EnergyReco            0.000289861    0.0898867      3.60398     0.00262803     0.434032        100    
prod:energyrecnumumcs:EnergyReco              0.00240466      0.20283       3.63787     0.00791138     0.465176        100    
prod:energyrecnc:EnergyReco                   0.00232585     0.152584       5.2843      0.00280352     0.577303        100    
prod:anglerecohits:NuAngularReco               0.799203      0.844635       1.54305      0.801899      0.124117        100    
prod:anglereconumu:NuAngularReco              0.000206365    0.003417      0.155388     0.000379759    0.0161425       100    
prod:anglereconuepfps:NuAngularReco            0.799029       1.60061       3.37464       1.62425      0.535802        100    
prod:anglereconumupfps:NuAngularReco          0.00027501    0.00363252     0.154511     0.000548628    0.0161187       100    
[art]:TriggerResults:TriggerResultInserter    1.2365e-05    1.53487e-05   6.3443e-05     1.405e-05    5.67531e-06      100    
end_path:analysistree:AtmoAnalysis             0.810753       2.72226       49.111        1.72504       5.08944        100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9039.43 MB
  Peak resident set size usage (VmHWM): 1438.81 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9039.43 MB
  Peak resident set size usage (VmHWM): 1438.81 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 100 passed = 100 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        100        100          0 analysistree

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 51.954021 Real = 1272.773892

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 9039.43 VmHWM = 1438.81

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
.:
total 1496
-rw-r--r-- 1 nilic nilic 720195 Jun 11 02:46 debug.log
-rw-r--r-- 1 nilic nilic 713339 Jun 11 02:46 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50649927_294_20231208T045104Z_gen_g4_detsim_hitreco__20240510T065353Z_reco2_reco_2025-06-11T_092446Z.log
-rw-r--r-- 1 nilic nilic  73383 Jun 11 02:46 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50649927_294_20231208T045104Z_gen_g4_detsim_hitreco__20240510T065353Z_reco2_ana_2025-06-11T_092446Z.root
-rw-r--r-- 1 nilic nilic   9440 Jun 11 02:46 jobscript.log
-rw-r--r-- 1 nilic nilic    219 Jun 11 02:46 justin-processed-pfns.txt
-rw-r--r-- 1 nilic nilic    138 Jun 11 02:24 all-input-dids.txt
justIN time: 2025-08-15 03:03:42 UTC       justIN version: 01.03.02