justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 228629.84@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID228629.84@justin-prod-sched02.dune.hep.ac.uk
Workflow ID7888
Stage ID1
User namepgranger@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit10800 (3 hours)
Submitted time2025-06-24 13:46:29
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce4
Last heartbeat2025-06-24 15:18:48
From worker nodeHostnamen265.dur.scotgrid.ac.uk
cpuinfoAMD EPYC 9534 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-24 13:49:02
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6452759_147_20231207T070810Z_gen_g4_detsim_hitreco__20240510T061158Z_reco2.root
JobscriptExit code0
Real time4m (257s)
CPU time0m (25s = 9%)
Max RSS bytes978579456 (933 MiB)
Outputting started2025-06-24 13:53:20
Output files
Finished2025-06-24 15:18:48
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

dune/73d0f1344195c3d6e1e47487dfd66f4d9029c355

MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v10_08_00
MRB_QUALS=e26:prof
MRB_TOP=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/73d0f1344195c3d6e1e47487dfd66f4d9029c355/pidana
MRB_SOURCE=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/73d0f1344195c3d6e1e47487dfd66f4d9029c355/pidana/srcs
MRB_BUILDDIR=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/73d0f1344195c3d6e1e47487dfd66f4d9029c355/pidana/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/73d0f1344195c3d6e1e47487dfd66f4d9029c355/pidana/localProducts_larsoft_v10_08_00_e26_prof

PRODUCTS=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/73d0f1344195c3d6e1e47487dfd66f4d9029c355/pidana/localProducts_larsoft_v10_08_00_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune/testproducts:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/73d0f1344195c3d6e1e47487dfd66f4d9029c355/pidana/localProducts_larsoft_v10_08_00_e26_prof

local product directory is /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/73d0f1344195c3d6e1e47487dfd66f4d9029c355/pidana/localProducts_larsoft_v10_08_00_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
lar exit code 0
=== Start last 100 lines of lar log file ===
=============== EVENT ID 14750 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14751 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14752 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14753 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14754 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14755 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14756 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14757 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14758 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14759 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14760 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14761 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14762 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14763 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14764 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14765 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14766 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14767 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14768 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14769 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14770 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14771 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14772 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14773 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14774 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14775 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14776 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14777 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14778 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14779 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14780 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14781 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14782 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14783 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14784 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14785 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14786 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14787 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14788 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14789 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14790 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14791 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14792 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14793 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14794 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14795 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14796 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14797 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14798 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14799 == RUN ID 6452759 == SUBRUN ID 1 ================
=============== EVENT ID 14800 == RUN ID 6452759 == SUBRUN ID 1 ================
24-Jun-2025 14:53:20 BST  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/ac/1f/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6452759_147_20231207T070810Z_gen_g4_detsim_hitreco__20240510T061158Z_reco2.root"
24-Jun-2025 14:53:20 BST  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/ac/1f/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6452759_147_20231207T070810Z_gen_g4_detsim_hitreco__20240510T061158Z_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.449609       1.02407       2.07558      0.962861      0.336147        100    
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)             0.0167998     0.0282233     0.191794      0.0265579     0.0186261       100    
end_path:pidtree:PIDAnalysis        0.41592      0.995712       2.0578       0.938974      0.334335        100    
====================================================================================================================

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.449609       1.02407       2.07558      0.962861      0.336147        100    
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)             0.0167998     0.0282233     0.191794      0.0265579     0.0186261       100    
end_path:pidtree:PIDAnalysis        0.41592      0.995712       2.0578       0.938974      0.334335        100    
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 36332.8 MB
  Peak resident set size usage (VmHWM): 978.579 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 36332.8 MB
  Peak resident set size usage (VmHWM): 978.579 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 100 passed = 100 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        100        100          0 pidtree

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 10.184155 Real = 236.093520

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 36332.8 VmHWM = 978.579

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
.:
total 1508
-rw-r--r--. 1 dune001 dune 1469493 Jun 24 14:53 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6452759_147_20231207T070810Z_gen_g4_detsim_hitreco__20240510T061158Z_reco2_ana_2025-06-24T_134906Z.root
-rw-r--r--. 1 dune001 dune   31966 Jun 24 14:53 debug.log
-rw-r--r--. 1 dune001 dune   14306 Jun 24 14:53 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6452759_147_20231207T070810Z_gen_g4_detsim_hitreco__20240510T061158Z_reco2_reco_2025-06-24T_134906Z.log
-rw-r--r--. 1 dune001 dune    9747 Jun 24 14:53 jobscript.log
-rw-r--r--. 1 dune001 dune     198 Jun 24 14:53 justin-processed-pfns.txt
-rw-r--r--. 1 dune001 dune     137 Jun 24 14:49 all-input-dids.txt
justIN time: 2025-08-14 18:51:02 UTC       justIN version: 01.03.02