justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 166774.17@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID166774.17@justin-prod-sched02.dune.hep.ac.uk
Workflow ID5755
Stage ID1
User namewalkerj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes13631488000 (13000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-03-27 15:54:37
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-03-27 16:05:00
From worker nodeHostnamedunegli-4477809-0-fnpc7613.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes13631488000 (13000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-03-27 16:03:02
Input filesusertests:np04_raw_run011655_0001_dl3_reco1_2025-03-27T_120723Z.root
JobscriptExit code0
Real time1m (72s)
CPU time1m (63s = 87%)
Max RSS bytes3477581824 (3316 MiB)
Outputting started2025-03-27 16:04:15
Output filesusertests:np04_raw_run011655_0001_dl3_reco1_2025-03-27T_120723Z_reco2_2025-03-27T_160306Z.root
Finished2025-03-27 16:05:00
Saved logsjustin-logs:166774.17-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Input PFN = root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/fc/2e/np04_raw_run011655_0001_dl3_reco1_2025-03-27T_120723Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/

MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v09_82_00
MRB_QUALS=e26:prof
MRB_TOP=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00
MRB_SOURCE=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/srcs
MRB_BUILDDIR=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof

PRODUCTS=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/exp/dune/app/users/walkerj/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof

local product directory is /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
local product directory is /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e26-p3913-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
34 0
35 0
36 0
37 0
38 0
39 0
40 0
41 0
42 0
43 0
44 0
45 0
46 0
47 0
48 0
49 0
50 0
51 0
52 0
53 0
54 0
55 0
56 0
57 0
58 0
59 0
60 0
61 0
62 0
63 0
64 0
65 0
66 0
67 0
68 0
69 0
70 0
71 0
72 0
73 0
74 0
75 0
76 0
77 0
78 0
79 0
80 0
81 0
82 0
83 0
84 0
85 0
86 0
87 0
88 0
89 0
90 0
91 0
92 0
93 0
94 0
95 0
96 0
97 0
98 0
99 0
27-Mar-2025 16:04:14 UTC  Closed output file "np04_raw_run011655_0001_dl3_reco1_2025-03-27T_120723Z_reco2_2025-03-27T_160306Z.root"
27-Mar-2025 16:04:14 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/fc/2e/np04_raw_run011655_0001_dl3_reco1_2025-03-27T_120723Z.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.0087141     0.0174819     0.0540424     0.0137972     0.0102902       27     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000473084   0.000662736   0.00101951    0.000583978   0.000162873      27     
reco:reco3d:SpacePointSolver                  0.00360108     0.0091263     0.0285468    0.00660406    0.00652541       27     
reco:hitpdune:DisambigFromSpacePoints          0.0018727    0.00296034    0.00864739    0.00256028    0.00136674       27     
[art]:TriggerResults:TriggerResultInserter    1.2069e-05    1.40121e-05   4.0221e-05    1.2701e-05    5.30421e-06      27     
end_path:out1:RootOutput                       1.987e-06    2.66011e-06   1.2753e-05     2.172e-06    2.05225e-06      27     
end_path:out1:RootOutput(write)               0.00242711    0.00442364     0.0156929    0.00361131     0.0025969       27     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 6085.62 MB
  Peak resident set size usage (VmHWM): 3477.58 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 0
ToolBasedRawDigitPrepService:dtor:  Call count: 0
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.00 sec
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   0.00 sec
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.00 sec
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2025-04-03 08:25:27 UTC       justIN version: 01.03.00