Jobsub ID 166774.16@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID	166774.16@justin-prod-sched02.dune.hep.ac.uk
Workflow ID	5755
Stage ID	1
User name	walkerj@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	13631488000 (13000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-03-27 15:54:37
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat	2025-03-27 16:04:41
From worker node	Hostname	dunegli-4477862-0-fnpc7517.fnal.gov
	cpuinfo	Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	13631488000 (13000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2025-03-27 16:02:35
Input files	usertests:np04_raw_run011655_0004_dl4_reco1_2025-03-27T_122033Z.root
Jobscript	Exit code	0
	Real time	1m (78s)
	CPU time	1m (61s = 78%)
	Max RSS bytes	3295428608 (3142 MiB)
Outputting started	2025-03-27 16:03:53
Output files	usertests:np04_raw_run011655_0004_dl4_reco1_2025-03-27T_122033Z_reco2_2025-03-27T_160239Z.root
Finished	2025-03-27 16:04:41
Saved logs	justin-logs:166774.16-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events Wrapper job log

Jobscript log (last 10,000 characters)

Input PFN = root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/bd/bd/np04_raw_run011655_0004_dl4_reco1_2025-03-27T_122033Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/

MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v09_82_00
MRB_QUALS=e26:prof
MRB_TOP=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00
MRB_SOURCE=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/srcs
MRB_BUILDDIR=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof

PRODUCTS=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/exp/dune/app/users/walkerj/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof

local product directory is /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
local product directory is /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e26-p3913-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
56 0
57 0
58 0
59 0
60 0
61 0
62 0
63 0
64 0
65 0
66 0
67 0
68 0
69 0
70 0
71 0
72 0
73 0
74 0
75 0
76 0
77 0
78 0
79 0
80 0
81 0
82 0
83 0
84 0
85 0
86 0
87 0
88 0
89 0
90 0
91 0
92 0
93 0
94 0
95 0
96 0
97 0
98 0
99 0
Begin processing the 27th record. run: 11655 subRun: 1 event: 1290 at 27-Mar-2025 16:03:47 UTC
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:1 188 XUs and 433 XVs -> 0 XUVs
C:0 T:2 808 XUs and 863 XVs -> 1 XUVs
C:0 T:4 25 XUs and 213 XVs -> 0 XUVs
C:0 T:5 274 XUs and 174 XVs -> 0 XUVs
C:0 T:6 322 XUs and 987 XVs -> 0 XUVs
C:0 T:9 79 XUs and 90 XVs -> 0 XUVs
C:0 T:10 31 XUs and 0 XVs -> 0 XUVs
C:0 T:11 100 XUs and 8 XVs -> 0 XUVs
1 XUVs total
1 collection wire objects
1 potential space points
Neighbour search...
1 tests to find 0 neighbours
Iterating with no regularization...
Begin: 325.078
0 325.078
Now with regularization...
Begin: 317.309
0 317.309
27-Mar-2025 16:03:52 UTC  Closed output file "np04_raw_run011655_0004_dl4_reco1_2025-03-27T_122033Z_reco2_2025-03-27T_160239Z.root"
27-Mar-2025 16:03:52 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/bd/bd/np04_raw_run011655_0004_dl4_reco1_2025-03-27T_122033Z.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                    0.00937482     0.015573      0.0265183     0.014663     0.00442061       27     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000535751    0.0008317    0.00151321    0.000717177   0.000273072      27     
reco:reco3d:SpacePointSolver                   0.0037255    0.00765556     0.0131039    0.00704952    0.00254641       27     
reco:hitpdune:DisambigFromSpacePoints         0.00188579     0.0029232    0.00552667    0.00279116    0.000727915      27     
[art]:TriggerResults:TriggerResultInserter    1.1694e-05    1.37822e-05   3.8462e-05    1.2373e-05    4.99627e-06      27     
end_path:out1:RootOutput                       1.935e-06    3.00948e-06   1.3011e-05     2.333e-06    2.08856e-06      27     
end_path:out1:RootOutput(write)                0.0020869    0.00384749    0.00684982    0.00360507    0.00131604       27     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 6085.75 MB
  Peak resident set size usage (VmHWM): 3295.43 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 0
ToolBasedRawDigitPrepService:dtor:  Call count: 0
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.00 sec
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   0.00 sec
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.00 sec
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0