Jobsub ID 166774.19@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID	166774.19@justin-prod-sched02.dune.hep.ac.uk
Workflow ID	5755
Stage ID	1
User name	walkerj@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	13631488000 (13000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-03-27 15:54:37
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat	2025-03-27 16:04:59
From worker node	Hostname	dunegli-4477862-0-fnpc7517.fnal.gov
	cpuinfo	Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	13631488000 (13000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2025-03-27 16:02:57
Input files	usertests:np04_raw_run011655_0002_dl12_reco1_2025-03-27T_122021Z.root
Jobscript	Exit code	0
	Real time	1m (74s)
	CPU time	1m (63s = 85%)
	Max RSS bytes	3609047040 (3441 MiB)
Outputting started	2025-03-27 16:04:12
Output files	usertests:np04_raw_run011655_0002_dl12_reco1_2025-03-27T_122021Z_reco2_2025-03-27T_160301Z.root
Finished	2025-03-27 16:04:59
Saved logs	justin-logs:166774.19-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events Wrapper job log

Jobscript log (last 10,000 characters)

Input PFN = root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/4e/03/np04_raw_run011655_0002_dl12_reco1_2025-03-27T_122021Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/

MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v09_82_00
MRB_QUALS=e26:prof
MRB_TOP=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00
MRB_SOURCE=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/srcs
MRB_BUILDDIR=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof

PRODUCTS=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/exp/dune/app/users/walkerj/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof

local product directory is /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
local product directory is /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e26-p3913-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
54 0
55 0
56 0
57 0
58 0
59 0
60 0
61 0
62 0
63 0
64 0
65 0
66 0
67 0
68 0
69 0
70 0
71 0
72 0
73 0
74 0
75 0
76 0
77 0
78 0
79 0
80 0
81 0
82 0
83 0
84 0
85 0
86 0
87 0
88 0
89 0
90 0
91 0
92 0
93 0
94 0
95 0
96 0
97 0
98 0
99 0
Begin processing the 27th record. run: 11655 subRun: 1 event: 657 at 27-Mar-2025 16:04:06 UTC
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:1 172 XUs and 111 XVs -> 0 XUVs
C:0 T:2 516 XUs and 624 XVs -> 0 XUVs
C:0 T:5 23 XUs and 53 XVs -> 0 XUVs
C:0 T:6 483 XUs and 866 XVs -> 1 XUVs
C:0 T:9 292 XUs and 58 XVs -> 0 XUVs
C:0 T:10 33 XUs and 0 XVs -> 0 XUVs
1 XUVs total
1 collection wire objects
1 potential space points
Neighbour search...
1 tests to find 0 neighbours
Iterating with no regularization...
Begin: 132.606
0 132.606
Now with regularization...
Begin: 99.9411
0 99.9411
27-Mar-2025 16:04:11 UTC  Closed output file "np04_raw_run011655_0002_dl12_reco1_2025-03-27T_122021Z_reco2_2025-03-27T_160301Z.root"
27-Mar-2025 16:04:11 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/4e/03/np04_raw_run011655_0002_dl12_reco1_2025-03-27T_122021Z.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.0108253     0.0172658     0.0296693     0.0155244    0.00555705       27     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000473914   0.000701017   0.00107348    0.000691941   0.000189417      27     
reco:reco3d:SpacePointSolver                  0.00478135    0.00856751     0.0180483    0.00780772    0.00316861       27     
reco:hitpdune:DisambigFromSpacePoints         0.00201857    0.00301223    0.00549624    0.00268389    0.00094641       27     
[art]:TriggerResults:TriggerResultInserter    1.2007e-05    1.49176e-05   4.3604e-05    1.3317e-05    5.92559e-06      27     
end_path:out1:RootOutput                       2.047e-06    3.34263e-06   1.4751e-05     2.437e-06    2.75359e-06      27     
end_path:out1:RootOutput(write)               0.00236657    0.00465108     0.0082643    0.00405897    0.00182853       27     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 6085.64 MB
  Peak resident set size usage (VmHWM): 3609.05 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 0
ToolBasedRawDigitPrepService:dtor:  Call count: 0
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.00 sec
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   0.00 sec
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.00 sec
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0