Jobsub ID 343808.26@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID	343808.26@justin-prod-sched01.dune.hep.ac.uk
Workflow ID	5345
Stage ID	1
User name	higuera@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-03-03 01:23:28
Site	CH_UNIBE-LHEP
Entry	OSG_CH_UNIBE_LHEP_ce02
Last heartbeat	2025-03-03 01:34:38
From worker node	Hostname	wn-1-33.local
	cpuinfo	Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	86400 (24 hours)
	GPU
	Inner Apptainer?	True
Job state	stalled
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2025-03-03 01:33:46
Input files	fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6220954_113_20231122T081043Z_gen_g4_detsim_hitreco.root
Outputting started	2025-03-03 01:34:38
Output files
Finished	2025-03-03 02:23:39
List job events Wrapper job log

Jobscript log (last 10,000 characters)

Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/45169c08e824fec56611e2d7afb7427458b57090
printing env
Justin processors: 1
/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/45169c08e824fec56611e2d7afb7427458b57090/atmo_v2_maps.fcl
Input PFN = root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/56/65/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6220954_113_20231122T081043Z_gen_g4_detsim_hitreco.root
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
minwire 0: 1237
minwire 1: 1283
minwire 2: 1226
Particle counts: 1, 0, 0, 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 89th record. run: 6220954 subRun: 1 event: 11389 at 03-Mar-2025 02:34:34 CET
Boundary wire vector sizes: 126, 180, 141
minwire 0: 495
minwire 1: 2216
minwire 2: 288
Particle counts: 1, 0, 0, 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 90th record. run: 6220954 subRun: 1 event: 11390 at 03-Mar-2025 02:34:34 CET
Boundary wire vector sizes: 185, 242, 254
minwire 0: 753
minwire 1: 2756
minwire 2: 84
Particle counts: 1, 0, 0, 2
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 91st record. run: 6220954 subRun: 1 event: 11391 at 03-Mar-2025 02:34:35 CET
Begin processing the 92nd record. run: 6220954 subRun: 1 event: 11392 at 03-Mar-2025 02:34:35 CET
Boundary wire vector sizes: 1678, 1454, 1389
minwire 0: 794
minwire 1: 837
minwire 2: 503
Particle counts: 1, 2, 1, 0
Begin processing the 93rd record. run: 6220954 subRun: 1 event: 11393 at 03-Mar-2025 02:34:35 CET
Begin processing the 94th record. run: 6220954 subRun: 1 event: 11394 at 03-Mar-2025 02:34:35 CET
Boundary wire vector sizes: 339, 670, 534
minwire 0: 273
minwire 1: 2067
minwire 2: 72
Particle counts: 3, 0, 0, 3
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 95th record. run: 6220954 subRun: 1 event: 11395 at 03-Mar-2025 02:34:35 CET
Boundary wire vector sizes: 154, 58, 108
minwire 0: 123
minwire 1: 2271
minwire 2: 148
Particle counts: 1, 0, 0, 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 96th record. run: 6220954 subRun: 1 event: 11396 at 03-Mar-2025 02:34:36 CET
Begin processing the 97th record. run: 6220954 subRun: 1 event: 11397 at 03-Mar-2025 02:34:36 CET
Boundary wire vector sizes: 245, 201, 182
minwire 0: 714
minwire 1: 2064
minwire 2: 498
Particle counts: 1, 1, 0, 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 98th record. run: 6220954 subRun: 1 event: 11398 at 03-Mar-2025 02:34:36 CET
Boundary wire vector sizes: 310, 275, 269
minwire 0: 1759
minwire 1: 570
minwire 2: 2022
Particle counts: 1, 0, 0, 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 99th record. run: 6220954 subRun: 1 event: 11399 at 03-Mar-2025 02:34:36 CET
Boundary wire vector sizes: 591, 464, 421
minwire 0: 858
minwire 1: 1600
minwire 2: 760
Particle counts: 0, 0, 1, 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 100th record. run: 6220954 subRun: 1 event: 11400 at 03-Mar-2025 02:34:37 CET
03-Mar-2025 02:34:37 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/56/65/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6220954_113_20231122T081043Z_gen_g4_detsim_hitreco.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.019981      0.099989      0.600504      0.0928134     0.0799528       100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0049124    0.00678086     0.0250406    0.00543848    0.00336229       100    
map:cvnmap:CVNMapper                           0.0144611     0.0452556     0.156081      0.0385287     0.0284559       100    
[art]:TriggerResults:TriggerResultInserter    1.1847e-05    2.04465e-05   6.0492e-05    1.9555e-05    5.15933e-06      100    
end_path:zlib:CVNZlibMaker                    1.2383e-05     0.0477024     0.438009      0.0458866     0.0564831       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2504.33 MB
  Peak resident set size usage (VmHWM): 836.784 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0