Jobsub ID 152330.39@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID	152330.39@justin-prod-sched02.dune.hep.ac.uk
Workflow ID	5345
Stage ID	1
User name	higuera@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-03-03 01:17:10
Site	CH_UNIBE-LHEP
Entry	OSG_CH_UNIBE_LHEP_ce02
Last heartbeat	2025-03-03 01:28:14
From worker node	Hostname	wn-1-33.local
	cpuinfo	Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	86400 (24 hours)
	GPU
	Inner Apptainer?	True
Job state	stalled
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2025-03-03 01:18:14
Input files	fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6220762_56_20231122T051629Z_gen_g4_detsim_hitreco.root
Outputting started	2025-03-03 01:19:13
Output files
Finished	2025-03-03 02:29:42
List job events Wrapper job log

Jobscript log (last 10,000 characters)

Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/45169c08e824fec56611e2d7afb7427458b57090
printing env
Justin processors: 1
/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/45169c08e824fec56611e2d7afb7427458b57090/atmo_v2_maps.fcl
Input PFN = root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/4b/d0/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6220762_56_20231122T051629Z_gen_g4_detsim_hitreco.root
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
minwire 2: 0
Particle counts: 0, 1, 0, 1
Begin processing the 86th record. run: 6220762 subRun: 1 event: 5686 at 03-Mar-2025 02:19:09 CET
Boundary wire vector sizes: 485, 455, 468
minwire 0: 1012
minwire 1: 1287
minwire 2: 632
Particle counts: 1, 0, 0, 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 87th record. run: 6220762 subRun: 1 event: 5687 at 03-Mar-2025 02:19:09 CET
Boundary wire vector sizes: 64, 79, 65
minwire 0: 2462
minwire 1: 287
minwire 2: 2704
Particle counts: 1, 0, 0, 0
Begin processing the 88th record. run: 6220762 subRun: 1 event: 5688 at 03-Mar-2025 02:19:10 CET
Boundary wire vector sizes: 171, 119, 154
minwire 0: 1573
minwire 1: 726
minwire 2: 1779
Particle counts: 3, 1, 0, 5
Begin processing the 89th record. run: 6220762 subRun: 1 event: 5689 at 03-Mar-2025 02:19:10 CET
Boundary wire vector sizes: 426, 440, 484
minwire 0: 1822
minwire 1: 432
minwire 2: 1573
Particle counts: 1, 0, 0, 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 90th record. run: 6220762 subRun: 1 event: 5690 at 03-Mar-2025 02:19:10 CET
Boundary wire vector sizes: 766, 632, 227
minwire 0: 329
minwire 1: 1843
minwire 2: 0
Particle counts: 0, 1, 1, 2
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 91st record. run: 6220762 subRun: 1 event: 5691 at 03-Mar-2025 02:19:10 CET
Begin processing the 92nd record. run: 6220762 subRun: 1 event: 5692 at 03-Mar-2025 02:19:10 CET
Begin processing the 93rd record. run: 6220762 subRun: 1 event: 5693 at 03-Mar-2025 02:19:11 CET
Begin processing the 94th record. run: 6220762 subRun: 1 event: 5694 at 03-Mar-2025 02:19:11 CET
Boundary wire vector sizes: 163, 134, 138
minwire 0: 2761
minwire 1: 844
minwire 2: 2535
Particle counts: 1, 0, 0, 0
Begin processing the 95th record. run: 6220762 subRun: 1 event: 5695 at 03-Mar-2025 02:19:11 CET
Begin processing the 96th record. run: 6220762 subRun: 1 event: 5696 at 03-Mar-2025 02:19:11 CET
Boundary wire vector sizes: 532, 593, 328
minwire 0: 1354
minwire 1: 1203
minwire 2: 970
Particle counts: 2, 0, 0, 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 97th record. run: 6220762 subRun: 1 event: 5697 at 03-Mar-2025 02:19:11 CET
Begin processing the 98th record. run: 6220762 subRun: 1 event: 5698 at 03-Mar-2025 02:19:11 CET
Begin processing the 99th record. run: 6220762 subRun: 1 event: 5699 at 03-Mar-2025 02:19:11 CET
Boundary wire vector sizes: 137, 133, 78
minwire 0: 1655
minwire 1: 933
minwire 2: 1455
Particle counts: 3, 0, 1, 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 100th record. run: 6220762 subRun: 1 event: 5700 at 03-Mar-2025 02:19:12 CET
Boundary wire vector sizes: 78, 47, 73
minwire 0: 2020
minwire 1: 506
minwire 2: 2334
Particle counts: 1, 0, 0, 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
03-Mar-2025 02:19:12 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/4b/d0/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6220762_56_20231122T051629Z_gen_g4_detsim_hitreco.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.0207751     0.0932659     0.469091      0.0845581     0.0790503       100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.00522448    0.00916664     0.218947     0.00575437     0.0213367       100    
map:cvnmap:CVNMapper                           0.0149709     0.0428304     0.248044      0.0386366     0.0314345       100    
[art]:TriggerResults:TriggerResultInserter    1.2602e-05    1.93806e-05   6.1018e-05    1.84805e-05   5.48032e-06      100    
end_path:zlib:CVNZlibMaker                    1.3371e-05     0.0410054     0.305577      0.0388148     0.0480098       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2743.35 MB
  Peak resident set size usage (VmHWM): 1074.2 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0