Jobsub ID 156649.46@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID	156649.46@justin-prod-sched02.dune.hep.ac.uk
Workflow ID	5475
Stage ID	1
User name	higuera@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-03-07 04:49:17
Site	ES_CIEMAT
Entry	DUNE_T2_ES_CIEMAT_condorce1
Last heartbeat	2025-03-07 05:02:00
From worker node	Hostname	gaew0209.ciemat.es
	cpuinfo	Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	232200 (64 hours)
	GPU
	Inner Apptainer?	True
Job state	stalled
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2025-03-07 05:00:09
Input files	fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6402377_173_20231202T095711Z_gen_g4_detsim_hitreco.root
Outputting started	2025-03-07 05:02:00
Output files
Finished	2025-03-07 05:31:14
List job events Wrapper job log

Jobscript log (last 10,000 characters)

Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/45169c08e824fec56611e2d7afb7427458b57090
printing env
Justin processors: 1
/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/45169c08e824fec56611e2d7afb7427458b57090/atmo_v2_maps.fcl
Input PFN = root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/2b/9a/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6402377_173_20231202T095711Z_gen_g4_detsim_hitreco.root
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
Begin processing the 84th record. run: 6402377 subRun: 1 event: 17384 at 07-Mar-2025 06:01:50 CET
Boundary wire vector sizes: 243, 257, 219
minwire 0: 1585
minwire 1: 842
minwire 2: 1618
Particle counts: 1, 0, 1, 1
Begin processing the 85th record. run: 6402377 subRun: 1 event: 17385 at 07-Mar-2025 06:01:50 CET
Begin processing the 86th record. run: 6402377 subRun: 1 event: 17386 at 07-Mar-2025 06:01:51 CET
Begin processing the 87th record. run: 6402377 subRun: 1 event: 17387 at 07-Mar-2025 06:01:51 CET
Begin processing the 88th record. run: 6402377 subRun: 1 event: 17388 at 07-Mar-2025 06:01:51 CET
Begin processing the 89th record. run: 6402377 subRun: 1 event: 17389 at 07-Mar-2025 06:01:51 CET
Boundary wire vector sizes: 5587, 4802, 2949
minwire 0: 0
minwire 1: 2001
minwire 2: 2
Particle counts: 1, 4, 1, 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 90th record. run: 6402377 subRun: 1 event: 17390 at 07-Mar-2025 06:01:54 CET
Boundary wire vector sizes: 254, 273, 263
minwire 0: 1562
minwire 1: 963
minwire 2: 1259
Particle counts: 1, 0, 0, 0
Begin processing the 91st record. run: 6402377 subRun: 1 event: 17391 at 07-Mar-2025 06:01:55 CET
Boundary wire vector sizes: 137, 160, 115
minwire 0: 1620
minwire 1: 1832
minwire 2: 1097
Particle counts: 1, 0, 1, 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 92nd record. run: 6402377 subRun: 1 event: 17392 at 07-Mar-2025 06:01:55 CET
Begin processing the 93rd record. run: 6402377 subRun: 1 event: 17393 at 07-Mar-2025 06:01:55 CET
Boundary wire vector sizes: 917, 937, 971
minwire 0: 1543
minwire 1: 1125
minwire 2: 1244
Particle counts: 2, 2, 0, 2
Begin processing the 94th record. run: 6402377 subRun: 1 event: 17394 at 07-Mar-2025 06:01:56 CET
Begin processing the 95th record. run: 6402377 subRun: 1 event: 17395 at 07-Mar-2025 06:01:56 CET
Boundary wire vector sizes: 130, 144, 90
minwire 0: 803
minwire 1: 2548
minwire 2: 582
Particle counts: 2, 0, 0, 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 96th record. run: 6402377 subRun: 1 event: 17396 at 07-Mar-2025 06:01:57 CET
Boundary wire vector sizes: 159, 300, 258
minwire 0: 1405
minwire 1: 1919
minwire 2: 994
Particle counts: 2, 0, 0, 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 97th record. run: 6402377 subRun: 1 event: 17397 at 07-Mar-2025 06:01:57 CET
Boundary wire vector sizes: 1758, 1245, 1157
minwire 0: 1060
minwire 1: 1618
minwire 2: 594
Particle counts: 2, 1, 1, 2
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 98th record. run: 6402377 subRun: 1 event: 17398 at 07-Mar-2025 06:01:58 CET
Boundary wire vector sizes: 359, 299, 316
minwire 0: 2428
minwire 1: 722
minwire 2: 2250
Particle counts: 0, 0, 0, 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 99th record. run: 6402377 subRun: 1 event: 17399 at 07-Mar-2025 06:01:59 CET
Begin processing the 100th record. run: 6402377 subRun: 1 event: 17400 at 07-Mar-2025 06:01:59 CET
07-Mar-2025 06:01:59 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/2b/9a/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6402377_173_20231202T095711Z_gen_g4_detsim_hitreco.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.100392      0.215606       1.0092       0.182375       0.14176        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0252273     0.0323749     0.130597      0.0254094     0.0156182       100    
map:cvnmap:CVNMapper                           0.0746884     0.118121      0.717232      0.0961326     0.0762406       100    
[art]:TriggerResults:TriggerResultInserter    2.2775e-05    2.67781e-05   9.4235e-05    2.5402e-05    7.62763e-06      100    
end_path:zlib:CVNZlibMaker                    2.4484e-05     0.0647922     0.607619      0.0485404     0.0818598       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2673.43 MB
  Peak resident set size usage (VmHWM): 1152.91 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0