Jobsub ID 345680.50@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID	345680.50@justin-prod-sched01.dune.hep.ac.uk
Workflow ID	5445
Stage ID	1
User name	higuera@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-03-06 01:29:23
Site	ES_CIEMAT
Entry	DUNE_T2_ES_CIEMAT_condorce2
Last heartbeat	2025-03-06 01:34:39
From worker node	Hostname	gaew0191.ciemat.es
	cpuinfo	Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	232200 (64 hours)
	GPU
	Inner Apptainer?	True
Job state	outputting_failed
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2025-03-06 01:30:27
Input files	fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50542214_601_20231201T223133Z_gen_g4_detsim_hitreco.root
Jobscript	Exit code	0
	Real time	1m (109s)
	CPU time	0m (55s = 50%)
	Max RSS bytes	1040134144 (991 MiB)
Outputting started	2025-03-06 01:32:17
Output files
Finished	2025-03-06 01:34:39
List job events Wrapper job log

Jobscript log (last 10,000 characters)

Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/45169c08e824fec56611e2d7afb7427458b57090
printing env
Justin processors: 1
/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/45169c08e824fec56611e2d7afb7427458b57090/atmo_v2_maps.fcl
Input PFN = root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/5a/10/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50542214_601_20231201T223133Z_gen_g4_detsim_hitreco.root
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 86th record. run: 50542214 subRun: 1 event: 60186 at 06-Mar-2025 02:32:06 CET
Begin processing the 87th record. run: 50542214 subRun: 1 event: 60187 at 06-Mar-2025 02:32:06 CET
Begin processing the 88th record. run: 50542214 subRun: 1 event: 60188 at 06-Mar-2025 02:32:06 CET
Boundary wire vector sizes: 507, 610, 447
minwire 0: 1514
minwire 1: 591
minwire 2: 1459
Particle counts: 3, 0, 1, 4
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 89th record. run: 50542214 subRun: 1 event: 60189 at 06-Mar-2025 02:32:07 CET
Boundary wire vector sizes: 494, 398, 206
minwire 0: 1595
minwire 1: 390
minwire 2: 1912
Particle counts: 1, 1, 0, 0
Begin processing the 90th record. run: 50542214 subRun: 1 event: 60190 at 06-Mar-2025 02:32:08 CET
Boundary wire vector sizes: 5308, 5719, 2509
minwire 0: 933
minwire 1: 1112
minwire 2: 735
Particle counts: 0, 1, 1, 2
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 91st record. run: 50542214 subRun: 1 event: 60191 at 06-Mar-2025 02:32:12 CET
Begin processing the 92nd record. run: 50542214 subRun: 1 event: 60192 at 06-Mar-2025 02:32:13 CET
Begin processing the 93rd record. run: 50542214 subRun: 1 event: 60193 at 06-Mar-2025 02:32:13 CET
Boundary wire vector sizes: 566, 471, 449
minwire 0: 2062
minwire 1: 984
minwire 2: 1661
Particle counts: 1, 0, 0, 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 94th record. run: 50542214 subRun: 1 event: 60194 at 06-Mar-2025 02:32:13 CET
Boundary wire vector sizes: 763, 924, 511
minwire 0: 718
minwire 1: 1824
minwire 2: 88
Particle counts: 1, 2, 0, 2
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 95th record. run: 50542214 subRun: 1 event: 60195 at 06-Mar-2025 02:32:15 CET
Boundary wire vector sizes: 167, 145, 140
minwire 0: 2353
minwire 1: 745
minwire 2: 2362
Particle counts: 0, 0, 0, 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 96th record. run: 50542214 subRun: 1 event: 60196 at 06-Mar-2025 02:32:15 CET
Begin processing the 97th record. run: 50542214 subRun: 1 event: 60197 at 06-Mar-2025 02:32:15 CET
Boundary wire vector sizes: 42, 52, 49
minwire 0: 1277
minwire 1: 1097
minwire 2: 1292
Particle counts: 0, 0, 0, 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Begin processing the 98th record. run: 50542214 subRun: 1 event: 60198 at 06-Mar-2025 02:32:16 CET
Begin processing the 99th record. run: 50542214 subRun: 1 event: 60199 at 06-Mar-2025 02:32:16 CET
Boundary wire vector sizes: 779, 848, 733
minwire 0: 2789
minwire 1: 576
minwire 2: 2637
Particle counts: 2, 2, 0, 0
Begin processing the 100th record. run: 50542214 subRun: 1 event: 60200 at 06-Mar-2025 02:32:16 CET
Boundary wire vector sizes: 75, 83, 67
minwire 0: 2509
minwire 1: 663
minwire 2: 2216
Particle counts: 1, 0, 0, 6
06-Mar-2025 02:32:17 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/5a/10/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50542214_601_20231201T223133Z_gen_g4_detsim_hitreco.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.0965791     0.204725      0.670289      0.201021      0.115487        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0241795     0.0296432     0.0939047     0.0245756     0.011457        100    
map:cvnmap:CVNMapper                           0.0719781     0.103293      0.250917      0.0931286     0.037686        100    
[art]:TriggerResults:TriggerResultInserter    1.4533e-05    2.3584e-05    6.6043e-05    2.3529e-05    5.28528e-06      100    
end_path:zlib:CVNZlibMaker                    1.9271e-05     0.0715166     0.432445      0.0576227     0.0848546       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2560.31 MB
  Peak resident set size usage (VmHWM): 1040.13 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0