justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 348041.105@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID348041.105@justin-prod-sched01.dune.hep.ac.uk
Workflow ID5470
Stage ID1
User namehiguera@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-03-07 00:49:52
SiteIT_CNAF
EntryCMSHTPC_T1_IT_CNAF_condor_ce02
Last heartbeat2025-03-07 05:47:16
From worker nodeHostnamewn-s04-05-30-03.cr.cnaf.infn.it
cpuinfoAMD EPYC 7313 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-03-07 03:07:01
Input filesmonte-carlo-005470-004459
JobscriptExit code0
Real time2h (9490s)
CPU time2h (9251s = 97%)
Max RSS bytes1926840320 (1837 MiB)
Outputting started2025-03-07 05:45:11
Output filesfardet-hd:prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250307T030704Z_gen_004459_supernova_g4_halfActiveVol_detsim_reco.root
Finished2025-03-07 05:47:16
Saved logsjustin-logs:348041.105-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

s and 6 XVs -> 2 XUVs
C:0 T:17 12 XUs and 10 XVs -> 7 XUVs
C:0 T:19 7 XUs and 7 XVs -> 3 XUVs
C:0 T:21 10 XUs and 5 XVs -> 3 XUVs
C:0 T:23 15 XUs and 18 XVs -> 11 XUVs
81 XUVs total
61 collection wire objects
81 potential space points
Neighbour search...
153 tests to find 72 neighbours
Iterating with no regularization...
Begin: 222796
0 182346
1 182073
2 182069
Now with regularization...
Begin: 125845
0 125840
Begin processing the 44th record. run: 5470 subRun: 0 event: 222944 at 07-Mar-2025 06:45:05 CET
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 24 XUs and 24 XVs -> 11 XUVs
C:0 T:3 25 XUs and 29 XVs -> 14 XUVs
C:0 T:5 9 XUs and 11 XVs -> 7 XUVs
C:0 T:7 8 XUs and 6 XVs -> 5 XUVs
C:0 T:9 16 XUs and 13 XVs -> 11 XUVs
C:0 T:11 18 XUs and 17 XVs -> 9 XUVs
C:0 T:13 37 XUs and 31 XVs -> 18 XUVs
C:0 T:15 6 XUs and 10 XVs -> 4 XUVs
C:0 T:17 2 XUs and 2 XVs -> 2 XUVs
C:0 T:19 2 XUs and 0 XVs -> 0 XUVs
C:0 T:21 22 XUs and 27 XVs -> 12 XUVs
C:0 T:23 16 XUs and 16 XVs -> 9 XUVs
102 XUVs total
78 collection wire objects
102 potential space points
Neighbour search...
212 tests to find 110 neighbours
Iterating with no regularization...
Begin: 366670
0 326860
1 326787
Now with regularization...
Begin: 247683
0 247673
Begin processing the 45th record. run: 5470 subRun: 0 event: 222945 at 07-Mar-2025 06:45:06 CET
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 19 XUs and 21 XVs -> 13 XUVs
C:0 T:3 12 XUs and 11 XVs -> 7 XUVs
C:0 T:5 9 XUs and 10 XVs -> 6 XUVs
C:0 T:7 12 XUs and 11 XVs -> 7 XUVs
C:0 T:9 13 XUs and 16 XVs -> 8 XUVs
C:0 T:11 7 XUs and 7 XVs -> 5 XUVs
C:0 T:13 6 XUs and 5 XVs -> 4 XUVs
C:0 T:15 9 XUs and 10 XVs -> 6 XUVs
C:0 T:17 6 XUs and 8 XVs -> 4 XUVs
C:0 T:19 10 XUs and 11 XVs -> 5 XUVs
C:0 T:21 9 XUs and 10 XVs -> 6 XUVs
C:0 T:23 8 XUs and 12 XVs -> 4 XUVs
75 XUVs total
59 collection wire objects
75 potential space points
Neighbour search...
137 tests to find 62 neighbours
Iterating with no regularization...
Begin: 239694
0 223158
1 223158
Now with regularization...
Begin: 169812
0 169811
Begin processing the 46th record. run: 5470 subRun: 0 event: 222946 at 07-Mar-2025 06:45:06 CET
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 28 XUs and 31 XVs -> 20 XUVs
C:0 T:3 17 XUs and 23 XVs -> 12 XUVs
C:0 T:5 8 XUs and 9 XVs -> 5 XUVs
C:0 T:7 6 XUs and 9 XVs -> 4 XUVs
C:0 T:9 9 XUs and 10 XVs -> 6 XUVs
C:0 T:11 13 XUs and 12 XVs -> 4 XUVs
C:0 T:13 8 XUs and 8 XVs -> 6 XUVs
C:0 T:15 17 XUs and 16 XVs -> 10 XUVs
C:0 T:17 5 XUs and 5 XVs -> 2 XUVs
C:0 T:19 5 XUs and 9 XVs -> 2 XUVs
C:0 T:21 17 XUs and 15 XVs -> 10 XUVs
C:0 T:23 37 XUs and 42 XVs -> 21 XUVs
102 XUVs total
76 collection wire objects
102 potential space points
Neighbour search...
224 tests to find 122 neighbours
Iterating with no regularization...
Begin: 329721
0 290949
1 288930
2 288787
Now with regularization...
Begin: 211099
0 211083
Begin processing the 47th record. run: 5470 subRun: 0 event: 222947 at 07-Mar-2025 06:45:06 CET
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 19 XUs and 24 XVs -> 9 XUVs
C:0 T:3 11 XUs and 8 XVs -> 8 XUVs
C:0 T:5 16 XUs and 16 XVs -> 8 XUVs
C:0 T:7 15 XUs and 17 XVs -> 11 XUVs
C:0 T:9 12 XUs and 11 XVs -> 7 XUVs
C:0 T:11 10 XUs and 14 XVs -> 6 XUVs
C:0 T:13 5 XUs and 5 XVs -> 4 XUVs
C:0 T:15 19 XUs and 17 XVs -> 14 XUVs
C:0 T:17 13 XUs and 16 XVs -> 7 XUVs
C:0 T:19 17 XUs and 14 XVs -> 8 XUVs
C:0 T:21 29 XUs and 26 XVs -> 16 XUVs
C:0 T:23 11 XUs and 16 XVs -> 6 XUVs
104 XUVs total
81 collection wire objects
104 potential space points
Neighbour search...
208 tests to find 102 neighbours
Iterating with no regularization...
Begin: 318159
0 283950
1 283943
Now with regularization...
Begin: 210965
0 210960
Begin processing the 48th record. run: 5470 subRun: 0 event: 222948 at 07-Mar-2025 06:45:06 CET
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 36 XUs and 36 XVs -> 19 XUVs
C:0 T:3 14 XUs and 16 XVs -> 6 XUVs
C:0 T:5 12 XUs and 13 XVs -> 9 XUVs
C:0 T:7 13 XUs and 12 XVs -> 7 XUVs
C:0 T:9 7 XUs and 9 XVs -> 6 XUVs
C:0 T:11 6 XUs and 6 XVs -> 3 XUVs
C:0 T:13 16 XUs and 13 XVs -> 9 XUVs
C:0 T:15 9 XUs and 11 XVs -> 7 XUVs
C:0 T:17 7 XUs and 7 XVs -> 4 XUVs
C:0 T:19 4 XUs and 5 XVs -> 4 XUVs
C:0 T:21 24 XUs and 27 XVs -> 13 XUVs
C:0 T:23 27 XUs and 28 XVs -> 15 XUVs
102 XUVs total
76 collection wire objects
102 potential space points
Neighbour search...
210 tests to find 108 neighbours
Iterating with no regularization...
Begin: 274511
0 242654
1 242518
Now with regularization...
Begin: 171607
0 171601
Begin processing the 49th record. run: 5470 subRun: 0 event: 222949 at 07-Mar-2025 06:45:06 CET
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 33 XUs and 32 XVs -> 22 XUVs
C:0 T:3 18 XUs and 21 XVs -> 11 XUVs
C:0 T:5 4 XUs and 4 XVs -> 2 XUVs
C:0 T:7 9 XUs and 12 XVs -> 4 XUVs
C:0 T:9 8 XUs and 8 XVs -> 6 XUVs
C:0 T:11 9 XUs and 12 XVs -> 5 XUVs
C:0 T:13 8 XUs and 12 XVs -> 5 XUVs
C:0 T:15 19 XUs and 14 XVs -> 11 XUVs
C:0 T:17 11 XUs and 7 XVs -> 5 XUVs
C:0 T:19 10 XUs and 10 XVs -> 6 XUVs
C:0 T:21 13 XUs and 15 XVs -> 9 XUVs
C:0 T:23 25 XUs and 21 XVs -> 13 XUVs
99 XUVs total
76 collection wire objects
99 potential space points
Neighbour search...
215 tests to find 114 neighbours
Iterating with no regularization...
Begin: 272749
0 242241
1 242184
Now with regularization...
Begin: 177524
0 177509
Begin processing the 50th record. run: 5470 subRun: 0 event: 222950 at 07-Mar-2025 06:45:07 CET
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 18 XUs and 18 XVs -> 12 XUVs
C:0 T:3 47 XUs and 38 XVs -> 29 XUVs
C:0 T:5 9 XUs and 11 XVs -> 8 XUVs
C:0 T:7 19 XUs and 24 XVs -> 12 XUVs
C:0 T:9 4 XUs and 4 XVs -> 3 XUVs
C:0 T:11 6 XUs and 6 XVs -> 3 XUVs
C:0 T:13 4 XUs and 2 XVs -> 1 XUVs
C:0 T:15 8 XUs and 9 XVs -> 4 XUVs
C:0 T:17 17 XUs and 18 XVs -> 14 XUVs
C:0 T:19 12 XUs and 15 XVs -> 9 XUVs
C:0 T:21 22 XUs and 30 XVs -> 12 XUVs
C:0 T:23 23 XUs and 30 XVs -> 18 XUVs
125 XUVs total
89 collection wire objects
125 potential space points
Neighbour search...
299 tests to find 164 neighbours
Iterating with no regularization...
Begin: 391390
0 336467
1 336309
Now with regularization...
Begin: 245597
0 245581
07-Mar-2025 06:45:07 CET  Closed output file "prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250307T030704Z_gen_004459_supernova_g4_halfActiveVol_detsim_reco.root"
07-Mar-2025 06:45:07 CET  Closed input file "prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250307T030704Z_gen_004459_supernova_g4_halfActiveVol_detsim.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.020188      0.0224433     0.0343762     0.0221364    0.00219088       50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.00021847    0.000308559   0.00072467    0.000290335   7.53033e-05      50     
reco:gaushit:GausHitFinder                     0.0150849     0.0162535     0.0203259     0.0159982    0.00107272       50     
reco:spsolve:SpacePointSolver                  0.0011413    0.00155102    0.00524853    0.00145618    0.000561458      50     
reco:hitfd:DisambigFromSpacePoints            0.000373961   0.000480043   0.00183948    0.000450254   0.000200465      50     
reco:rns:RandomNumberSaver                    1.1081e-05    1.52216e-05   0.00010683    1.30645e-05   1.31567e-05      50     
[art]:TriggerResults:TriggerResultInserter     6.362e-06    8.33084e-06   2.9776e-05     7.219e-06    3.98215e-06      50     
end_path:out1:RootOutput                       2.264e-06    7.02914e-06   0.00019733    2.8655e-06    2.72505e-05      50     
end_path:out1:RootOutput(write)               0.00275256    0.00365417    0.00545823    0.00359954    0.000528635      50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1773.74 MB
  Peak resident set size usage (VmHWM): 890.958 MB
====================================================================================================
Art has completed and will exit with status 0.
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250307T030704Z_gen_004459.root 109917714
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250307T030704Z_gen_004459_supernova_g4_halfActiveVol.root 718355865
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250307T030704Z_gen_004459_supernova_g4_halfActiveVol_detsim.root 1826294703
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250307T030704Z_gen_004459_supernova_g4_halfActiveVol_detsim_hist.root 12750
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250307T030704Z_gen_004459_supernova_g4_halfActiveVol_detsim_reco.root 1829679031
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250307T030704Z_gen_004459_supernova_g4_halfActiveVol_detsim_reco.root.ext.json 1607
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250307T030704Z_gen_004459_supernova_g4_halfActiveVol_detsim_reco.root.json 1837
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250307T030704Z_gen_004459_supernova_g4_halfActiveVol_detsim_reco.root.temp.json 1837
justIN time: 2025-04-03 07:59:54 UTC       justIN version: 01.03.00