justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 92151.179@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID92151.179@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3938
Stage ID1
User nameimawby@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit43200 (12 hours)
Submitted time2024-11-06 16:43:53
SiteUK_Edinburgh
EntryDUNE_UK_SGridECDF_ce1_multicore
Last heartbeat2024-11-06 17:24:45
From worker nodeHostnamenode3a01.ecdf.ed.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 6242 CPU @ 2.80GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statejobscript_error
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-06 16:52:24
Input filesfardet-hd:nutau_dune10kt_1x2x6_1424_676_20230827T144057Z_gen_g4_detsim_hitreco__20240219T182122Z_reco2.root
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Outputting started 
Output files
Finished2024-11-06 17:24:45
Saved logsjustin-logs:92151.179-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

2
daughterClusterListU.size(): 0
daughterClusterListV.size(): 0
daughterClusterListW.size(): 0
daughterClusterListU.size(): 0
daughterClusterListV.size(): 0
daughterClusterListW.size(): 0
daughterClusterListU.size(): 0
daughterClusterListV.size(): 0
daughterClusterListW.size(): 0
                         : Rebuilding Dataset Default
Boundary wire vector sizes: 1501, 1801, 1546
minwire 0: 762
minwire 1: 1854
minwire 2: 429
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0229993, 
Output 1: 0.000204623, 0.990059, 0.00829366, 0.0014423, 
Output 2: 0.00492533, 0.356548, 0.638471, 5.53492e-05, 
Output 3: 0.00161919, 0.998343, 3.67892e-05, 1.23421e-06, 
Output 4: 0.998908, 0.00108244, 9.45142e-06, 1.98004e-07, 
Output 5: 0.012611, 0.979759, 0.0075348, 9.56199e-05, 
Output 6: 0.99956, 0.000395536, 3.83655e-05, 5.74903e-06, 

[2024-11-06 16:53:07.339029 +0000][Debug  ][File              ][ 1399] [0x11be6000@root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/1d/b1/nutau_dune10kt_1x2x6_1424_676_20230827T144057Z_gen_g4_detsim_hitreco__20240219T182122Z_reco2.root?xrdcl.requuid=f757b75e-3263-4e61-a955-9bf1089b1fc1] Sending a read command for handle 0x0 to heplns143.pp.rl.ac.uk:51209
[2024-11-06 16:53:07.339099 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] MsgHandler created: 0x15fd68c0 (message: kXR_read (handle: 0x00000000, offset: 1082693849, size: 170) ).
[2024-11-06 16:53:07.339233 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] Moving MsgHandler: 0x15fd68c0 (message: kXR_read (handle: 0x00000000, offset: 1082693849, size: 170) ) from out-queu to in-queue.
[2024-11-06 16:53:07.353261 +0000][Debug  ][ExDbgMsg          ][ 1399] [msg: 0x16bb43e0] Assigned MsgHandler: 0x15fd68c0.
[2024-11-06 16:53:07.353297 +0000][Debug  ][ExDbgMsg          ][ 1399] [handler: 0x15fd68c0] Removed MsgHandler: 0x15fd68c0 from the in-queue.
[2024-11-06 16:53:07.353420 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] Calling MsgHandler: 0x15fd68c0 (message: kXR_read (handle: 0x00000000, offset: 1082693849, size: 170) ) with status: [SUCCESS] .
[2024-11-06 16:53:07.353458 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] Destroying MsgHandler: 0x15fd68c0.
[2024-11-06 16:53:07.353554 +0000][Debug  ][File              ][ 1399] [0x11be6000@root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/1d/b1/nutau_dune10kt_1x2x6_1424_676_20230827T144057Z_gen_g4_detsim_hitreco__20240219T182122Z_reco2.root?xrdcl.requuid=f757b75e-3263-4e61-a955-9bf1089b1fc1] Sending a read command for handle 0x0 to heplns143.pp.rl.ac.uk:51209
[2024-11-06 16:53:07.353598 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] MsgHandler created: 0x15fd68c0 (message: kXR_read (handle: 0x00000000, offset: 1082694019, size: 176) ).
[2024-11-06 16:53:07.353674 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] Moving MsgHandler: 0x15fd68c0 (message: kXR_read (handle: 0x00000000, offset: 1082694019, size: 176) ) from out-queu to in-queue.
[2024-11-06 16:53:07.367683 +0000][Debug  ][ExDbgMsg          ][ 1399] [msg: 0x178de8b0] Assigned MsgHandler: 0x15fd68c0.
[2024-11-06 16:53:07.367731 +0000][Debug  ][ExDbgMsg          ][ 1399] [handler: 0x15fd68c0] Removed MsgHandler: 0x15fd68c0 from the in-queue.
[2024-11-06 16:53:07.367843 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] Calling MsgHandler: 0x15fd68c0 (message: kXR_read (handle: 0x00000000, offset: 1082694019, size: 176) ) with status: [SUCCESS] .
[2024-11-06 16:53:07.367879 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] Destroying MsgHandler: 0x15fd68c0.
[2024-11-06 16:53:07.368416 +0000][Debug  ][File              ][ 1399] [0x11be6000@root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/1d/b1/nutau_dune10kt_1x2x6_1424_676_20230827T144057Z_gen_g4_detsim_hitreco__20240219T182122Z_reco2.root?xrdcl.requuid=f757b75e-3263-4e61-a955-9bf1089b1fc1] Sending a read command for handle 0x0 to heplns143.pp.rl.ac.uk:51209
[2024-11-06 16:53:07.368468 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] MsgHandler created: 0x15fd68c0 (message: kXR_read (handle: 0x00000000, offset: 9825116, size: 3532734) ).
[2024-11-06 16:53:07.368569 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] Moving MsgHandler: 0x15fd68c0 (message: kXR_read (handle: 0x00000000, offset: 9825116, size: 3532734) ) from out-queu to in-queue.
[2024-11-06 16:53:07.386002 +0000][Debug  ][ExDbgMsg          ][ 1399] [msg: 0x1bd5a010] Assigned MsgHandler: 0x15fd68c0.
[2024-11-06 16:53:07.386055 +0000][Debug  ][ExDbgMsg          ][ 1399] [handler: 0x15fd68c0] Removed MsgHandler: 0x15fd68c0 from the in-queue.
[2024-11-06 16:53:07.485226 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] Calling MsgHandler: 0x15fd68c0 (message: kXR_read (handle: 0x00000000, offset: 9825116, size: 3532734) ) with status: [SUCCESS] .
[2024-11-06 16:53:07.485318 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] Destroying MsgHandler: 0x15fd68c0.
[2024-11-06 16:53:07.532120 +0000][Debug  ][File              ][ 1399] [0x11be6000@root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/1d/b1/nutau_dune10kt_1x2x6_1424_676_20230827T144057Z_gen_g4_detsim_hitreco__20240219T182122Z_reco2.root?xrdcl.requuid=f757b75e-3263-4e61-a955-9bf1089b1fc1] Sending a read command for handle 0x0 to heplns143.pp.rl.ac.uk:51209
[2024-11-06 16:53:07.532204 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] MsgHandler created: 0x15fd68c0 (message: kXR_read (handle: 0x00000000, offset: 172060, size: 131) ).
[2024-11-06 16:53:07.532394 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] Moving MsgHandler: 0x15fd68c0 (message: kXR_read (handle: 0x00000000, offset: 172060, size: 131) ) from out-queu to in-queue.
[2024-11-06 16:53:07.546241 +0000][Debug  ][ExDbgMsg          ][ 1399] [msg: 0x1bdb9af0] Assigned MsgHandler: 0x15fd68c0.
[2024-11-06 16:53:07.546290 +0000][Debug  ][ExDbgMsg          ][ 1399] [handler: 0x15fd68c0] Removed MsgHandler: 0x15fd68c0 from the in-queue.
[2024-11-06 16:53:07.546432 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] Calling MsgHandler: 0x15fd68c0 (message: kXR_read (handle: 0x00000000, offset: 172060, size: 131) ) with status: [SUCCESS] .
[2024-11-06 16:53:07.546503 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] Destroying MsgHandler: 0x15fd68c0.
[2024-11-06 16:53:07.546612 +0000][Debug  ][File              ][ 1399] [0x11be6000@root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/1d/b1/nutau_dune10kt_1x2x6_1424_676_20230827T144057Z_gen_g4_detsim_hitreco__20240219T182122Z_reco2.root?xrdcl.requuid=f757b75e-3263-4e61-a955-9bf1089b1fc1] Sending a read command for handle 0x0 to heplns143.pp.rl.ac.uk:51209
[2024-11-06 16:53:07.546652 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] MsgHandler created: 0x15fd68c0 (message: kXR_read (handle: 0x00000000, offset: 172191, size: 137) ).
[2024-11-06 16:53:07.546755 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] Moving MsgHandler: 0x15fd68c0 (message: kXR_read (handle: 0x00000000, offset: 172191, size: 137) ) from out-queu to in-queue.
[2024-11-06 16:53:07.560793 +0000][Debug  ][ExDbgMsg          ][ 1399] [msg: 0x1bd73320] Assigned MsgHandler: 0x15fd68c0.
[2024-11-06 16:53:07.560842 +0000][Debug  ][ExDbgMsg          ][ 1399] [handler: 0x15fd68c0] Removed MsgHandler: 0x15fd68c0 from the in-queue.
[2024-11-06 16:53:07.560982 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] Calling MsgHandler: 0x15fd68c0 (message: kXR_read (handle: 0x00000000, offset: 172191, size: 137) ) with status: [SUCCESS] .
[2024-11-06 16:53:07.561043 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] Destroying MsgHandler: 0x15fd68c0.
[2024-11-06 16:53:07.561163 +0000][Debug  ][File              ][ 1399] [0x11be6000@root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/1d/b1/nutau_dune10kt_1x2x6_1424_676_20230827T144057Z_gen_g4_detsim_hitreco__20240219T182122Z_reco2.root?xrdcl.requuid=f757b75e-3263-4e61-a955-9bf1089b1fc1] Sending a read command for handle 0x0 to heplns143.pp.rl.ac.uk:51209
[2024-11-06 16:53:07.561218 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] MsgHandler created: 0x15fd68c0 (message: kXR_read (handle: 0x00000000, offset: 43264, size: 5464) ).
[2024-11-06 16:53:07.561308 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] Moving MsgHandler: 0x15fd68c0 (message: kXR_read (handle: 0x00000000, offset: 43264, size: 5464) ) from out-queu to in-queue.
[2024-11-06 16:53:07.575275 +0000][Debug  ][ExDbgMsg          ][ 1399] [msg: 0x1c695260] Assigned MsgHandler: 0x15fd68c0.
[2024-11-06 16:53:07.575319 +0000][Debug  ][ExDbgMsg          ][ 1399] [handler: 0x15fd68c0] Removed MsgHandler: 0x15fd68c0 from the in-queue.
[2024-11-06 16:53:07.575429 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] Calling MsgHandler: 0x15fd68c0 (message: kXR_read (handle: 0x00000000, offset: 43264, size: 5464) ) with status: [SUCCESS] .
[2024-11-06 16:53:07.575473 +0000][Debug  ][ExDbgMsg          ][ 1399] [heplns143.pp.rl.ac.uk:51209] Destroying MsgHandler: 0x15fd68c0.
                         : Rebuilding Dataset Default
                         : Rebuilding Dataset Default
                         : Rebuilding Dataset Default
HT SHOWER: NOT ALL ORIENTATIONS COVERED
terminate called without an active exception
=== End last 100 lines of lar log file ===
justIN time: 2024-11-22 10:41:12 UTC       justIN version: 01.01.09