21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 423630.0@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 423630.0@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 7977 | |
| Stage ID | 1 | |
| User name | imawby@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 43200 (12 hours) | |
| Submitted time | 2025-06-27 12:01:05 | |
| Site | UK_Edinburgh | |
| Entry | DUNE_UK_SGridECDF_ce1 | |
| Last heartbeat | 2025-06-27 12:16:05 | |
| From worker node | Hostname | node2b05.ecdf.ed.ac.uk |
| cpuinfo | Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-06-27 12:02:51 | |
| Input files | fardet-hd:nu_dune10kt_1x2x6_1410_136_20230826T123317Z_gen_g4_detsim_hitreco__20240229T194302Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 12m (776s) | |
| CPU time | 10m (627s = 80%) | |
| Max RSS bytes | 1510203392 (1440 MiB) | |
| Outputting started | 2025-06-27 12:15:47 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/splitting_nu_0/07977/1/001/HierarchyRecoPerformance_nu_dune10kt_1x2x6_1410_136_20230826T123317Z_gen_g4_detsim_hitreco__20240229T194302Z_reco2.root | |
| Finished | 2025-06-27 12:16:05 | |
| Saved logs | justin-logs:423630.0-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
k:51795] Calling MsgHandler: 0x1926f600 (message: kXR_read (handle: 0x00000000, offset: 1480870398, size: 690) ) with status: [SUCCESS] . [2025-06-27 13:15:44.792302 +0100][Debug ][ExDbgMsg ][ 1305] [heplns144.pp.rl.ac.uk:51795] Destroying MsgHandler: 0x1926f600. [2025-06-27 13:15:44.799794 +0100][Debug ][File ][ 1305] [0x9af3f70@root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/ee/9b/nu_dune10kt_1x2x6_1410_136_20230826T123317Z_gen_g4_detsim_hitreco__20240229T194302Z_reco2.root?xrdcl.requuid=fbe8a622-f3a7-4724-9e78-12f701e17e4e] Sending a read command for handle 0x0 to heplns144.pp.rl.ac.uk:51795 [2025-06-27 13:15:44.799841 +0100][Debug ][ExDbgMsg ][ 1305] [heplns144.pp.rl.ac.uk:51795] MsgHandler created: 0x150727a0 (message: kXR_read (handle: 0x00000000, offset: 175099, size: 132) ). [2025-06-27 13:15:44.799909 +0100][Debug ][ExDbgMsg ][ 1305] [heplns144.pp.rl.ac.uk:51795] Moving MsgHandler: 0x150727a0 (message: kXR_read (handle: 0x00000000, offset: 175099, size: 132) ) from out-queu to in-queue. [2025-06-27 13:15:44.813671 +0100][Debug ][ExDbgMsg ][ 1305] [msg: 0x13a37030] Assigned MsgHandler: 0x150727a0. [2025-06-27 13:15:44.813715 +0100][Debug ][ExDbgMsg ][ 1305] [handler: 0x150727a0] Removed MsgHandler: 0x150727a0 from the in-queue. [2025-06-27 13:15:44.813754 +0100][Debug ][ExDbgMsg ][ 1305] [heplns144.pp.rl.ac.uk:51795] Calling MsgHandler: 0x150727a0 (message: kXR_read (handle: 0x00000000, offset: 175099, size: 132) ) with status: [SUCCESS] . [2025-06-27 13:15:44.813773 +0100][Debug ][ExDbgMsg ][ 1305] [heplns144.pp.rl.ac.uk:51795] Destroying MsgHandler: 0x150727a0. [2025-06-27 13:15:44.813837 +0100][Debug ][File ][ 1305] [0x9af3f70@root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/ee/9b/nu_dune10kt_1x2x6_1410_136_20230826T123317Z_gen_g4_detsim_hitreco__20240229T194302Z_reco2.root?xrdcl.requuid=fbe8a622-f3a7-4724-9e78-12f701e17e4e] Sending a read command for handle 0x0 to heplns144.pp.rl.ac.uk:51795 [2025-06-27 13:15:44.813861 +0100][Debug ][ExDbgMsg ][ 1305] [heplns144.pp.rl.ac.uk:51795] MsgHandler created: 0x150727a0 (message: kXR_read (handle: 0x00000000, offset: 175231, size: 138) ). [2025-06-27 13:15:44.813924 +0100][Debug ][ExDbgMsg ][ 1305] [heplns144.pp.rl.ac.uk:51795] Moving MsgHandler: 0x150727a0 (message: kXR_read (handle: 0x00000000, offset: 175231, size: 138) ) from out-queu to in-queue. [2025-06-27 13:15:44.827714 +0100][Debug ][ExDbgMsg ][ 1305] [msg: 0xc25f910] Assigned MsgHandler: 0x150727a0. [2025-06-27 13:15:44.827755 +0100][Debug ][ExDbgMsg ][ 1305] [handler: 0x150727a0] Removed MsgHandler: 0x150727a0 from the in-queue. [2025-06-27 13:15:44.827790 +0100][Debug ][ExDbgMsg ][ 1305] [heplns144.pp.rl.ac.uk:51795] Calling MsgHandler: 0x150727a0 (message: kXR_read (handle: 0x00000000, offset: 175231, size: 138) ) with status: [SUCCESS] . [2025-06-27 13:15:44.827810 +0100][Debug ][ExDbgMsg ][ 1305] [heplns144.pp.rl.ac.uk:51795] Destroying MsgHandler: 0x150727a0. [2025-06-27 13:15:44.827880 +0100][Debug ][File ][ 1305] [0x9af3f70@root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/ee/9b/nu_dune10kt_1x2x6_1410_136_20230826T123317Z_gen_g4_detsim_hitreco__20240229T194302Z_reco2.root?xrdcl.requuid=fbe8a622-f3a7-4724-9e78-12f701e17e4e] Sending a read command for handle 0x0 to heplns144.pp.rl.ac.uk:51795 [2025-06-27 13:15:44.827904 +0100][Debug ][ExDbgMsg ][ 1305] [heplns144.pp.rl.ac.uk:51795] MsgHandler created: 0x150727a0 (message: kXR_read (handle: 0x00000000, offset: 166537, size: 1893) ). [2025-06-27 13:15:44.827954 +0100][Debug ][ExDbgMsg ][ 1305] [heplns144.pp.rl.ac.uk:51795] Moving MsgHandler: 0x150727a0 (message: kXR_read (handle: 0x00000000, offset: 166537, size: 1893) ) from out-queu to in-queue. [2025-06-27 13:15:44.841760 +0100][Debug ][ExDbgMsg ][ 1305] [msg: 0x28306190] Assigned MsgHandler: 0x150727a0. [2025-06-27 13:15:44.841796 +0100][Debug ][ExDbgMsg ][ 1305] [handler: 0x150727a0] Removed MsgHandler: 0x150727a0 from the in-queue. [2025-06-27 13:15:44.841831 +0100][Debug ][ExDbgMsg ][ 1305] [heplns144.pp.rl.ac.uk:51795] Calling MsgHandler: 0x150727a0 (message: kXR_read (handle: 0x00000000, offset: 166537, size: 1893) ) with status: [SUCCESS] . [2025-06-27 13:15:44.841850 +0100][Debug ][ExDbgMsg ][ 1305] [heplns144.pp.rl.ac.uk:51795] Destroying MsgHandler: 0x150727a0. 27-Jun-2025 13:15:47 BST Closed output file "nu_dune10kt_1x2x6_1410_136_20230826T123317Z_gen_g4_detsim_hitreco__20240229T194302Z_reco2_reco2.root" [2025-06-27 13:15:47.212743 +0100][Debug ][File ][ 1305] [0x9af3f70@root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/ee/9b/nu_dune10kt_1x2x6_1410_136_20230826T123317Z_gen_g4_detsim_hitreco__20240229T194302Z_reco2.root?xrdcl.requuid=fbe8a622-f3a7-4724-9e78-12f701e17e4e] Sending a close command for handle 0x0 to heplns144.pp.rl.ac.uk:51795 [2025-06-27 13:15:47.212894 +0100][Debug ][ExDbgMsg ][ 1305] [heplns144.pp.rl.ac.uk:51795] MsgHandler created: 0xa245950 (message: kXR_close (handle: 0x00000000) ). [2025-06-27 13:15:47.212962 +0100][Debug ][ExDbgMsg ][ 1305] [heplns144.pp.rl.ac.uk:51795] Moving MsgHandler: 0xa245950 (message: kXR_close (handle: 0x00000000) ) from out-queu to in-queue. [2025-06-27 13:15:47.226978 +0100][Debug ][ExDbgMsg ][ 1305] [msg: 0x13ea1b50] Assigned MsgHandler: 0xa245950. [2025-06-27 13:15:47.226989 +0100][Debug ][ExDbgMsg ][ 1305] [handler: 0xa245950] Removed MsgHandler: 0xa245950 from the in-queue. [2025-06-27 13:15:47.227013 +0100][Debug ][ExDbgMsg ][ 1305] [heplns144.pp.rl.ac.uk:51795] Calling MsgHandler: 0xa245950 (message: kXR_close (handle: 0x00000000) ) with status: [SUCCESS] . [2025-06-27 13:15:47.227034 +0100][Debug ][File ][ 1305] [0x9af3f70@root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/ee/9b/nu_dune10kt_1x2x6_1410_136_20230826T123317Z_gen_g4_detsim_hitreco__20240229T194302Z_reco2.root?xrdcl.requuid=fbe8a622-f3a7-4724-9e78-12f701e17e4e] Close returned from heplns144.pp.rl.ac.uk:51795 with: [SUCCESS] [2025-06-27 13:15:47.227052 +0100][Debug ][ExDbgMsg ][ 1305] [heplns144.pp.rl.ac.uk:51795] Destroying MsgHandler: 0xa245950. 27-Jun-2025 13:15:47 BST Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/ee/9b/nu_dune10kt_1x2x6_1410_136_20230826T123317Z_gen_g4_detsim_hitreco__20240229T194302Z_reco2.root" ================================================================================================================================ TimeTracker printout (sec) Min Avg Max Median RMS nEvts ================================================================================================================================ Full event 2.01517 6.02684 129.071 2.43626 18.2434 100 -------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.0288236 0.0430662 0.0929267 0.0450206 0.00901364 100 reco:pandora:StandardPandora 1.96956 5.97337 128.933 2.39001 18.2308 100 [art]:TriggerResults:TriggerResultInserter 1.1211e-05 2.468e-05 0.000179258 1.86195e-05 2.39002e-05 100 end_path:out1:RootOutput 2.203e-06 2.91139e-06 1.2437e-05 2.588e-06 1.19626e-06 100 end_path:out1:RootOutput(write) 0.000826235 0.0102354 0.0912707 0.00585589 0.0142396 100 ================================================================================================================================ ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 2495.22 MB Peak resident set size usage (VmHWM): 1510.2 MB ==================================================================================================== Art has completed and will exit with status 0. [2025-06-27 13:15:47.599036 +0100][Debug ][JobMgr ][ 1305] Stopping the job manager... [2025-06-27 13:15:47.600093 +0100][Debug ][JobMgr ][ 1305] Job manager stopped [2025-06-27 13:15:47.600924 +0100][Debug ][TaskMgr ][ 1305] Stopping the task manager... [2025-06-27 13:15:47.601408 +0100][Debug ][TaskMgr ][ 1305] Task manager stopped [2025-06-27 13:15:47.601435 +0100][Debug ][Poller ][ 1305] Stopping the poller... [2025-06-27 13:15:47.601750 +0100][Debug ][AsyncSock ][ 1305] [heplns144.pp.rl.ac.uk:51795.0] Closing the socket [2025-06-27 13:15:47.601937 +0100][Debug ][Poller ][ 1305] <[::ffff:192.41.105.38]:51624><--><[::ffff:130.246.47.144]:51795> Removing socket from the poller [2025-06-27 13:15:47.601997 +0100][Debug ][PostMaster ][ 1305] [heplns144.pp.rl.ac.uk:51795] Destroying stream [2025-06-27 13:15:47.602023 +0100][Debug ][AsyncSock ][ 1305] [heplns144.pp.rl.ac.uk:51795.0] Closing the socket [2025-06-27 13:15:47.602059 +0100][Debug ][AsyncSock ][ 1305] [mover.pp.rl.ac.uk:1094.0] Closing the socket [2025-06-27 13:15:47.602083 +0100][Debug ][Poller ][ 1305] <[::ffff:192.41.105.38]:34716><--><[::ffff:130.246.47.231]:1094> Removing socket from the poller [2025-06-27 13:15:47.602340 +0100][Debug ][PostMaster ][ 1305] [mover.pp.rl.ac.uk:1094] Destroying stream [2025-06-27 13:15:47.602378 +0100][Debug ][AsyncSock ][ 1305] [mover.pp.rl.ac.uk:1094.0] Closing the socket === End last 100 lines of lar log file ===