21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 423643.46@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 423643.46@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 7979 | |
| Stage ID | 1 | |
| User name | imawby@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 43200 (12 hours) | |
| Submitted time | 2025-06-27 12:12:11 | |
| Site | UK_Edinburgh | |
| Entry | DUNE_UK_SGridECDF_ce1 | |
| Last heartbeat | 2025-06-27 12:26:24 | |
| From worker node | Hostname | node2b05.ecdf.ed.ac.uk |
| cpuinfo | Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-06-27 12:14:39 | |
| Input files | fardet-hd:nutau_dune10kt_1x2x6_1406_540_20230826T060308Z_gen_g4_detsim_hitreco__20240220T160020Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 11m (688s) | |
| CPU time | 7m (442s = 64%) | |
| Max RSS bytes | 1483325440 (1414 MiB) | |
| Outputting started | 2025-06-27 12:26:07 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/splitting_nutau_0/07979/1/001/HierarchyRecoPerformance_nutau_dune10kt_1x2x6_1406_540_20230826T060308Z_gen_g4_detsim_hitreco__20240220T160020Z_reco2.root | |
| Finished | 2025-06-27 12:26:24 | |
| Saved logs | justin-logs:423643.46-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
) with status: [SUCCESS] . [2025-06-27 13:26:04.659930 +0100][Debug ][ExDbgMsg ][ 1304] [ceph-svc22.gridpp.rl.ac.uk:1094] Destroying MsgHandler: 0x1c0f94e0. [2025-06-27 13:26:04.668955 +0100][Debug ][File ][ 1304] [0xaa222e0@root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/21/28/nutau_dune10kt_1x2x6_1406_540_20230826T060308Z_gen_g4_detsim_hitreco__20240220T160020Z_reco2.root?xrdcl.requuid=899b7c66-2c74-4338-b36a-0fb810a196ef] Sending a read command for handle 0x0 to ceph-svc22.gridpp.rl.ac.uk:1094 [2025-06-27 13:26:04.669013 +0100][Debug ][ExDbgMsg ][ 1304] [ceph-svc22.gridpp.rl.ac.uk:1094] MsgHandler created: 0xd246880 (message: kXR_read (handle: 0x00000000, offset: 179950, size: 132) ). [2025-06-27 13:26:04.669095 +0100][Debug ][ExDbgMsg ][ 1304] [ceph-svc22.gridpp.rl.ac.uk:1094] Moving MsgHandler: 0xd246880 (message: kXR_read (handle: 0x00000000, offset: 179950, size: 132) ) from out-queu to in-queue. [2025-06-27 13:26:04.738499 +0100][Debug ][ExDbgMsg ][ 1304] [msg: 0xba7eff0] Assigned MsgHandler: 0xd246880. [2025-06-27 13:26:04.738549 +0100][Debug ][ExDbgMsg ][ 1304] [handler: 0xd246880] Removed MsgHandler: 0xd246880 from the in-queue. [2025-06-27 13:26:04.738604 +0100][Debug ][ExDbgMsg ][ 1304] [ceph-svc22.gridpp.rl.ac.uk:1094] Calling MsgHandler: 0xd246880 (message: kXR_read (handle: 0x00000000, offset: 179950, size: 132) ) with status: [SUCCESS] . [2025-06-27 13:26:04.738625 +0100][Debug ][ExDbgMsg ][ 1304] [ceph-svc22.gridpp.rl.ac.uk:1094] Destroying MsgHandler: 0xd246880. [2025-06-27 13:26:04.738693 +0100][Debug ][File ][ 1304] [0xaa222e0@root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/21/28/nutau_dune10kt_1x2x6_1406_540_20230826T060308Z_gen_g4_detsim_hitreco__20240220T160020Z_reco2.root?xrdcl.requuid=899b7c66-2c74-4338-b36a-0fb810a196ef] Sending a read command for handle 0x0 to ceph-svc22.gridpp.rl.ac.uk:1094 [2025-06-27 13:26:04.738717 +0100][Debug ][ExDbgMsg ][ 1304] [ceph-svc22.gridpp.rl.ac.uk:1094] MsgHandler created: 0xd246880 (message: kXR_read (handle: 0x00000000, offset: 180082, size: 138) ). [2025-06-27 13:26:04.738767 +0100][Debug ][ExDbgMsg ][ 1304] [ceph-svc22.gridpp.rl.ac.uk:1094] Moving MsgHandler: 0xd246880 (message: kXR_read (handle: 0x00000000, offset: 180082, size: 138) ) from out-queu to in-queue. [2025-06-27 13:26:04.752514 +0100][Debug ][ExDbgMsg ][ 1304] [msg: 0x1bc34440] Assigned MsgHandler: 0xd246880. [2025-06-27 13:26:04.752545 +0100][Debug ][ExDbgMsg ][ 1304] [handler: 0xd246880] Removed MsgHandler: 0xd246880 from the in-queue. [2025-06-27 13:26:04.752589 +0100][Debug ][ExDbgMsg ][ 1304] [ceph-svc22.gridpp.rl.ac.uk:1094] Calling MsgHandler: 0xd246880 (message: kXR_read (handle: 0x00000000, offset: 180082, size: 138) ) with status: [SUCCESS] . [2025-06-27 13:26:04.752606 +0100][Debug ][ExDbgMsg ][ 1304] [ceph-svc22.gridpp.rl.ac.uk:1094] Destroying MsgHandler: 0xd246880. [2025-06-27 13:26:04.752667 +0100][Debug ][File ][ 1304] [0xaa222e0@root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/21/28/nutau_dune10kt_1x2x6_1406_540_20230826T060308Z_gen_g4_detsim_hitreco__20240220T160020Z_reco2.root?xrdcl.requuid=899b7c66-2c74-4338-b36a-0fb810a196ef] Sending a read command for handle 0x0 to ceph-svc22.gridpp.rl.ac.uk:1094 [2025-06-27 13:26:04.752685 +0100][Debug ][ExDbgMsg ][ 1304] [ceph-svc22.gridpp.rl.ac.uk:1094] MsgHandler created: 0xd246880 (message: kXR_read (handle: 0x00000000, offset: 169084, size: 4218) ). [2025-06-27 13:26:04.752725 +0100][Debug ][ExDbgMsg ][ 1304] [ceph-svc22.gridpp.rl.ac.uk:1094] Moving MsgHandler: 0xd246880 (message: kXR_read (handle: 0x00000000, offset: 169084, size: 4218) ) from out-queu to in-queue. [2025-06-27 13:26:04.797354 +0100][Debug ][ExDbgMsg ][ 1304] [msg: 0x1bc34440] Assigned MsgHandler: 0xd246880. [2025-06-27 13:26:04.797406 +0100][Debug ][ExDbgMsg ][ 1304] [handler: 0xd246880] Removed MsgHandler: 0xd246880 from the in-queue. [2025-06-27 13:26:04.797453 +0100][Debug ][ExDbgMsg ][ 1304] [ceph-svc22.gridpp.rl.ac.uk:1094] Calling MsgHandler: 0xd246880 (message: kXR_read (handle: 0x00000000, offset: 169084, size: 4218) ) with status: [SUCCESS] . [2025-06-27 13:26:04.797477 +0100][Debug ][ExDbgMsg ][ 1304] [ceph-svc22.gridpp.rl.ac.uk:1094] Destroying MsgHandler: 0xd246880. 27-Jun-2025 13:26:06 BST Closed output file "nutau_dune10kt_1x2x6_1406_540_20230826T060308Z_gen_g4_detsim_hitreco__20240220T160020Z_reco2_reco2.root" [2025-06-27 13:26:06.964488 +0100][Debug ][File ][ 1304] [0xaa222e0@root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/21/28/nutau_dune10kt_1x2x6_1406_540_20230826T060308Z_gen_g4_detsim_hitreco__20240220T160020Z_reco2.root?xrdcl.requuid=899b7c66-2c74-4338-b36a-0fb810a196ef] Sending a close command for handle 0x0 to ceph-svc22.gridpp.rl.ac.uk:1094 [2025-06-27 13:26:06.964625 +0100][Debug ][ExDbgMsg ][ 1304] [ceph-svc22.gridpp.rl.ac.uk:1094] MsgHandler created: 0x107b3f50 (message: kXR_close (handle: 0x00000000) ). [2025-06-27 13:26:06.964710 +0100][Debug ][ExDbgMsg ][ 1304] [ceph-svc22.gridpp.rl.ac.uk:1094] Moving MsgHandler: 0x107b3f50 (message: kXR_close (handle: 0x00000000) ) from out-queu to in-queue. [2025-06-27 13:26:06.982778 +0100][Debug ][ExDbgMsg ][ 1304] [msg: 0x127d2860] Assigned MsgHandler: 0x107b3f50. [2025-06-27 13:26:06.982792 +0100][Debug ][ExDbgMsg ][ 1304] [handler: 0x107b3f50] Removed MsgHandler: 0x107b3f50 from the in-queue. [2025-06-27 13:26:06.982817 +0100][Debug ][ExDbgMsg ][ 1304] [ceph-svc22.gridpp.rl.ac.uk:1094] Calling MsgHandler: 0x107b3f50 (message: kXR_close (handle: 0x00000000) ) with status: [SUCCESS] . [2025-06-27 13:26:06.982842 +0100][Debug ][File ][ 1304] [0xaa222e0@root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/21/28/nutau_dune10kt_1x2x6_1406_540_20230826T060308Z_gen_g4_detsim_hitreco__20240220T160020Z_reco2.root?xrdcl.requuid=899b7c66-2c74-4338-b36a-0fb810a196ef] Close returned from ceph-svc22.gridpp.rl.ac.uk:1094 with: [SUCCESS] [2025-06-27 13:26:06.982862 +0100][Debug ][ExDbgMsg ][ 1304] [ceph-svc22.gridpp.rl.ac.uk:1094] Destroying MsgHandler: 0x107b3f50. 27-Jun-2025 13:26:06 BST Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/21/28/nutau_dune10kt_1x2x6_1406_540_20230826T060308Z_gen_g4_detsim_hitreco__20240220T160020Z_reco2.root" ================================================================================================================================ TimeTracker printout (sec) Min Avg Max Median RMS nEvts ================================================================================================================================ Full event 0.454117 4.57852 69.764 2.77263 7.81769 100 -------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.028216 0.217521 0.998412 0.170297 0.151912 100 reco:pandora:StandardPandora 0.352428 4.3516 69.3306 2.53349 7.79735 100 [art]:TriggerResults:TriggerResultInserter 1.2615e-05 2.60677e-05 0.000291562 1.7754e-05 3.64968e-05 100 end_path:out1:RootOutput 2.544e-06 3.39187e-06 1.1851e-05 3.1465e-06 1.12283e-06 100 end_path:out1:RootOutput(write) 0.000825755 0.00920982 0.0783033 0.00403084 0.0132898 100 ================================================================================================================================ ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 2462.14 MB Peak resident set size usage (VmHWM): 1483.33 MB ==================================================================================================== Art has completed and will exit with status 0. [2025-06-27 13:26:07.376641 +0100][Debug ][JobMgr ][ 1304] Stopping the job manager... [2025-06-27 13:26:07.377575 +0100][Debug ][JobMgr ][ 1304] Job manager stopped [2025-06-27 13:26:07.378007 +0100][Debug ][TaskMgr ][ 1304] Stopping the task manager... [2025-06-27 13:26:07.378082 +0100][Debug ][TaskMgr ][ 1304] Task manager stopped [2025-06-27 13:26:07.378109 +0100][Debug ][Poller ][ 1304] Stopping the poller... [2025-06-27 13:26:07.378389 +0100][Debug ][AsyncSock ][ 1304] [ceph-svc22.gridpp.rl.ac.uk:1094.0] Closing the socket [2025-06-27 13:26:07.378438 +0100][Debug ][Poller ][ 1304] <[::ffff:192.41.105.38]:40562><--><[::ffff:130.246.179.158]:1094> Removing socket from the poller [2025-06-27 13:26:07.378759 +0100][Debug ][PostMaster ][ 1304] [ceph-svc22.gridpp.rl.ac.uk:1094] Destroying stream [2025-06-27 13:26:07.378801 +0100][Debug ][AsyncSock ][ 1304] [ceph-svc22.gridpp.rl.ac.uk:1094.0] Closing the socket [2025-06-27 13:26:07.378946 +0100][Debug ][AsyncSock ][ 1304] [xrootd.echo.stfc.ac.uk:1094.0] Closing the socket [2025-06-27 13:26:07.378990 +0100][Debug ][Poller ][ 1304] <[::ffff:192.41.105.38]:37070><--><[::ffff:130.246.217.8]:1094> Removing socket from the poller [2025-06-27 13:26:07.379075 +0100][Debug ][PostMaster ][ 1304] [xrootd.echo.stfc.ac.uk:1094] Destroying stream [2025-06-27 13:26:07.379088 +0100][Debug ][AsyncSock ][ 1304] [xrootd.echo.stfc.ac.uk:1094.0] Closing the socket === End last 100 lines of lar log file ===