justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 421276.20@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID421276.20@justin-prod-sched01.dune.hep.ac.uk
Workflow ID7898
Stage ID1
User namehiguera@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-24 19:03:26
SiteUK_Edinburgh
EntryDUNE_UK_SGridECDF_ce1
Last heartbeat2025-06-24 21:57:55
From worker nodeHostnamenode2b05.ecdf.ed.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-24 19:09:05
Input filesusertests:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74505548_724_20231202T143702Z_gen_g4_detsim_hitreco_reco2.root
JobscriptExit code0
Real time0m (54s)
CPU time0m (20s = 37%)
Max RSS bytes947269632 (903 MiB)
Outputting started2025-06-24 19:10:00
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/higuera/07898/1/001/atmo_ana_2025-06-24T_190910Z.root
Finished2025-06-24 21:57:55
Saved logsjustin-logs:421276.20-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

-06-24 20:09:59.547803 +0100][Debug  ][ExDbgMsg          ][ 2713] [msg: 0x1348b1b0] Assigned MsgHandler: 0x1348a8e0.
[2025-06-24 20:09:59.547812 +0100][Debug  ][ExDbgMsg          ][ 2713] [handler: 0x1348a8e0] Removed MsgHandler: 0x1348a8e0 from the in-queue.
[2025-06-24 20:09:59.547834 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Calling MsgHandler: 0x1348a8e0 (message: kXR_read (handle: 0x00000000, offset: 1023886914, size: 119) ) with status: [SUCCESS] .
[2025-06-24 20:09:59.547843 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Destroying MsgHandler: 0x1348a8e0.
[2025-06-24 20:09:59.547858 +0100][Debug  ][File              ][ 2713] [0x8269fb0@root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/usertests/39/0d/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74505548_724_20231202T143702Z_gen_g4_detsim_hitreco_reco2.root?xrdcl.requuid=b78f32c8-6091-485f-9b02-7d03b277d24b] Sending a read command for handle 0x0 to cephc02.gla.scotgrid.ac.uk:1094
[2025-06-24 20:09:59.547869 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] MsgHandler created: 0x1348a8e0 (message: kXR_read (handle: 0x00000000, offset: 1023887033, size: 125) ).
[2025-06-24 20:09:59.547896 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Moving MsgHandler: 0x1348a8e0 (message: kXR_read (handle: 0x00000000, offset: 1023887033, size: 125) ) from out-queu to in-queue.
[2025-06-24 20:09:59.551416 +0100][Debug  ][ExDbgMsg          ][ 2713] [msg: 0x1348b1b0] Assigned MsgHandler: 0x1348a8e0.
[2025-06-24 20:09:59.551425 +0100][Debug  ][ExDbgMsg          ][ 2713] [handler: 0x1348a8e0] Removed MsgHandler: 0x1348a8e0 from the in-queue.
[2025-06-24 20:09:59.551471 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Calling MsgHandler: 0x1348a8e0 (message: kXR_read (handle: 0x00000000, offset: 1023887033, size: 125) ) with status: [SUCCESS] .
[2025-06-24 20:09:59.551480 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Destroying MsgHandler: 0x1348a8e0.
[2025-06-24 20:09:59.551494 +0100][Debug  ][File              ][ 2713] [0x8269fb0@root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/usertests/39/0d/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74505548_724_20231202T143702Z_gen_g4_detsim_hitreco_reco2.root?xrdcl.requuid=b78f32c8-6091-485f-9b02-7d03b277d24b] Sending a read command for handle 0x0 to cephc02.gla.scotgrid.ac.uk:1094
[2025-06-24 20:09:59.551516 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] MsgHandler created: 0xc17ca20 (message: kXR_read (handle: 0x00000000, offset: 1023887158, size: 212) ).
[2025-06-24 20:09:59.551544 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Moving MsgHandler: 0xc17ca20 (message: kXR_read (handle: 0x00000000, offset: 1023887158, size: 212) ) from out-queu to in-queue.
[2025-06-24 20:09:59.555058 +0100][Debug  ][ExDbgMsg          ][ 2713] [msg: 0x1348b090] Assigned MsgHandler: 0xc17ca20.
[2025-06-24 20:09:59.555070 +0100][Debug  ][ExDbgMsg          ][ 2713] [handler: 0xc17ca20] Removed MsgHandler: 0xc17ca20 from the in-queue.
[2025-06-24 20:09:59.555108 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Calling MsgHandler: 0xc17ca20 (message: kXR_read (handle: 0x00000000, offset: 1023887158, size: 212) ) with status: [SUCCESS] .
[2025-06-24 20:09:59.555117 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Destroying MsgHandler: 0xc17ca20.
[2025-06-24 20:09:59.560942 +0100][Debug  ][File              ][ 2713] [0x8269fb0@root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/usertests/39/0d/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74505548_724_20231202T143702Z_gen_g4_detsim_hitreco_reco2.root?xrdcl.requuid=b78f32c8-6091-485f-9b02-7d03b277d24b] Sending a close command for handle 0x0 to cephc02.gla.scotgrid.ac.uk:1094
[2025-06-24 20:09:59.560994 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] MsgHandler created: 0x8296e50 (message: kXR_close (handle: 0x00000000) ).
[2025-06-24 20:09:59.561069 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Moving MsgHandler: 0x8296e50 (message: kXR_close (handle: 0x00000000) ) from out-queu to in-queue.
[2025-06-24 20:09:59.564794 +0100][Debug  ][ExDbgMsg          ][ 2713] [msg: 0xaf8e740] Assigned MsgHandler: 0x8296e50.
[2025-06-24 20:09:59.564801 +0100][Debug  ][ExDbgMsg          ][ 2713] [handler: 0x8296e50] Removed MsgHandler: 0x8296e50 from the in-queue.
[2025-06-24 20:09:59.564820 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Calling MsgHandler: 0x8296e50 (message: kXR_close (handle: 0x00000000) ) with status: [SUCCESS] .
[2025-06-24 20:09:59.564841 +0100][Debug  ][File              ][ 2713] [0x8269fb0@root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/usertests/39/0d/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74505548_724_20231202T143702Z_gen_g4_detsim_hitreco_reco2.root?xrdcl.requuid=b78f32c8-6091-485f-9b02-7d03b277d24b] Close returned from cephc02.gla.scotgrid.ac.uk:1094 with: [SUCCESS] 
[2025-06-24 20:09:59.564858 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Destroying MsgHandler: 0x8296e50.
24-Jun-2025 20:09:59 BST  Closed input file "root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/usertests/39/0d/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74505548_724_20231202T143702Z_gen_g4_detsim_hitreco_reco2.root"
24-Jun-2025 20:09:59 BST  Closed input file "root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/usertests/39/0d/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74505548_724_20231202T143702Z_gen_g4_detsim_hitreco_reco2.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                             0.0447796     0.170165      0.376684      0.156356      0.0626032       100    
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                0.00398656     0.0333572     0.116471      0.0276083     0.0225581       100    
end_path:analysistree:AtmoAnalysis     0.0336429      0.13671      0.327506      0.127407      0.0537359       100    
========================================================================================================================

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                             0.0447796     0.170165      0.376684      0.156356      0.0626032       100    
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                0.00398656     0.0333572     0.116471      0.0276083     0.0225581       100    
end_path:analysistree:AtmoAnalysis     0.0336429      0.13671      0.327506      0.127407      0.0537359       100    
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2044.03 MB
  Peak resident set size usage (VmHWM): 947.27 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2044.03 MB
  Peak resident set size usage (VmHWM): 947.27 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 100 passed = 100 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        100        100          0 analysistree

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 6.308083 Real = 38.621679

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 2044.03 VmHWM = 947.27

Art has completed and will exit with status 0.
[2025-06-24 20:09:59.746926 +0100][Debug  ][JobMgr            ][ 2713] Stopping the job manager...
[2025-06-24 20:09:59.747143 +0100][Debug  ][JobMgr            ][ 2713] Job manager stopped
[2025-06-24 20:09:59.747303 +0100][Debug  ][TaskMgr           ][ 2713] Stopping the task manager...
[2025-06-24 20:09:59.747445 +0100][Debug  ][TaskMgr           ][ 2713] Task manager stopped
[2025-06-24 20:09:59.747456 +0100][Debug  ][Poller            ][ 2713] Stopping the poller...
[2025-06-24 20:09:59.747659 +0100][Debug  ][AsyncSock         ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094.0] Closing the socket
[2025-06-24 20:09:59.747722 +0100][Debug  ][Poller            ][ 2713] <[::ffff:192.41.105.38]:56380><--><[::ffff:130.209.239.113]:1094> Removing socket from the poller
[2025-06-24 20:09:59.747961 +0100][Debug  ][PostMaster        ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Destroying stream
[2025-06-24 20:09:59.748251 +0100][Debug  ][AsyncSock         ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094.0] Closing the socket
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2025-08-15 04:45:28 UTC       justIN version: 01.03.02