justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 228904.44@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID228904.44@justin-prod-sched02.dune.hep.ac.uk
Workflow ID7898
Stage ID1
User namehiguera@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-24 19:04:34
SiteUK_Edinburgh
EntryDUNE_UK_SGridECDF_ce1
Last heartbeat2025-06-24 22:08:52
From worker nodeHostnamenode2b05.ecdf.ed.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-24 19:48:28
Input filesusertests:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_534_20231202T160914Z_gen_g4_detsim_hitreco_reco2.root
JobscriptExit code0
Real time0m (55s)
CPU time0m (19s = 34%)
Max RSS bytes825536512 (787 MiB)
Outputting started2025-06-24 19:49:24
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/higuera/07898/1/001/atmo_ana_2025-06-24T_194833Z.root
Finished2025-06-24 22:08:52
Saved logsjustin-logs:228904.44-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

queue.
[2025-06-24 20:49:23.703314 +0100][Debug  ][ExDbgMsg          ][ 2713] [msg: 0xa55ab20] Assigned MsgHandler: 0xa0c0210.
[2025-06-24 20:49:23.703322 +0100][Debug  ][ExDbgMsg          ][ 2713] [handler: 0xa0c0210] Removed MsgHandler: 0xa0c0210 from the in-queue.
[2025-06-24 20:49:23.703343 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Calling MsgHandler: 0xa0c0210 (message: kXR_read (handle: 0x00000000, offset: 1023163706, size: 119) ) with status: [SUCCESS] .
[2025-06-24 20:49:23.703358 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Destroying MsgHandler: 0xa0c0210.
[2025-06-24 20:49:23.703371 +0100][Debug  ][File              ][ 2713] [0x82a9600@root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/usertests/ab/5a/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_534_20231202T160914Z_gen_g4_detsim_hitreco_reco2.root?xrdcl.requuid=bb800c11-f744-4b8c-a6bf-d35388ded3cf] Sending a read command for handle 0x0 to cephc02.gla.scotgrid.ac.uk:1094
[2025-06-24 20:49:23.703382 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] MsgHandler created: 0xa0c0210 (message: kXR_read (handle: 0x00000000, offset: 1023163825, size: 125) ).
[2025-06-24 20:49:23.703409 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Moving MsgHandler: 0xa0c0210 (message: kXR_read (handle: 0x00000000, offset: 1023163825, size: 125) ) from out-queu to in-queue.
[2025-06-24 20:49:23.706913 +0100][Debug  ][ExDbgMsg          ][ 2713] [msg: 0xa0bfdd0] Assigned MsgHandler: 0xa0c0210.
[2025-06-24 20:49:23.706923 +0100][Debug  ][ExDbgMsg          ][ 2713] [handler: 0xa0c0210] Removed MsgHandler: 0xa0c0210 from the in-queue.
[2025-06-24 20:49:23.706944 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Calling MsgHandler: 0xa0c0210 (message: kXR_read (handle: 0x00000000, offset: 1023163825, size: 125) ) with status: [SUCCESS] .
[2025-06-24 20:49:23.706952 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Destroying MsgHandler: 0xa0c0210.
[2025-06-24 20:49:23.706964 +0100][Debug  ][File              ][ 2713] [0x82a9600@root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/usertests/ab/5a/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_534_20231202T160914Z_gen_g4_detsim_hitreco_reco2.root?xrdcl.requuid=bb800c11-f744-4b8c-a6bf-d35388ded3cf] Sending a read command for handle 0x0 to cephc02.gla.scotgrid.ac.uk:1094
[2025-06-24 20:49:23.706975 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] MsgHandler created: 0xa0bfc80 (message: kXR_read (handle: 0x00000000, offset: 1023163950, size: 213) ).
[2025-06-24 20:49:23.707002 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Moving MsgHandler: 0xa0bfc80 (message: kXR_read (handle: 0x00000000, offset: 1023163950, size: 213) ) from out-queu to in-queue.
[2025-06-24 20:49:23.710550 +0100][Debug  ][ExDbgMsg          ][ 2713] [msg: 0xa0c0380] Assigned MsgHandler: 0xa0bfc80.
[2025-06-24 20:49:23.710556 +0100][Debug  ][ExDbgMsg          ][ 2713] [handler: 0xa0bfc80] Removed MsgHandler: 0xa0bfc80 from the in-queue.
[2025-06-24 20:49:23.710575 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Calling MsgHandler: 0xa0bfc80 (message: kXR_read (handle: 0x00000000, offset: 1023163950, size: 213) ) with status: [SUCCESS] .
[2025-06-24 20:49:23.710583 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Destroying MsgHandler: 0xa0bfc80.
[2025-06-24 20:49:23.713659 +0100][Debug  ][File              ][ 2713] [0x82a9600@root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/usertests/ab/5a/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_534_20231202T160914Z_gen_g4_detsim_hitreco_reco2.root?xrdcl.requuid=bb800c11-f744-4b8c-a6bf-d35388ded3cf] Sending a close command for handle 0x0 to cephc02.gla.scotgrid.ac.uk:1094
[2025-06-24 20:49:23.713720 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] MsgHandler created: 0xa3ee260 (message: kXR_close (handle: 0x00000000) ).
[2025-06-24 20:49:23.713789 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Moving MsgHandler: 0xa3ee260 (message: kXR_close (handle: 0x00000000) ) from out-queu to in-queue.
[2025-06-24 20:49:23.717574 +0100][Debug  ][ExDbgMsg          ][ 2713] [msg: 0xb2b4070] Assigned MsgHandler: 0xa3ee260.
[2025-06-24 20:49:23.717583 +0100][Debug  ][ExDbgMsg          ][ 2713] [handler: 0xa3ee260] Removed MsgHandler: 0xa3ee260 from the in-queue.
[2025-06-24 20:49:23.717610 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Calling MsgHandler: 0xa3ee260 (message: kXR_close (handle: 0x00000000) ) with status: [SUCCESS] .
[2025-06-24 20:49:23.717632 +0100][Debug  ][File              ][ 2713] [0x82a9600@root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/usertests/ab/5a/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_534_20231202T160914Z_gen_g4_detsim_hitreco_reco2.root?xrdcl.requuid=bb800c11-f744-4b8c-a6bf-d35388ded3cf] Close returned from cephc02.gla.scotgrid.ac.uk:1094 with: [SUCCESS] 
[2025-06-24 20:49:23.717648 +0100][Debug  ][ExDbgMsg          ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Destroying MsgHandler: 0xa3ee260.
24-Jun-2025 20:49:23 BST  Closed input file "root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/usertests/ab/5a/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_534_20231202T160914Z_gen_g4_detsim_hitreco_reco2.root"
24-Jun-2025 20:49:23 BST  Closed input file "root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/usertests/ab/5a/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_534_20231202T160914Z_gen_g4_detsim_hitreco_reco2.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                             0.0386566     0.179204      0.419609      0.165085      0.0782286       100    
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                0.00407619     0.0382249      0.15546      0.0289931     0.0323737       100    
end_path:analysistree:AtmoAnalysis     0.0329185     0.140861      0.377458      0.131109      0.059756        100    
========================================================================================================================

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                             0.0386566     0.179204      0.419609      0.165085      0.0782286       100    
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                0.00407619     0.0382249      0.15546      0.0289931     0.0323737       100    
end_path:analysistree:AtmoAnalysis     0.0329185     0.140861      0.377458      0.131109      0.059756        100    
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1922.33 MB
  Peak resident set size usage (VmHWM): 825.537 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1922.33 MB
  Peak resident set size usage (VmHWM): 825.537 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 100 passed = 100 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        100        100          0 analysistree

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 6.022423 Real = 39.761878

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1922.33 VmHWM = 825.537

Art has completed and will exit with status 0.
[2025-06-24 20:49:23.893038 +0100][Debug  ][JobMgr            ][ 2713] Stopping the job manager...
[2025-06-24 20:49:23.893291 +0100][Debug  ][JobMgr            ][ 2713] Job manager stopped
[2025-06-24 20:49:23.893333 +0100][Debug  ][TaskMgr           ][ 2713] Stopping the task manager...
[2025-06-24 20:49:23.893520 +0100][Debug  ][TaskMgr           ][ 2713] Task manager stopped
[2025-06-24 20:49:23.893528 +0100][Debug  ][Poller            ][ 2713] Stopping the poller...
[2025-06-24 20:49:23.893729 +0100][Debug  ][AsyncSock         ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094.0] Closing the socket
[2025-06-24 20:49:23.893816 +0100][Debug  ][Poller            ][ 2713] <[::ffff:192.41.105.38]:34376><--><[::ffff:130.209.239.113]:1094> Removing socket from the poller
[2025-06-24 20:49:23.894047 +0100][Debug  ][PostMaster        ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094] Destroying stream
[2025-06-24 20:49:23.894071 +0100][Debug  ][AsyncSock         ][ 2713] [cephc02.gla.scotgrid.ac.uk:1094.0] Closing the socket
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2025-08-14 21:50:22 UTC       justIN version: 01.03.02