justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 360194.20@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID360194.20@justin-prod-sched01.dune.hep.ac.uk
Workflow ID5893
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-04-02 08:42:26
SiteUK_Edinburgh
EntryDUNE_UK_SGridECDF_ce1_multicore
Last heartbeat2025-04-02 09:53:02
From worker nodeHostnamenode2b07.ecdf.ed.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-04-02 08:50:45
Input filesvd-protodune:np02vd_raw_run035707_0177_df-s04-d0_dw_0_20250402T073732.hdf5
JobscriptExit code0
Real time1h (3655s)
CPU time3m (213s = 5%)
Max RSS bytes909754368 (867 MiB)
Outputting started2025-04-02 09:51:41
Output filesvd-protodune-det-reco:np02vd_raw_run035707_0177_df-s04-d0_dw_0_20250402T073732_reco_stage1_20250402T095134_keepup.root
Finished2025-04-02 09:53:02
Saved logsjustin-logs:360194.20-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

10:51:30.406466 +0100][Debug  ][ExDbgMsg          ][ 1148] [msg: 0x8fc6ff0] Assigned MsgHandler: 0xa498210.
[2025-04-02 10:51:30.406486 +0100][Debug  ][ExDbgMsg          ][ 1148] [handler: 0xa498210] Removed MsgHandler: 0xa498210 from the in-queue.
[2025-04-02 10:51:30.406531 +0100][Debug  ][ExDbgMsg          ][ 1148] [st-096-100gb-ip304-bcd74.cern.ch:1095] Calling MsgHandler: 0xa498210 (message: kXR_read (handle: 0x00000000, offset: 4214217528, size: 512) ) with status: [SUCCESS] .
[2025-04-02 10:51:30.406559 +0100][Debug  ][ExDbgMsg          ][ 1148] [st-096-100gb-ip304-bcd74.cern.ch:1095] Destroying MsgHandler: 0xa498210.
[2025-04-02 10:51:30.406768 +0100][Debug  ][File              ][ 1148] [0x82bdc00@root://eospublic.cern.ch:1094//eos/experiment/neutplatform/protodune/dune/vd-protodune/79/17/np02vd_raw_run035707_0177_df-s04-d0_dw_0_20250402T073732.hdf5?xrdcl.requuid=622d8b41-9b2a-414d-9b33-34bca2195027] Sending a read command for handle 0x0 to st-096-100gb-ip304-bcd74.cern.ch:1095
[2025-04-02 10:51:30.406801 +0100][Debug  ][ExDbgMsg          ][ 1148] [st-096-100gb-ip304-bcd74.cern.ch:1095] MsgHandler created: 0xb7558a0 (message: kXR_read (handle: 0x00000000, offset: 4215328176, size: 1108872) ).
[2025-04-02 10:51:30.406859 +0100][Debug  ][ExDbgMsg          ][ 1148] [st-096-100gb-ip304-bcd74.cern.ch:1095] Moving MsgHandler: 0xb7558a0 (message: kXR_read (handle: 0x00000000, offset: 4215328176, size: 1108872) ) from out-queu to in-queue.
[2025-04-02 10:51:30.434558 +0100][Debug  ][ExDbgMsg          ][ 1148] [msg: 0x928df70] Assigned MsgHandler: 0xb7558a0.
[2025-04-02 10:51:30.434582 +0100][Debug  ][ExDbgMsg          ][ 1148] [handler: 0xb7558a0] Removed MsgHandler: 0xb7558a0 from the in-queue.
[2025-04-02 10:51:31.244873 +0100][Debug  ][ExDbgMsg          ][ 1148] [st-096-100gb-ip304-bcd74.cern.ch:1095] Calling MsgHandler: 0xb7558a0 (message: kXR_read (handle: 0x00000000, offset: 4215328176, size: 1108872) ) with status: [SUCCESS] .
[2025-04-02 10:51:31.244913 +0100][Debug  ][ExDbgMsg          ][ 1148] [st-096-100gb-ip304-bcd74.cern.ch:1095] Destroying MsgHandler: 0xb7558a0.
02-Apr-2025 10:51:34 BST  Closed output file "np02vd_raw_run035707_0177_df-s04-d0_dw_0_20250402T073732_reco_stage1_20250402T095134_keepup.root"
[2025-04-02 10:51:34.379490 +0100][Debug  ][File              ][ 1148] [0x82bdc00@root://eospublic.cern.ch:1094//eos/experiment/neutplatform/protodune/dune/vd-protodune/79/17/np02vd_raw_run035707_0177_df-s04-d0_dw_0_20250402T073732.hdf5?xrdcl.requuid=622d8b41-9b2a-414d-9b33-34bca2195027] Sending a close command for handle 0x0 to st-096-100gb-ip304-bcd74.cern.ch:1095
[2025-04-02 10:51:34.379783 +0100][Debug  ][ExDbgMsg          ][ 1148] [st-096-100gb-ip304-bcd74.cern.ch:1095] MsgHandler created: 0x9811cd0 (message: kXR_close (handle: 0x00000000) ).
[2025-04-02 10:51:34.380080 +0100][Debug  ][ExDbgMsg          ][ 1148] [st-096-100gb-ip304-bcd74.cern.ch:1095] Moving MsgHandler: 0x9811cd0 (message: kXR_close (handle: 0x00000000) ) from out-queu to in-queue.
[2025-04-02 10:51:34.409570 +0100][Debug  ][ExDbgMsg          ][ 1148] [msg: 0x89ebcd0] Assigned MsgHandler: 0x9811cd0.
[2025-04-02 10:51:34.409594 +0100][Debug  ][ExDbgMsg          ][ 1148] [handler: 0x9811cd0] Removed MsgHandler: 0x9811cd0 from the in-queue.
[2025-04-02 10:51:34.409669 +0100][Debug  ][ExDbgMsg          ][ 1148] [st-096-100gb-ip304-bcd74.cern.ch:1095] Calling MsgHandler: 0x9811cd0 (message: kXR_close (handle: 0x00000000) ) with status: [SUCCESS] .
[2025-04-02 10:51:34.409724 +0100][Debug  ][File              ][ 1148] [0x82bdc00@root://eospublic.cern.ch:1094//eos/experiment/neutplatform/protodune/dune/vd-protodune/79/17/np02vd_raw_run035707_0177_df-s04-d0_dw_0_20250402T073732.hdf5?xrdcl.requuid=622d8b41-9b2a-414d-9b33-34bca2195027] Close returned from st-096-100gb-ip304-bcd74.cern.ch:1095 with: [SUCCESS] 
[2025-04-02 10:51:34.409759 +0100][Debug  ][ExDbgMsg          ][ 1148] [st-096-100gb-ip304-bcd74.cern.ch:1095] Destroying MsgHandler: 0x9811cd0.

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      65.9218       81.9677       110.823       78.801        11.6395        44     
--------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                    1.1108e-05    1.68898e-05   7.6131e-05    1.6618e-05    9.37177e-06      44     
produce:tpcrawdecoder:PDVDTPCReader             63.9601       80.0154       108.857       76.8399       11.6331        44     
[art]:TriggerResults:TriggerResultInserter    1.1656e-05    1.48227e-05   4.0405e-05    1.39825e-05    4.239e-06       44     
end_path:out1:RootOutput                       2.921e-06    5.31907e-06   1.3753e-05     5.47e-06     1.53853e-06      44     
end_path:out1:RootOutput(write)                 1.92456       1.95207       2.04889       1.95076       0.02071        44     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1638.16 MB
  Peak resident set size usage (VmHWM): 909.754 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
[2025-04-02 10:51:35.345960 +0100][Debug  ][JobMgr            ][ 1148] Stopping the job manager...
[2025-04-02 10:51:35.346362 +0100][Debug  ][JobMgr            ][ 1148] Job manager stopped
[2025-04-02 10:51:35.346409 +0100][Debug  ][TaskMgr           ][ 1148] Stopping the task manager...
[2025-04-02 10:51:35.346567 +0100][Debug  ][TaskMgr           ][ 1148] Task manager stopped
[2025-04-02 10:51:35.346575 +0100][Debug  ][Poller            ][ 1148] Stopping the poller...
[2025-04-02 10:51:35.346678 +0100][Debug  ][AsyncSock         ][ 1148] [st-096-100gb-ip304-bcd74.cern.ch:1095.0] Closing the socket
[2025-04-02 10:51:35.346698 +0100][Debug  ][Poller            ][ 1148] <[::ffff:192.41.105.40]:34952><--><[::ffff:128.142.218.13]:1095> Removing socket from the poller
[2025-04-02 10:51:35.346736 +0100][Debug  ][PostMaster        ][ 1148] [st-096-100gb-ip304-bcd74.cern.ch:1095] Destroying stream
[2025-04-02 10:51:35.346821 +0100][Debug  ][AsyncSock         ][ 1148] [st-096-100gb-ip304-bcd74.cern.ch:1095.0] Closing the socket
Output files:
\tReco: np02vd_raw_run035707_0177_df-s04-d0_dw_0_20250402T073732_reco_stage1_20250402T095134_keepup.root
\tHists: np02vd_raw_run035707_0177_df-s04-d0_dw_0_20250402T073732_reco_stage1_20250402T095135_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run035707_0177_df-s04-d0_dw_0_20250402T073732_reco_stage1_20250402T095134_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run035707_0177_df-s04-d0_dw_0_20250402T073732_reco_stage1_20250402T095134_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_03_01d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1743587495.0,
    "core.end_time": 1743587495.0,
    "core.events": [
      7789,
      7790,
      7791,
      7792,
      7793,
      7794,
      7795,
      7796,
      7797,
      7798,
      7799,
      7800,
      7801,
      7802,
      7803,
      7804,
      7805,
      7806,
      7807,
      7808,
      7809,
      7810,
      7811,
      7812,
      7813,
      7814,
      7815,
      7816,
      7817,
      7818,
      7819,
      7820,
      7821,
      7822,
      7823,
      7824,
      7825,
      7826,
      7827,
      7828,
      7829,
      7830,
      7831,
      7832
    ],
    "core.event_count": 44,
    "core.first_event_number": 7789,
    "core.last_event_number": 7832,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      35707
    ],
    "core.runs_subruns": [
      3570700001
    ],
    "dune.daq_test": true,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run035707_0177_df-s04-d0_dw_0_20250402T073732.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run035707_0177_df-s04-d0_dw_0_20250402T073732_reco_stage1_20250402T095135_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_03_01d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1743587495.0,
    "core.end_time": 1743587495.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      35707
    ],
    "core.runs_subruns": [
      3570700001
    ],
    "dune.daq_test": true,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run035707_0177_df-s04-d0_dw_0_20250402T073732.hdf5"
    }
  ]
}
justIN time: 2025-04-03 08:23:26 UTC       justIN version: 01.03.00