justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 167708.6@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID167708.6@justin-prod-sched02.dune.hep.ac.uk
Workflow ID5785
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-03-31 09:42:15
SiteUK_Lancaster
EntryUBoone_UK_Lancaster_HEC_grendel_ce02
Last heartbeat2025-03-31 10:04:53
From worker nodeHostnamecomp11-14
cpuinfoIntel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-03-31 09:42:56
Input filesvd-protodune:np02vd_raw_run035691_0550_df-s04-d0_dw_0_20250331T084547.hdf5
JobscriptExit code0
Real time19m (1163s)
CPU time3m (216s = 18%)
Max RSS bytes915480576 (873 MiB)
Outputting started2025-03-31 10:02:24
Output filesvd-protodune-det-reco:np02vd_raw_run035691_0550_df-s04-d0_dw_0_20250331T084547_reco_stage1_20250331T100211_keepup.root
Finished2025-03-31 10:04:53
Saved logsjustin-logs:167708.6-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

g runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16451 nodes/ 2412 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
GeoApaChannelGroupService::ctor: Group 0 (apa0) has 3072 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 1 (apa1) has 3072 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 2 (apa2) has 3072 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 3 (apa3) has 3072 channels from 3/3 readout planes.
DAPHNE Channel Map: Building DAPHNE channel map from file DAPHNE_vd_coldbox_ChannelMap_bde2.txt
PDVD Channel Map: Building TPC wiremap from file PD2VDBottomTPCChannelMap_v1.txt
PDSP Channel Map: Building RCE TPC wiremap from file protoDUNETPCChannelMap_RCE_v4.txt
PDSP Channel Map: Building FELIX TPC wiremap from file protoDUNETPCChannelMap_RCE_v4.txt
PDSP Channel Map: Building SSP channel map from file protoDUNESSPChannelMap_v1.txt
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
db: runtime1743410747
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 53 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 149 timestamp delta: 5920
31-Mar-2025 10:43:40 BST  Opened output file with pattern "%ifb_reco_stage1_%tc_keepup.root"
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 61 timestamp delta: 5984
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 48 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 47 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 14 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 3 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 30 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 80 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 35 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 94 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 65 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 79 timestamp delta: 5856
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 2 timestamp delta: 5984
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 30 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 71 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 87 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 39 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 85 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 76 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 77 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 91 timestamp delta: 6016
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 76 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 98 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 119 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 33 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 97 timestamp delta: 5824
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 109 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 122 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 138 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 9 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 100 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 144 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 77 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 85 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 88 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 16 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 67 timestamp delta: 2080
PDVDDataInterfaceWIBEth WARNING. APPARENT SKIPPED FRAME 68 timestamp delta: 2080
31-Mar-2025 11:02:11 BST  Closed output file "np02vd_raw_run035691_0550_df-s04-d0_dw_0_20250331T084547_reco_stage1_20250331T100211_keepup.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      16.5327       25.084         33.1         24.8553       4.81535        44     
--------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                    2.0296e-05    2.4907e-05    0.000132915   2.1378e-05    1.67214e-05      44     
produce:tpcrawdecoder:PDVDTPCReader             14.9032       23.4338       31.4334       23.2311       4.82351        44     
[art]:TriggerResults:TriggerResultInserter    1.0119e-05    1.2162e-05    4.1256e-05    1.10645e-05   4.59793e-06      44     
end_path:out1:RootOutput                       2.384e-06    3.19111e-06   1.4656e-05     2.703e-06    1.84683e-06      44     
end_path:out1:RootOutput(write)                 1.60307       1.64987       1.80529       1.64369      0.0323096       44     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1652.96 MB
  Peak resident set size usage (VmHWM): 915.481 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run035691_0550_df-s04-d0_dw_0_20250331T084547_reco_stage1_20250331T100211_keepup.root
\tHists: np02vd_raw_run035691_0550_df-s04-d0_dw_0_20250331T084547_reco_stage1_20250331T100212_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run035691_0550_df-s04-d0_dw_0_20250331T084547_reco_stage1_20250331T100211_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run035691_0550_df-s04-d0_dw_0_20250331T084547_reco_stage1_20250331T100211_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_03_01d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1743415332.0,
    "core.end_time": 1743415332.0,
    "core.events": [
      24201,
      24202,
      24203,
      24204,
      24205,
      24206,
      24207,
      24208,
      24209,
      24210,
      24211,
      24212,
      24213,
      24214,
      24215,
      24216,
      24217,
      24218,
      24219,
      24220,
      24221,
      24222,
      24223,
      24224,
      24225,
      24226,
      24227,
      24228,
      24229,
      24230,
      24231,
      24232,
      24233,
      24234,
      24235,
      24236,
      24237,
      24238,
      24239,
      24240,
      24241,
      24242,
      24243,
      24244
    ],
    "core.event_count": 44,
    "core.first_event_number": 24201,
    "core.last_event_number": 24244,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      35691
    ],
    "core.runs_subruns": [
      3569100001
    ],
    "dune.daq_test": true,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run035691_0550_df-s04-d0_dw_0_20250331T084547.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run035691_0550_df-s04-d0_dw_0_20250331T084547_reco_stage1_20250331T100212_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_03_01d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1743415332.0,
    "core.end_time": 1743415332.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      35691
    ],
    "core.runs_subruns": [
      3569100001
    ],
    "dune.daq_test": true,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run035691_0550_df-s04-d0_dw_0_20250331T084547.hdf5"
    }
  ]
}
justIN time: 2025-04-03 08:18:44 UTC       justIN version: 01.03.00