justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 418024.103@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID418024.103@justin-prod-sched01.dune.hep.ac.uk
Workflow ID7774
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-19 14:00:12
SiteUK_Brunel
EntryCMSHTPC_T2_UK_London_Brunel_dc2_22
Last heartbeat2025-06-20 00:27:28
From worker nodeHostnamewn-b7-05-00.brunel.ac.uk
cpuinfoIntel(R) Xeon(R) CPU E5645 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes6815744000 (6500 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-19 14:40:34
Input filesmonte-carlo-007774-000091
JobscriptExit code0
Real time9h (34478s)
CPU time9h (33035s = 95%)
Max RSS bytes10427006976 (9943 MiB)
Outputting started2025-06-20 00:15:13
Output filesusertests:prod_cosmics_only_protodunehd_1_418024_103_1750344043_reco_nest.root
usertests:prod_cosmics_only_protodunehd_1_418024_103_1750344043_reco_box.root
usertests:prod_cosmics_only_protodunehd_1_418024_103_1750344043_reco_box_sce.root
Finished2025-06-20 00:27:28
Saved logsjustin-logs:418024.103-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

meSaver: no samples within desired window for channel 9532
wclsFrameSaver: no samples within desired window for channel 9534
wclsFrameSaver: no samples within desired window for channel 9550
wclsFrameSaver: no samples within desired window for channel 9558
FrameSaver: q=2.0467e+06 n=924102 tag=wiener
20-Jun-2025 01:14:32 BST  Closed output file "prod_cosmics_only_protodunehd_1_418024_103_1750344043_reco_box_sce.root"
20-Jun-2025 01:14:32 BST  Closed input file "prod_cosmics_only_protodunehd_1_418024_103_1750344043_detsim_box_sce.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            202.513       250.934       283.339       253.907       21.7673        10     
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                              0.000786283   0.00386711    0.00736795    0.00385524    0.00208063       10     
reco:opdec:Deconvolution                              1.38166       1.61066       2.0568        1.5649       0.189434        10     
reco:ophitspe:OpHitFinderDeco                        0.302941      0.335329      0.387318      0.331909      0.0205713       10     
reco:opflash:OpFlashFinder                            0.10876      0.158204      0.229666      0.151468      0.0309713       10     
reco:opslicer:OpSlicer                               0.505546      0.691359      0.923866      0.673274      0.106312        10     
reco:wclsdatahd:WireCellToolkit                       84.6319       92.832        102.207       91.9975       6.20355        10     
reco:gaushit:GausHitFinder                            1.11968       1.38174       1.56167       1.43291      0.144508        10     
reco:nhitsfilter:NumberOfHitsFilter                 0.000356133   0.000596356   0.000784003   0.000595302   0.000121239      10     
reco:reco3d:SpacePointSolver                         0.264316      0.749702       1.27801       0.66357      0.292947        10     
reco:hitpdune:DisambigFromSpacePoints                0.532958       1.10745       1.45145       1.14444      0.265732        10     
reco:pandora:StandardPandora                          15.3507       23.8271       37.3108       24.0346       6.38881        10     
reco:pandoraWriter:StandardPandora                   0.235642      0.314515      0.356825      0.314912      0.0349936       10     
reco:pandoraTrack:LArPandoraTrackCreation             1.68304       2.09701       2.85835       2.09892      0.342811        10     
reco:pandoraShower:LArPandoraShowerCreation           1.39385       2.5429        3.37341       2.55692      0.579412        10     
reco:pandoracalo:Calorimetry                         0.873473       1.04226       1.33518       1.02003      0.131092        10     
reco:pandoracalonosce:Calorimetry                    0.848467       1.01436       1.31174      0.980997       0.12588        10     
reco:pandoraShowercalo:ShowerCalorimetry              1.34407       2.39514       3.10782       2.47439      0.464239        10     
reco:pandoraShowercalonosce:ShowerCalorimetry         1.28012       2.3506        3.0114        2.45345      0.460403        10     
reco:pandoraGnocchicalo:GnocchiCalorimetry            0.04883      0.0742935     0.0883273     0.0748297     0.0106655       10     
reco:pandoraGnocchicalonosce:GnocchiCalorimetry      0.0486391     0.073619      0.0865726     0.074275      0.0101004       10     
reco:emtrkmichelid:EmTrackMichelId                    68.6278       93.3265       109.228       96.7093       11.0503        10     
reco:crttag:SingleCRTMatchingProducer               0.00651959    0.00911068     0.0119706     0.0088962    0.00142424       10     
reco:crtreco:TwoCRTMatchingProducer                 0.00554297    0.00759228    0.00901419    0.00737488    0.000980625      10     
reco:pandora2Track:LArPandoraTrackCreation            3.70911       6.82297       8.94138       7.10584       1.43365        10     
reco:pandora2calo:ShowerCalorimetry                   1.27848       2.24586       2.82885       2.41951      0.455778        10     
reco:pandora2calonosce:ShowerCalorimetry              1.23978       2.20066       2.77392       2.35865      0.441905        10     
reco:pandora2Gnocchicalo:GnocchiCalorimetry          0.0496629     0.074817      0.0859044     0.0783057    0.00982171       10     
reco:pandora2Gnocchicalonosce:GnocchiCalorimetry     0.050412      0.0738877     0.0848866     0.0754313    0.00920631       10     
reco:pandora2Shower:LArPandoraShowerCreation          1.61829       2.8449        3.82521       2.92086      0.638243        10     
reco:pandora2Showercalo:ShowerCalorimetry             1.82886       2.8442        3.91987       2.94216      0.554862        10     
reco:pandora2Showercalonosce:ShowerCalorimetry        1.78093       2.77943       3.80215       2.88979      0.530432        10     
[art]:TriggerResults:TriggerResultInserter          3.0929e-05    3.87415e-05   8.5117e-05    3.34615e-05   1.55942e-05      10     
end_path:out1:RootOutput                             9.041e-06    1.14543e-05   2.7392e-05     9.583e-06    5.33773e-06      10     
end_path:out1:RootOutput(write)                       2.53284       3.02042       3.48448       2.95867      0.266012        10     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5919.17 MB
  Peak resident set size usage (VmHWM): 3700.87 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'prod_cosmics_only_protodunehd_1_418024_103_1750344043_reco_box_sce.root', 'start_time': 1750375708.8918574, 'end_time': 1750378474.3233159}
Output files:
   Reco: prod_cosmics_only_protodunehd_1_418024_103_1750344043_reco_box.root
prod_cosmics_only_protodunehd_1_418024_103_1750344043_reco_box_sce.root
prod_cosmics_only_protodunehd_1_418024_103_1750344043_reco_nest.root
Forming reco metadata
  subrun: 1 -> reco file: prod_cosmics_only_protodunehd_1_418024_103_1750344043_reco_box.root
    KEY: reco_box
    FCL:  standard_reco_protodunehd_MC.fcl
TClass::Init:0: RuntimeWarning: no dictionary for class sim::IDE is available
Successfully opened file prod_cosmics_only_protodunehd_1_418024_103_1750344043_reco_box.root
  Ran successfully
{
  "name": "prod_cosmics_only_protodunehd_1_418024_103_1750344043_reco_box.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_06_00d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_protodunehd_MC.fcl",
    "dune.campaign": "pdhd-LE-test",
    "core.start_time": 1750344042.0,
    "core.end_time": 1750378475.0,
    "core.runs": 1,
    "core.subruns": 1,
    "core.events": [
      1,
      2,
      3,
      4,
      5,
      6,
      7,
      8,
      9,
      10
    ],
    "core.event_count": 10,
    "core.first_event_number": 1,
    "core.last_event_number": 10
  }
}  subrun: 2 -> reco file: prod_cosmics_only_protodunehd_1_418024_103_1750344043_reco_box_sce.root
    KEY: reco_box_sce
    FCL:  standard_reco_protodunehd_MC.fcl
TClass::Init:0: RuntimeWarning: no dictionary for class sim::IDE is available
Successfully opened file prod_cosmics_only_protodunehd_1_418024_103_1750344043_reco_box_sce.root
  Ran successfully
{
  "name": "prod_cosmics_only_protodunehd_1_418024_103_1750344043_reco_box_sce.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_06_00d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_protodunehd_MC.fcl",
    "dune.campaign": "pdhd-LE-test",
    "core.start_time": 1750344042.0,
    "core.end_time": 1750378475.0,
    "core.runs": 1,
    "core.subruns": 1,
    "core.events": [
      1,
      2,
      3,
      4,
      5,
      6,
      7,
      8,
      9,
      10
    ],
    "core.event_count": 10,
    "core.first_event_number": 1,
    "core.last_event_number": 10
  }
}  subrun: 3 -> reco file: prod_cosmics_only_protodunehd_1_418024_103_1750344043_reco_nest.root
    KEY: reco_nest
    FCL:  standard_reco_protodunehd_MC.fcl
TClass::Init:0: RuntimeWarning: no dictionary for class sim::IDE is available
Successfully opened file prod_cosmics_only_protodunehd_1_418024_103_1750344043_reco_nest.root
  Ran successfully
{
  "name": "prod_cosmics_only_protodunehd_1_418024_103_1750344043_reco_nest.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_06_00d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_protodunehd_MC.fcl",
    "dune.campaign": "pdhd-LE-test",
    "core.start_time": 1750344042.0,
    "core.end_time": 1750378475.0,
    "core.runs": 1,
    "core.subruns": 1,
    "core.events": [
      1,
      2,
      3,
      4,
      5,
      6,
      7,
      8,
      9,
      10
    ],
    "core.event_count": 10,
    "core.first_event_number": 1,
    "core.last_event_number": 10
  }
}
justIN time: 2025-08-14 17:53:40 UTC       justIN version: 01.03.02