justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 228784.1@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID228784.1@justin-prod-sched02.dune.hep.ac.uk
Workflow ID7774
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-24 16:24:46
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce01
Last heartbeat2025-06-25 05:12:25
From worker nodeHostnamedune001-7714312.0-lcg2638.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes6815744000 (6500 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-24 20:22:18
Input filesmonte-carlo-007774-000081
JobscriptExit code0
Real time8h (30750s)
CPU time8h (30198s = 98%)
Max RSS bytes11501125632 (10968 MiB)
Outputting started2025-06-25 04:54:49
Output filesusertests:prod_cosmics_only_protodunehd_1_228784_1_1750796552_reco_nest.root
usertests:prod_cosmics_only_protodunehd_1_228784_1_1750796552_reco_box.root
usertests:prod_cosmics_only_protodunehd_1_228784_1_1750796552_reco_box_sce.root
Finished2025-06-25 05:12:01
Saved logsjustin-logs:228784.1-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

dow for channel 9682
wclsFrameSaver: no samples within desired window for channel 9745
wclsFrameSaver: no samples within desired window for channel 9746
wclsFrameSaver: no samples within desired window for channel 9747
wclsFrameSaver: no samples within desired window for channel 9748
FrameSaver: q=2.89094e+06 n=1316425 tag=wiener
25-Jun-2025 04:54:15 UTC  Closed output file "prod_cosmics_only_protodunehd_1_228784_1_1750796552_reco_box_sce.root"
25-Jun-2025 04:54:15 UTC  Closed input file "prod_cosmics_only_protodunehd_1_228784_1_1750796552_detsim_box_sce.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            124.462       174.086       274.009       159.039       43.6274        10     
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                              0.00118242    0.00565903     0.011366       0.00563     0.00266438       10     
reco:opdec:Deconvolution                             0.957843       1.37772       1.66604       1.42521      0.273618        10     
reco:ophitspe:OpHitFinderDeco                        0.182933      0.285186      0.376364      0.320492      0.076636        10     
reco:opflash:OpFlashFinder                           0.125064      0.180928      0.281914      0.173188       0.05065        10     
reco:opslicer:OpSlicer                               0.454931      0.690117       1.05829       0.74147      0.191756        10     
reco:wclsdatahd:WireCellToolkit                       51.3703       56.2111       61.068        56.3714       2.67563        10     
reco:gaushit:GausHitFinder                            0.60856       1.00177       1.72874      0.891632      0.315399        10     
reco:nhitsfilter:NumberOfHitsFilter                 0.000399533   0.000826974   0.00114201    0.000882591   0.000270163      10     
reco:reco3d:SpacePointSolver                         0.538734       1.03381       2.13212      0.944467      0.476512        10     
reco:hitpdune:DisambigFromSpacePoints                0.307511      0.786276       1.35954      0.736154       0.32768        10     
reco:pandora:StandardPandora                          11.4768       23.0373       41.9697       20.5553       9.11288        10     
reco:pandoraWriter:StandardPandora                    0.24922      0.401791      0.689377      0.357191      0.139603        10     
reco:pandoraTrack:LArPandoraTrackCreation            0.878028       2.8503        5.69417       2.35021       1.56049        10     
reco:pandoraShower:LArPandoraShowerCreation          0.871756       3.69226       9.9367        2.79025       2.69436        10     
reco:pandoracalo:Calorimetry                         0.426811       1.55733       3.45609       1.32056      0.868525        10     
reco:pandoracalonosce:Calorimetry                    0.422482       1.51059       3.27588       1.20655      0.827986        10     
reco:pandoraShowercalo:ShowerCalorimetry              1.22386       3.49036       9.31852       3.02263       2.23313        10     
reco:pandoraShowercalonosce:ShowerCalorimetry         1.15396       3.11391       9.35499       2.3364        2.27647        10     
reco:pandoraGnocchicalo:GnocchiCalorimetry           0.0502604     0.0855476     0.113675      0.0898542     0.0190723       10     
reco:pandoraGnocchicalonosce:GnocchiCalorimetry      0.0601194     0.0833062     0.118551      0.0828411     0.0175325       10     
reco:emtrkmichelid:EmTrackMichelId                    32.849        44.1707       62.5931       42.2273       9.33847        10     
reco:crttag:SingleCRTMatchingProducer               0.00719872     0.0111818     0.020819     0.00923998    0.00431939       10     
reco:crtreco:TwoCRTMatchingProducer                 0.00560518    0.00865069     0.0149451    0.00637615    0.00346276       10     
reco:pandora2Track:LArPandoraTrackCreation            4.06666       9.02709       23.8352       6.87403       5.83704        10     
reco:pandora2calo:ShowerCalorimetry                   1.45131       3.10966       9.87751       2.00674       2.56034        10     
reco:pandora2calonosce:ShowerCalorimetry              1.6302        2.70117       6.9033        2.01973       1.61535        10     
reco:pandora2Gnocchicalo:GnocchiCalorimetry          0.0499307     0.0808643     0.106343      0.0795726     0.0153442       10     
reco:pandora2Gnocchicalonosce:GnocchiCalorimetry     0.0440686     0.0769398     0.108004      0.0751204     0.0166932       10     
reco:pandora2Shower:LArPandoraShowerCreation          1.93747       3.38503       7.47632       2.79589       1.65608        10     
reco:pandora2Showercalo:ShowerCalorimetry             1.96805       3.46977       6.55856       3.07901       1.46121        10     
reco:pandora2Showercalonosce:ShowerCalorimetry        1.81677       3.4289        6.60364       2.76439       1.60104        10     
[art]:TriggerResults:TriggerResultInserter           3.52e-05     6.51385e-05   0.000136041   6.00605e-05   2.65202e-05      10     
end_path:out1:RootOutput                             4.331e-06    1.09711e-05     3.7e-05      7.12e-06     9.2349e-06       10     
end_path:out1:RootOutput(write)                       2.27915       3.04156       3.5677        3.06362      0.442296        10     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 6828.83 MB
  Peak resident set size usage (VmHWM): 4239.01 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'prod_cosmics_only_protodunehd_1_228784_1_1750796552_reco_box_sce.root', 'start_time': 1750825349.7517354, 'end_time': 1750827257.4650524}
Output files:
   Reco: prod_cosmics_only_protodunehd_1_228784_1_1750796552_reco_box.root
prod_cosmics_only_protodunehd_1_228784_1_1750796552_reco_box_sce.root
prod_cosmics_only_protodunehd_1_228784_1_1750796552_reco_nest.root
Forming reco metadata
  subrun: 1 -> reco file: prod_cosmics_only_protodunehd_1_228784_1_1750796552_reco_box.root
    KEY: reco_box
    FCL:  standard_reco_protodunehd_MC.fcl
TClass::Init:0: RuntimeWarning: no dictionary for class sim::IDE is available
Successfully opened file prod_cosmics_only_protodunehd_1_228784_1_1750796552_reco_box.root
  Ran successfully
{
  "name": "prod_cosmics_only_protodunehd_1_228784_1_1750796552_reco_box.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_06_00d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_protodunehd_MC.fcl",
    "dune.campaign": "pdhd-LE-test",
    "core.start_time": 1750796551.0,
    "core.end_time": 1750827264.0,
    "core.runs": 1,
    "core.subruns": 1,
    "core.events": [
      1,
      2,
      3,
      4,
      5,
      6,
      7,
      8,
      9,
      10
    ],
    "core.event_count": 10,
    "core.first_event_number": 1,
    "core.last_event_number": 10
  }
}  subrun: 2 -> reco file: prod_cosmics_only_protodunehd_1_228784_1_1750796552_reco_box_sce.root
    KEY: reco_box_sce
    FCL:  standard_reco_protodunehd_MC.fcl
TClass::Init:0: RuntimeWarning: no dictionary for class sim::IDE is available
Successfully opened file prod_cosmics_only_protodunehd_1_228784_1_1750796552_reco_box_sce.root
  Ran successfully
{
  "name": "prod_cosmics_only_protodunehd_1_228784_1_1750796552_reco_box_sce.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_06_00d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_protodunehd_MC.fcl",
    "dune.campaign": "pdhd-LE-test",
    "core.start_time": 1750796551.0,
    "core.end_time": 1750827264.0,
    "core.runs": 1,
    "core.subruns": 1,
    "core.events": [
      1,
      2,
      3,
      4,
      5,
      6,
      7,
      8,
      9,
      10
    ],
    "core.event_count": 10,
    "core.first_event_number": 1,
    "core.last_event_number": 10
  }
}  subrun: 3 -> reco file: prod_cosmics_only_protodunehd_1_228784_1_1750796552_reco_nest.root
    KEY: reco_nest
    FCL:  standard_reco_protodunehd_MC.fcl
TClass::Init:0: RuntimeWarning: no dictionary for class sim::IDE is available
Successfully opened file prod_cosmics_only_protodunehd_1_228784_1_1750796552_reco_nest.root
  Ran successfully
{
  "name": "prod_cosmics_only_protodunehd_1_228784_1_1750796552_reco_nest.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_06_00d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_protodunehd_MC.fcl",
    "dune.campaign": "pdhd-LE-test",
    "core.start_time": 1750796551.0,
    "core.end_time": 1750827264.0,
    "core.runs": 1,
    "core.subruns": 1,
    "core.events": [
      1,
      2,
      3,
      4,
      5,
      6,
      7,
      8,
      9,
      10
    ],
    "core.event_count": 10,
    "core.first_event_number": 1,
    "core.last_event_number": 10
  }
}
justIN time: 2025-08-15 06:41:05 UTC       justIN version: 01.03.02