justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 226763.3@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID226763.3@justin-prod-sched02.dune.hep.ac.uk
Workflow ID7765
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-20 19:07:28
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce03
Last heartbeat2025-06-20 22:19:33
From worker nodeHostnameccwcondor0461
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes6815744000 (6500 MiB)
Wall seconds limit106200 (29 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-20 19:53:49
Input filesmonte-carlo-007765-000076
JobscriptExit code0
Real time2h (8503s)
CPU time2h (8054s = 94%)
Max RSS bytes2300108800 (2193 MiB)
Outputting started2025-06-20 22:15:32
Output filesusertests:prod_39Ar_protodunehd_1_226763_3_1750449391_reco_nest.root
usertests:prod_39Ar_protodunehd_1_226763_3_1750449391_reco_box_sce.root
usertests:prod_39Ar_protodunehd_1_226763_3_1750449391_reco_box.root
Finished2025-06-20 22:19:33
Saved logsjustin-logs:226763.3-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

les within desired window for channel 9261
wclsFrameSaver: no samples within desired window for channel 9723
FrameSaver: q=135623 n=319704 tag=wiener
21-Jun-2025 00:15:16 CEST  Closed output file "prod_39Ar_protodunehd_1_226763_3_1750449391_reco_box_sce.root"
21-Jun-2025 00:15:16 CEST  Closed input file "prod_39Ar_protodunehd_1_226763_3_1750449391_detsim_box_sce.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            46.6073       53.571        59.4868       55.1993       4.50388        20     
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                              0.000824403   0.00156371    0.00239318    0.00149516    0.000428799      20     
reco:opdec:Deconvolution                             0.140586      0.178554      0.215395      0.191487      0.0244648       20     
reco:ophitspe:OpHitFinderDeco                         0.11002      0.158989      0.198786      0.175384      0.0354112       20     
reco:opflash:OpFlashFinder                          0.000271512   0.000526122   0.00214838    0.000442157   0.000384687      20     
reco:opslicer:OpSlicer                              5.5355e-05    0.000169906   0.00105346    0.000107236   0.000220498      20     
reco:wclsdatahd:WireCellToolkit                       41.391        48.9646       54.5801       50.8006       4.42368        20     
reco:gaushit:GausHitFinder                           0.0478682     0.0609811     0.0749691     0.0619606    0.00974401       20     
reco:nhitsfilter:NumberOfHitsFilter                 3.9304e-05    6.5575e-05    0.000214083   5.3671e-05    3.74869e-05      20     
reco:reco3d:SpacePointSolver                        0.00237545    0.00484743     0.0110302    0.00306447    0.00334457       20     
reco:hitpdune:DisambigFromSpacePoints               0.00153641    0.00229482    0.00360092    0.00230424    0.000534879      20     
reco:pandora:StandardPandora                         0.187835      0.445832       2.06597      0.290102      0.396039        20     
reco:pandoraWriter:StandardPandora                   0.0129112     0.0205593     0.0327797     0.0209456    0.00493262       20     
reco:pandoraTrack:LArPandoraTrackCreation           0.000242296   0.000764493   0.00497768    0.000350911   0.00120154       20     
reco:pandoraShower:LArPandoraShowerCreation         0.000112242   0.000194571   0.000893944   0.000162451   0.000163586      20     
reco:pandoracalo:Calorimetry                        0.000152487   0.000397357   0.00223816    0.000212265   0.000535715      20     
reco:pandoracalonosce:Calorimetry                   6.4401e-05    0.000112959    0.0002175    0.000101487   3.99702e-05      20     
reco:pandoraShowercalo:ShowerCalorimetry             6.366e-05    0.000123799    0.0008444    8.7455e-05    0.000165814      20     
reco:pandoraShowercalonosce:ShowerCalorimetry       4.9864e-05    7.38106e-05   0.000134213   6.87895e-05   2.21297e-05      20     
reco:pandoraGnocchicalo:GnocchiCalorimetry          7.7716e-05    0.000250475   0.00136715    0.000126884   0.000352601      20     
reco:pandoraGnocchicalonosce:GnocchiCalorimetry     6.7477e-05    0.000114702   0.000202401   0.000108204   3.5984e-05       20     
reco:emtrkmichelid:EmTrackMichelId                    2.43205       3.3077        3.75862       3.35318      0.369583        20     
reco:crttag:SingleCRTMatchingProducer               0.000373323   0.00062772    0.00186523    0.000511458   0.000363343      20     
reco:crtreco:TwoCRTMatchingProducer                 9.9006e-05    0.000179403   0.000500974   0.000151761   9.34745e-05      20     
reco:pandora2Track:LArPandoraTrackCreation          0.000145344   0.000227686   0.000583439   0.000192021   9.86473e-05      20     
reco:pandora2calo:ShowerCalorimetry                 7.4881e-05    0.00010519    0.000141126   0.000104141   1.76503e-05      20     
reco:pandora2calonosce:ShowerCalorimetry            4.8391e-05    7.02813e-05   9.4938e-05    6.92655e-05   1.27021e-05      20     
reco:pandora2Gnocchicalo:GnocchiCalorimetry          7.952e-05    0.00013172    0.000224533   0.000123087   3.53139e-05      20     
reco:pandora2Gnocchicalonosce:GnocchiCalorimetry    6.6416e-05    0.00010156    0.000147007   9.54855e-05   1.92623e-05      20     
reco:pandora2Shower:LArPandoraShowerCreation        9.5049e-05    0.000250216   0.00223537    0.000138712   0.000456487      20     
reco:pandora2Showercalo:ShowerCalorimetry            5.827e-05    0.000154417   0.00107859    8.9288e-05    0.000218663      20     
reco:pandora2Showercalonosce:ShowerCalorimetry       5.284e-05    8.50853e-05   0.000145614   7.7611e-05    2.28719e-05      20     
[art]:TriggerResults:TriggerResultInserter          1.3836e-05    2.39086e-05   8.7455e-05    2.0253e-05    1.61927e-05      20     
end_path:out1:RootOutput                             3.347e-06    5.8425e-06    2.9706e-05     4.258e-06    5.6023e-06       20     
end_path:out1:RootOutput(write)                      0.307464       0.39408      0.484943       0.40408      0.0506107       20     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4491.94 MB
  Peak resident set size usage (VmHWM): 2295.07 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'prod_39Ar_protodunehd_1_226763_3_1750449391_reco_box_sce.root', 'start_time': 1750456595.1235952, 'end_time': 1750457717.2600064}
Output files:
   Reco: prod_39Ar_protodunehd_1_226763_3_1750449391_reco_box.root
prod_39Ar_protodunehd_1_226763_3_1750449391_reco_box_sce.root
prod_39Ar_protodunehd_1_226763_3_1750449391_reco_nest.root
Forming reco metadata
  subrun: 1 -> reco file: prod_39Ar_protodunehd_1_226763_3_1750449391_reco_box.root
    KEY: reco_box
    FCL:  standard_reco_protodunehd_MC.fcl
TClass::Init:0: RuntimeWarning: no dictionary for class sim::IDE is available
Successfully opened file prod_39Ar_protodunehd_1_226763_3_1750449391_reco_box.root
  Ran successfully
{
  "name": "prod_39Ar_protodunehd_1_226763_3_1750449391_reco_box.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_06_00d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_protodunehd_MC.fcl",
    "dune.campaign": "pdhd-LE-test",
    "core.start_time": 1750449390.0,
    "core.end_time": 1750457717.0,
    "core.runs": 1,
    "core.subruns": 1,
    "core.events": [
      1,
      2,
      3,
      4,
      5,
      6,
      7,
      8,
      9,
      10,
      11,
      12,
      13,
      14,
      15,
      16,
      17,
      18,
      19,
      20
    ],
    "core.event_count": 20,
    "core.first_event_number": 1,
    "core.last_event_number": 20
  }
}  subrun: 2 -> reco file: prod_39Ar_protodunehd_1_226763_3_1750449391_reco_box_sce.root
    KEY: reco_box_sce
    FCL:  standard_reco_protodunehd_MC.fcl
TClass::Init:0: RuntimeWarning: no dictionary for class sim::IDE is available
Successfully opened file prod_39Ar_protodunehd_1_226763_3_1750449391_reco_box_sce.root
  Ran successfully
{
  "name": "prod_39Ar_protodunehd_1_226763_3_1750449391_reco_box_sce.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_06_00d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_protodunehd_MC.fcl",
    "dune.campaign": "pdhd-LE-test",
    "core.start_time": 1750449390.0,
    "core.end_time": 1750457717.0,
    "core.runs": 1,
    "core.subruns": 1,
    "core.events": [
      1,
      2,
      3,
      4,
      5,
      6,
      7,
      8,
      9,
      10,
      11,
      12,
      13,
      14,
      15,
      16,
      17,
      18,
      19,
      20
    ],
    "core.event_count": 20,
    "core.first_event_number": 1,
    "core.last_event_number": 20
  }
}  subrun: 3 -> reco file: prod_39Ar_protodunehd_1_226763_3_1750449391_reco_nest.root
    KEY: reco_nest
    FCL:  standard_reco_protodunehd_MC.fcl
TClass::Init:0: RuntimeWarning: no dictionary for class sim::IDE is available
Successfully opened file prod_39Ar_protodunehd_1_226763_3_1750449391_reco_nest.root
  Ran successfully
{
  "name": "prod_39Ar_protodunehd_1_226763_3_1750449391_reco_nest.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_06_00d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_protodunehd_MC.fcl",
    "dune.campaign": "pdhd-LE-test",
    "core.start_time": 1750449390.0,
    "core.end_time": 1750457717.0,
    "core.runs": 1,
    "core.subruns": 1,
    "core.events": [
      1,
      2,
      3,
      4,
      5,
      6,
      7,
      8,
      9,
      10,
      11,
      12,
      13,
      14,
      15,
      16,
      17,
      18,
      19,
      20
    ],
    "core.event_count": 20,
    "core.first_event_number": 1,
    "core.last_event_number": 20
  }
}
justIN time: 2025-08-14 23:46:19 UTC       justIN version: 01.03.02