justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 226763.4@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID226763.4@justin-prod-sched02.dune.hep.ac.uk
Workflow ID7765
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-20 19:07:28
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce04
Last heartbeat2025-06-20 22:19:17
From worker nodeHostnameccwcondor0502
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes6815744000 (6500 MiB)
Wall seconds limit106200 (29 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-20 19:53:26
Input filesmonte-carlo-007765-000028
JobscriptExit code0
Real time2h (8519s)
CPU time2h (8096s = 95%)
Max RSS bytes2301095936 (2194 MiB)
Outputting started2025-06-20 22:15:26
Output filesusertests:prod_39Ar_protodunehd_1_226763_4_1750449391_reco_nest.root
usertests:prod_39Ar_protodunehd_1_226763_4_1750449391_reco_box_sce.root
usertests:prod_39Ar_protodunehd_1_226763_4_1750449391_reco_box.root
Finished2025-06-20 22:19:17
Saved logsjustin-logs:226763.4-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

les within desired window for channel 9707
wclsFrameSaver: no samples within desired window for channel 9747
FrameSaver: q=135202 n=319269 tag=wiener
21-Jun-2025 00:15:06 CEST  Closed output file "prod_39Ar_protodunehd_1_226763_4_1750449391_reco_box_sce.root"
21-Jun-2025 00:15:06 CEST  Closed input file "prod_39Ar_protodunehd_1_226763_4_1750449391_detsim_box_sce.root"

======================================================================================================================================
TimeTracker printout (sec)                              Min           Avg           Max         Median          RMS         nEvts   
======================================================================================================================================
Full event                                            50.3249       55.4321       59.1583       55.5149       2.3715         20     
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                              0.000802356   0.00162548    0.00237157    0.00168782    0.000366846      20     
reco:opdec:Deconvolution                             0.163749      0.199197       0.24923      0.199092      0.0166551       20     
reco:ophitspe:OpHitFinderDeco                        0.112796      0.175196      0.199503      0.184001      0.0254512       20     
reco:opflash:OpFlashFinder                          0.000322239   0.000540398   0.00248833    0.000433553   0.000451903      20     
reco:opslicer:OpSlicer                              6.9842e-05    0.000124126   0.000551802   9.81005e-05   0.000100294      20     
reco:wclsdatahd:WireCellToolkit                       45.1644       50.8981       54.7811       51.2441       2.69601        20     
reco:gaushit:GausHitFinder                           0.0480459     0.0659279     0.0760241     0.0685989    0.00891001       20     
reco:nhitsfilter:NumberOfHitsFilter                  3.684e-05    6.10264e-05   0.000237178   5.1482e-05    4.14415e-05      20     
reco:reco3d:SpacePointSolver                        0.00241589    0.00574823     0.0131675    0.00342312    0.00373393       20     
reco:hitpdune:DisambigFromSpacePoints                0.0015706    0.00245623    0.00521629    0.00242677    0.000751292      20     
reco:pandora:StandardPandora                         0.192197      0.365709       2.03233      0.252053      0.398133        20     
reco:pandoraWriter:StandardPandora                   0.0132587     0.0205846     0.0306648     0.0208673    0.00415986       20     
reco:pandoraTrack:LArPandoraTrackCreation           0.000184648   0.000538499   0.00350984    0.000261218   0.000848051      20     
reco:pandoraShower:LArPandoraShowerCreation         0.000102243   0.000186047   0.000666068   0.000144583   0.000135993      20     
reco:pandoracalo:Calorimetry                        0.000122913   0.000355257   0.00287607    0.000168253   0.000618731      20     
reco:pandoracalonosce:Calorimetry                   6.2358e-05    0.000108516   0.000389195   9.08215e-05   6.86937e-05      20     
reco:pandoraShowercalo:ShowerCalorimetry            5.9823e-05    0.000115216   0.000658373   8.29765e-05   0.000126212      20     
reco:pandoraShowercalonosce:ShowerCalorimetry       4.6939e-05    7.32177e-05   0.000118834   7.0278e-05    1.81937e-05      20     
reco:pandoraGnocchicalo:GnocchiCalorimetry          7.6314e-05    0.000258139   0.00208051    0.000119591   0.000462313      20     
reco:pandoraGnocchicalonosce:GnocchiCalorimetry      6.902e-05    0.000108836   0.000341285   9.4328e-05    5.57135e-05      20     
reco:emtrkmichelid:EmTrackMichelId                    2.25344       3.26679       3.81157       3.30701      0.296517        20     
reco:crttag:SingleCRTMatchingProducer               0.000367995   0.000572658    0.0018643    0.000457048   0.000333778      20     
reco:crtreco:TwoCRTMatchingProducer                 0.000104458   0.000184241   0.000486509   0.000159977   8.2991e-05       20     
reco:pandora2Track:LArPandoraTrackCreation          0.000123853   0.000188254   0.000277674   0.000180756   3.81826e-05      20     
reco:pandora2calo:ShowerCalorimetry                 7.2617e-05    0.00010971    0.000141418   0.000108766   1.47292e-05      20     
reco:pandora2calonosce:ShowerCalorimetry            4.8883e-05    8.89806e-05   0.000277003   7.85835e-05   4.4626e-05       20     
reco:pandora2Gnocchicalo:GnocchiCalorimetry         8.2596e-05    0.000136383    0.0002221    0.00012708    3.27139e-05      20     
reco:pandora2Gnocchicalonosce:GnocchiCalorimetry    6.4191e-05    0.000109504   0.000138301   0.000107889   1.91223e-05      20     
reco:pandora2Shower:LArPandoraShowerCreation        9.2705e-05    0.000238703   0.00202602    0.000139408   0.000410896      20     
reco:pandora2Showercalo:ShowerCalorimetry           5.3972e-05    0.000126961   0.000929877   8.3032e-05    0.00018479       20     
reco:pandora2Showercalonosce:ShowerCalorimetry      4.9784e-05    7.74704e-05   0.000119135   7.7276e-05    1.42476e-05      20     
[art]:TriggerResults:TriggerResultInserter          1.6361e-05    2.27754e-05   5.7609e-05     2.125e-05    8.38573e-06      20     
end_path:out1:RootOutput                             6.382e-06    8.4359e-06    2.1501e-05     7.95e-06     3.08135e-06      20     
end_path:out1:RootOutput(write)                      0.288365      0.401923      0.517293      0.402694      0.0407744       20     
======================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4485.94 MB
  Peak resident set size usage (VmHWM): 2288.93 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'prod_39Ar_protodunehd_1_226763_4_1750449391_reco_box_sce.root', 'start_time': 1750456549.1514947, 'end_time': 1750457706.5566747}
Output files:
   Reco: prod_39Ar_protodunehd_1_226763_4_1750449391_reco_box.root
prod_39Ar_protodunehd_1_226763_4_1750449391_reco_box_sce.root
prod_39Ar_protodunehd_1_226763_4_1750449391_reco_nest.root
Forming reco metadata
  subrun: 1 -> reco file: prod_39Ar_protodunehd_1_226763_4_1750449391_reco_box.root
    KEY: reco_box
    FCL:  standard_reco_protodunehd_MC.fcl
TClass::Init:0: RuntimeWarning: no dictionary for class sim::IDE is available
Successfully opened file prod_39Ar_protodunehd_1_226763_4_1750449391_reco_box.root
  Ran successfully
{
  "name": "prod_39Ar_protodunehd_1_226763_4_1750449391_reco_box.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_06_00d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_protodunehd_MC.fcl",
    "dune.campaign": "pdhd-LE-test",
    "core.start_time": 1750449390.0,
    "core.end_time": 1750457706.0,
    "core.runs": 1,
    "core.subruns": 1,
    "core.events": [
      1,
      2,
      3,
      4,
      5,
      6,
      7,
      8,
      9,
      10,
      11,
      12,
      13,
      14,
      15,
      16,
      17,
      18,
      19,
      20
    ],
    "core.event_count": 20,
    "core.first_event_number": 1,
    "core.last_event_number": 20
  }
}  subrun: 2 -> reco file: prod_39Ar_protodunehd_1_226763_4_1750449391_reco_box_sce.root
    KEY: reco_box_sce
    FCL:  standard_reco_protodunehd_MC.fcl
TClass::Init:0: RuntimeWarning: no dictionary for class sim::IDE is available
Successfully opened file prod_39Ar_protodunehd_1_226763_4_1750449391_reco_box_sce.root
  Ran successfully
{
  "name": "prod_39Ar_protodunehd_1_226763_4_1750449391_reco_box_sce.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_06_00d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_protodunehd_MC.fcl",
    "dune.campaign": "pdhd-LE-test",
    "core.start_time": 1750449390.0,
    "core.end_time": 1750457706.0,
    "core.runs": 1,
    "core.subruns": 1,
    "core.events": [
      1,
      2,
      3,
      4,
      5,
      6,
      7,
      8,
      9,
      10,
      11,
      12,
      13,
      14,
      15,
      16,
      17,
      18,
      19,
      20
    ],
    "core.event_count": 20,
    "core.first_event_number": 1,
    "core.last_event_number": 20
  }
}  subrun: 3 -> reco file: prod_39Ar_protodunehd_1_226763_4_1750449391_reco_nest.root
    KEY: reco_nest
    FCL:  standard_reco_protodunehd_MC.fcl
TClass::Init:0: RuntimeWarning: no dictionary for class sim::IDE is available
Successfully opened file prod_39Ar_protodunehd_1_226763_4_1750449391_reco_nest.root
  Ran successfully
{
  "name": "prod_39Ar_protodunehd_1_226763_4_1750449391_reco_nest.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_06_00d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_protodunehd_MC.fcl",
    "dune.campaign": "pdhd-LE-test",
    "core.start_time": 1750449390.0,
    "core.end_time": 1750457706.0,
    "core.runs": 1,
    "core.subruns": 1,
    "core.events": [
      1,
      2,
      3,
      4,
      5,
      6,
      7,
      8,
      9,
      10,
      11,
      12,
      13,
      14,
      15,
      16,
      17,
      18,
      19,
      20
    ],
    "core.event_count": 20,
    "core.first_event_number": 1,
    "core.last_event_number": 20
  }
}
justIN time: 2025-08-14 21:49:21 UTC       justIN version: 01.03.02