justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266105.12@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID266105.12@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3552
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-29 00:27:52
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-09-29 02:10:31
From worker nodeHostnamewn2204250.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7513 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-29 00:29:36
Input fileshd-protodune:np04hd_raw_run029389_0026_dataflow1_datawriter_0_20240928T231019.hdf5
JobscriptExit code0
Real time1h (5943s)
CPU time1h (5108s = 85%)
Outputting started2024-09-29 02:08:40
Output fileshd-protodune-det-reco:np04hd_raw_run029389_0026_dataflow1_datawriter_0_20240928T231019_reco_stage1_reco_stage2_20240929T020828_keepup.root
hd-protodune-det-reco:np04hd_raw_run029389_0026_dataflow1_datawriter_0_20240928T231019_reco_stage1_reco_stage2_20240929T020828_keepup_hists.root
Finished2024-09-29 02:10:31
Saved logsjustin-logs:266105.12-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

27835 0.0422077 0.0118113 
----view 1: 0.000101864 0.000101805 0.000101864 0.000101805 0.000101805 0.000101864 0.000101805 0.000101864 0.000101805 0.000101864 0.000101805 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.0231285 0.0130301 0.0264254 0.0258865 0.0235128 0.0309687 0.0400696 0.0327835 0.0422077 0.0118113 0.00429726 
----view 1: 0.000101805 0.000101864 0.000101805 0.000101805 0.000101864 0.000101805 0.000101864 0.000101805 0.000101864 0.000101805 0.000101864 
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 2105 TrkackID 17 startx, y, z 58.8332 155.532 160.036  wireno, peakt tpcno 319 671.033 1 dist 128.503min T, max_T0.515254 717.895
no of hits closeby  0   event 2105 TrkackID 17 startx, y, z 58.8332 155.532 160.036  wireno, peakt tpcno 319 671.033 1 dist 128.503min T, max_T0.515254 717.895
29-Sep-2024 03:08:28 BST  Closed output file "np04hd_raw_run029389_0026_dataflow1_datawriter_0_20240928T231019_reco_stage1_reco_stage2_20240929T020828_keepup.root"
29-Sep-2024 03:08:28 BST  Closed input file "np04hd_raw_run029389_0026_dataflow1_datawriter_0_20240928T231019_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              79.0421       109.293       196.678       100.356       28.7413        39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00189243    0.00388747     0.0101286    0.00375144    0.00158422       39     
produce:fembfilter:PDHDFEMBFilter                      0.765578      0.813541      0.963132      0.806273      0.0440095       39     
produce:wclsdatahd:WireCellToolkit                      39.9744       43.2043       46.3212       43.2235       1.26623        39     
produce:gaushit:GausHitFinder                          0.561741       0.87152       1.39223      0.819667      0.209108        39     
produce:nhitsfilter:NumberOfHitsFilter                0.000300996   0.000538865   0.00427737    0.000432734   0.000610343      39     
produce:reco3d:SpacePointSolver                        0.273132       2.60194       12.4102       1.01858       3.72019        39     
produce:hitpdune:DisambigFromSpacePoints               0.266427      0.818906       2.80975      0.639986      0.550617        39     
produce:pandora:StandardPandora                         7.37237       16.6771       51.808        14.4708       9.53904        39     
produce:pandoraWriter:StandardPandora                  0.154085      0.263948       0.4631       0.235668      0.0793821       39     
produce:pandoraTrack:LArPandoraTrackCreation           0.456532       1.62293       3.82715       1.4183       0.855393        39     
produce:pandoraShower:LArPandoraShowerCreation         0.358444       1.83533       5.42086       1.55319       1.18514        39     
produce:pandoracalo:Calorimetry                         0.29375      0.864718       2.27152       0.76484      0.427433        39     
produce:pandoracalonosce:Calorimetry                   0.240763      0.769304       1.96991      0.659396      0.388255        39     
produce:pandorapid:Chi2ParticleID                     0.00160289    0.00311794     0.0204262    0.00244213    0.00308312       39     
produce:pandoraShowercalo:ShowerCalorimetry            0.396438       1.69462       5.32777       1.44804       1.11904        39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.357634       1.64931       5.15388       1.38459       1.08802        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.112797      0.188853      0.297807      0.178886      0.0509737       39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0354547     0.0661297     0.109307       0.0597       0.019327        39     
produce:emtrkmichelid:EmTrackMichelId                   21.3713       33.1291       61.2285       30.0797       9.53572        39     
[art]:TriggerResults:TriggerResultInserter            3.2822e-05    6.1576e-05    0.000122941    5.819e-05    2.04199e-05      39     
end_path:out1:RootOutput                              1.0068e-05    1.55225e-05   4.4664e-05    1.2945e-05    7.17474e-06      39     
end_path:michelremoving:michelremoving                 0.0196199     0.127824      0.671796      0.0580904     0.131043        39     
end_path:michelremovinggnocchi:michelremoving          0.0182988     0.126772      0.651555      0.0533114     0.130164        39     
end_path:calibanagnocchi:CalibAnaTree                  0.222765      0.619216       1.8674       0.524067       0.35182        39     
end_path:out1:RootOutput(write)                        0.755188       1.17612       1.9395        1.13168      0.319855        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5011.78 MB
  Peak resident set size usage (VmHWM): 2651.65 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029389_0026_dataflow1_datawriter_0_20240928T231019_reco_stage1_reco_stage2_20240929T020828_keepup.root
\tHists: np04hd_raw_run029389_0026_dataflow1_datawriter_0_20240928T231019_reco_stage1_reco_stage2_20240929T020828_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029389_0026_dataflow1_datawriter_0_20240928T231019_reco_stage1_reco_stage2_20240929T020828_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029389_0026_dataflow1_datawriter_0_20240928T231019_reco_stage1_reco_stage2_20240929T020828_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727571383.0,
    "core.end_time": 1727575709.0,
    "core.events": [
      2029,
      2031,
      2033,
      2035,
      2037,
      2039,
      2041,
      2043,
      2045,
      2047,
      2049,
      2051,
      2053,
      2055,
      2057,
      2059,
      2061,
      2063,
      2065,
      2067,
      2069,
      2071,
      2073,
      2075,
      2077,
      2079,
      2081,
      2083,
      2085,
      2087,
      2089,
      2091,
      2093,
      2095,
      2097,
      2099,
      2101,
      2103,
      2105
    ],
    "core.event_count": 39,
    "core.first_event_number": 2029,
    "core.last_event_number": 2105,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0026_dataflow1_datawriter_0_20240928T231019.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029389_0026_dataflow1_datawriter_0_20240928T231019_reco_stage1_reco_stage2_20240929T020828_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727571383.0,
    "core.end_time": 1727575709.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0026_dataflow1_datawriter_0_20240928T231019.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:32:59 UTC       justIN version: 01.01.08