justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264916.35@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID264916.35@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3493
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 10:09:08
SiteUS_BNL
EntryDUNE_US_BNL_sp02
Last heartbeat2024-09-27 15:42:40
From worker nodeHostnamespool1594.sdcc.bnl.gov
cpuinfoIntel(R) Xeon(R) Gold 6336Y CPU @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?False
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 10:21:40
Input fileshd-protodune:np04hd_raw_run027310_0417_dataflow3_datawriter_0_20240620T023330.hdf5
Outputting started2024-09-27 12:36:18
Output files
Finished2024-09-27 15:42:40
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

05 1.23382e-05 1.23978e-05 1.23382e-05 0.000320911 4.8995e-05 4.89354e-05 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 2.72989e-05 2.72393e-05 0.000225782 5.57303e-05 5.56707e-05 5.57303e-05 5.56707e-05 0.00132811 2.73585e-05 2.73585e-05 2.73585e-05 2.72989e-05 2.73585e-05 
----view 1: 1.23382e-05 1.23978e-05 1.23382e-05 1.23382e-05 1.23978e-05 1.23382e-05 1.23978e-05 1.23382e-05 0.000320911 4.8995e-05 4.89354e-05 0.000239491 4.75645e-05 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 2.72393e-05 0.000225782 5.57303e-05 5.56707e-05 5.57303e-05 5.56707e-05 0.00132811 2.73585e-05 2.73585e-05 2.73585e-05 2.72989e-05 2.73585e-05 0.000392437 
----view 1: 1.23978e-05 1.23382e-05 1.23382e-05 1.23978e-05 1.23382e-05 1.23978e-05 1.23382e-05 0.000320911 4.8995e-05 4.89354e-05 0.000239491 4.75645e-05 4.75645e-05 
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 12:35:59 UTC  Closed output file "np04hd_raw_run027310_0417_dataflow3_datawriter_0_20240620T023330_reco_stage1_reco_stage2_20240927T123559_keepup.root"
27-Sep-2024 12:35:59 UTC  Closed input file "np04hd_raw_run027310_0417_dataflow3_datawriter_0_20240620T023330_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              83.2994       157.278       273.54        153.245       43.784         35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000454829   0.00260121    0.00881744    0.00171355    0.00195598       35     
produce:fembfilter:PDHDFEMBFilter                      0.686917      0.891084       1.36248       0.86282      0.185636        35     
produce:wclsdatahd:WireCellToolkit                      46.7493       60.8292       69.8451       62.0483       7.01499        35     
produce:gaushit:GausHitFinder                          0.587515       1.24072       2.50125       1.24211      0.367582        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000414779   0.000763351   0.00140114    0.000739093   0.000204432      35     
produce:reco3d:SpacePointSolver                        0.638586       2.21657       5.75245       1.71529       1.39023        35     
produce:hitpdune:DisambigFromSpacePoints               0.308067      0.987644       2.26713      0.958786       0.45798        35     
produce:pandora:StandardPandora                         13.1714       41.2892       101.524       35.5812       22.4257        35     
produce:pandoraWriter:StandardPandora                  0.151388       0.28235      0.441949      0.278832      0.0731662       35     
produce:pandoraTrack:LArPandoraTrackCreation            1.53039       6.33854       13.6547       5.84673       3.31624        35     
produce:pandoraShower:LArPandoraShowerCreation          1.48508       6.57794       17.7412       5.9907        3.72653        35     
produce:pandoracalo:Calorimetry                        0.713812       2.26193       4.58602       2.13356       1.05659        35     
produce:pandoracalonosce:Calorimetry                   0.554573       2.09746       4.35831       1.90898       1.00498        35     
produce:pandorapid:Chi2ParticleID                     0.00156853    0.00327073    0.00526902     0.0033678    0.000798642      35     
produce:pandoraShowercalo:ShowerCalorimetry             1.19653       4.90316       14.2194       4.19379       2.87907        35     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.16794       4.80842       12.2481       4.42907       2.7224         35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.103092      0.183956       0.3143       0.175979      0.0492388       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0453239     0.0808304     0.139266      0.0769353     0.0223614       35     
produce:emtrkmichelid:EmTrackMichelId                   10.953        18.9482       27.2661       19.4292       4.28272        35     
[art]:TriggerResults:TriggerResultInserter            4.1343e-05    6.72682e-05   0.000152274   6.3896e-05    2.36006e-05      35     
end_path:out1:RootOutput                              1.1388e-05    1.95112e-05   4.8953e-05    1.5227e-05    8.84061e-06      35     
end_path:michelremoving:michelremoving                 0.0331267     0.0911084     0.283491      0.0707632     0.054027        35     
end_path:michelremovinggnocchi:michelremoving          0.0301086     0.0924267     0.329993      0.0652113     0.0658164       35     
end_path:calibanagnocchi:CalibAnaTree                  0.445924       1.66929       3.91043       1.63579      0.889012        35     
end_path:out1:RootOutput(write)                        0.591488       1.09916       1.75609       1.10842      0.292519        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5935.48 MB
  Peak resident set size usage (VmHWM): 2664.76 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027310_0417_dataflow3_datawriter_0_20240620T023330_reco_stage1_reco_stage2_20240927T123559_keepup.root
\tHists: np04hd_raw_run027310_0417_dataflow3_datawriter_0_20240620T023330_reco_stage1_reco_stage2_20240927T123559_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027310_0417_dataflow3_datawriter_0_20240620T023330_reco_stage1_reco_stage2_20240927T123559_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027310_0417_dataflow3_datawriter_0_20240620T023330_reco_stage1_reco_stage2_20240927T123559_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727434997.0,
    "core.end_time": 1727440562.0,
    "core.events": [
      58427,
      58431,
      58435,
      58439,
      58443,
      58447,
      58451,
      58455,
      58459,
      58463,
      58467,
      58471,
      58475,
      58479,
      58483,
      58487,
      58491,
      58495,
      58499,
      58503,
      58507,
      58511,
      58515,
      58519,
      58523,
      58527,
      58531,
      58535,
      58539,
      58543,
      58547,
      58551,
      58555,
      58559,
      58563
    ],
    "core.event_count": 35,
    "core.first_event_number": 58427,
    "core.last_event_number": 58563,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27310
    ],
    "core.runs_subruns": [
      2731000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027310_0417_dataflow3_datawriter_0_20240620T023330.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027310_0417_dataflow3_datawriter_0_20240620T023330_reco_stage1_reco_stage2_20240927T123559_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727434997.0,
    "core.end_time": 1727440562.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27310
    ],
    "core.runs_subruns": [
      2731000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027310_0417_dataflow3_datawriter_0_20240620T023330.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:23:26 UTC       justIN version: 01.01.08