justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 255330.130@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID255330.130@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3197
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-12 15:42:06
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-09-12 19:16:48
From worker nodeHostnamewn5916290.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-12 15:44:24
Input fileshd-protodune:np04hd_raw_run028590_0075_dataflow6_datawriter_0_20240808T163544.hdf5
JobscriptExit code0
Real time3h (11829s)
CPU time1h (4402s = 37%)
Outputting started2024-09-12 19:01:33
Output fileshd-protodune-det-reco:np04hd_raw_run028590_0075_dataflow6_datawriter_0_20240808T163544_reco_stage1_reco_stage2_20240912T190121_keepup.root
hd-protodune-det-reco:np04hd_raw_run028590_0075_dataflow6_datawriter_0_20240808T163544_reco_stage1_reco_stage2_20240912T190121_keepup_hists.root
Finished2024-09-12 19:16:48
Saved logsjustin-logs:255330.130-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

00537872 0.00417709 0.0103493 0.00408554 0.0242462 0.00600815 0.0273533 0.0031662 0.0401745 0.0046978 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0 0 0 0 0 0 0 0 0 0 0 
----view 1: 0.00537872 0.00417709 0.0103493 0.00408554 0.0242462 0.00600815 0.0273533 0.0031662 0.0401745 0.0046978 0.0324421 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0 0 0 0 0 0 0 0 0 0 0 
----view 1: 0.00417709 0.0103493 0.00408554 0.0242462 0.00600815 0.0273533 0.0031662 0.0401745 0.0046978 0.0324421 0.068924 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0 0 0 0 0 0 0 0 0 0 0 
----view 1: 0.0103493 0.00408554 0.0242462 0.00600815 0.0273533 0.0031662 0.0401745 0.0046978 0.0324421 0.068924 0.0519943 
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

12-Sep-2024 20:01:21 BST  Closed output file "np04hd_raw_run028590_0075_dataflow6_datawriter_0_20240808T163544_reco_stage1_reco_stage2_20240912T190121_keepup.root"
12-Sep-2024 20:01:21 BST  Closed input file "np04hd_raw_run028590_0075_dataflow6_datawriter_0_20240808T163544_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              63.2972       118.318       197.743       110.397       26.0923        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00062978    0.00298331    0.00551448    0.00332718    0.00151325       30     
produce:fembfilter:PDHDFEMBFilter                      0.625032      0.913805       1.34552      0.953166       0.15179        30     
produce:wclsdatahd:WireCellToolkit                      35.4212       49.2793       57.1881       51.417        6.0652         30     
produce:gaushit:GausHitFinder                          0.509153       1.01216       3.52681      0.901411      0.524007        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000336957   0.00814136     0.171209     0.000517092    0.0311037       30     
[art]:TriggerResults:TriggerResultInserter             1.605e-05    5.60807e-05   0.000110959   5.72535e-05   2.29068e-05      30     
end_path:out1:RootOutput                               3.757e-06    8.37743e-06   2.2032e-05     6.863e-06    3.65208e-06      30     
end_path:michelremoving:michelremoving                 0.0002699     0.116596      0.574179      0.0541092     0.125251        30     
end_path:michelremovinggnocchi:michelremoving         7.6574e-05     0.115944      0.585663      0.0506765     0.124021        30     
end_path:calibanagnocchi:CalibAnaTree                 7.4802e-05     0.825783       2.18379      0.681711      0.510478        30     
end_path:out1:RootOutput(write)                        0.694906       3.01062       13.9906       1.21909       3.73045        30     
produce:reco3d:SpacePointSolver                        0.206605       1.32908       4.19912       1.02234      0.974477        29     
produce:hitpdune:DisambigFromSpacePoints               0.198741      0.654999       1.94119      0.598139      0.339757        29     
produce:pandora:StandardPandora                         6.31081       15.6237       36.2489       13.7861       7.18796        29     
produce:pandoraWriter:StandardPandora                  0.153824       1.45413       8.19508      0.272474       2.44953        29     
produce:pandoraTrack:LArPandoraTrackCreation           0.629414       1.96986       5.07342       1.57877       1.09509        29     
produce:pandoraShower:LArPandoraShowerCreation         0.641122       2.28307       8.72569       1.71213       1.77784        29     
produce:pandoracalo:Calorimetry                        0.356607      0.933409       2.4521       0.830938      0.486358        29     
produce:pandoracalonosce:Calorimetry                   0.314542      0.841275       2.42735      0.692803      0.488348        29     
produce:pandorapid:Chi2ParticleID                     0.00156649    0.00271003    0.00456576    0.00261578    0.000706912      29     
produce:pandoraShowercalo:ShowerCalorimetry            0.540447       1.92462        8.335        1.42039       1.58365        29     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.415418       1.79776       8.13968       1.3582        1.49706        29     
produce:pandoraGnocchiCalo:GnocchiCalorimetry           0.10835      0.207639      0.464072       0.17933      0.084456        29     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0370299     0.0697831     0.143963      0.0650209     0.0263295       29     
produce:emtrkmichelid:EmTrackMichelId                   21.8718       35.9055       59.702        33.7968       9.08003        29     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5011.58 MB
  Peak resident set size usage (VmHWM): 2645.14 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028590_0075_dataflow6_datawriter_0_20240808T163544_reco_stage1_reco_stage2_20240912T190121_keepup.root
\tHists: np04hd_raw_run028590_0075_dataflow6_datawriter_0_20240808T163544_reco_stage1_reco_stage2_20240912T190121_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028590_0075_dataflow6_datawriter_0_20240808T163544_reco_stage1_reco_stage2_20240912T190121_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028590_0075_dataflow6_datawriter_0_20240808T163544_reco_stage1_reco_stage2_20240912T190121_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1726163851.0,
    "core.end_time": 1726167682.0,
    "core.events": [
      17990,
      17998,
      18022,
      18030,
      18038,
      18046,
      18054,
      18062,
      18070,
      18078,
      18086,
      18094,
      18102,
      18110,
      18118,
      18126,
      18134,
      18142,
      18150,
      18158,
      18166,
      18174,
      18182,
      18190,
      18198,
      18206,
      18214,
      18222,
      18230,
      18238
    ],
    "core.event_count": 30,
    "core.first_event_number": 17990,
    "core.last_event_number": 18238,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28590
    ],
    "core.runs_subruns": [
      2859000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028590_0075_dataflow6_datawriter_0_20240808T163544.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028590_0075_dataflow6_datawriter_0_20240808T163544_reco_stage1_reco_stage2_20240912T190121_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1726163851.0,
    "core.end_time": 1726167682.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28590
    ],
    "core.runs_subruns": [
      2859000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028590_0075_dataflow6_datawriter_0_20240808T163544.hdf5"
    }
  ]
}
justIN time: 2024-11-17 08:33:51 UTC       justIN version: 01.01.09