justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 265387.3@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID265387.3@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3511
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 20:40:18
SiteUS_BNL
EntryDUNE_US_BNL_sp02
Last heartbeat2024-09-27 22:18:49
From worker nodeHostnamespool1585.sdcc.bnl.gov
cpuinfoIntel(R) Xeon(R) Gold 6336Y CPU @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?False
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 20:41:57
Input fileshd-protodune:np04hd_raw_run027334_0231_dataflow0_datawriter_0_20240621T045308.hdf5
JobscriptExit code0
Real time0m (0s)
CPU time0m (0s = 0%)
Outputting started2024-09-27 22:16:56
Output fileshd-protodune-det-reco:np04hd_raw_run027334_0231_dataflow0_datawriter_0_20240621T045308_reco_stage1_reco_stage2_20240927T221646_keepup.root
hd-protodune-det-reco:np04hd_raw_run027334_0231_dataflow0_datawriter_0_20240621T045308_reco_stage1_reco_stage2_20240927T221646_keepup_hists.root
Finished2024-09-27 22:18:49
Saved logsjustin-logs:265387.3-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

78 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000353456 0.000218749 0.000218749 0.000218749 0.000218749 0.000218749 0.000218749 0.00021863 0.000218749 0.000218749 0.000218749 
----view 1: 0.0897522 0.135529 0.0976715 0.0917206 0.0450439 0.0366669 0.0252609 0.00660706 0.00506592 0.00758743 0.00825119 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000218749 0.000218749 0.000218749 0.000218749 0.000218749 0.000218749 0.00021863 0.000218749 0.000218749 0.000218749 0.000218749 
----view 1: 0.135529 0.0976715 0.0917206 0.0450439 0.0366669 0.0252609 0.00660706 0.00506592 0.00758743 0.00825119 0.0109901 
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 22:16:46 UTC  Closed output file "np04hd_raw_run027334_0231_dataflow0_datawriter_0_20240621T045308_reco_stage1_reco_stage2_20240927T221646_keepup.root"
27-Sep-2024 22:16:46 UTC  Closed input file "np04hd_raw_run027334_0231_dataflow0_datawriter_0_20240621T045308_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              84.1964       136.104       228.182       123.944       35.7799        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000373901   0.00182219    0.00543044    0.00127073    0.00141547       35     
produce:fembfilter:PDHDFEMBFilter                      0.657835      0.673259      0.707776      0.670136      0.0116627       35     
produce:wclsdatahd:WireCellToolkit                      45.6792       49.4578       55.9142       48.4523       2.36838        35     
produce:gaushit:GausHitFinder                          0.655187      0.983617       1.41413      0.987867      0.162199        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000403855   0.000565429   0.000712738   0.000567218   7.56195e-05      35     
produce:reco3d:SpacePointSolver                        0.464106       1.97188       4.46474       1.49779       1.17447        35     
produce:hitpdune:DisambigFromSpacePoints               0.338069      0.726917       1.45688      0.646286       0.26897        35     
produce:pandora:StandardPandora                         10.4219       40.1624       102.18        34.4837       23.4243        35     
produce:pandoraWriter:StandardPandora                  0.159113      0.216891      0.308839      0.212143      0.0346682       35     
produce:pandoraTrack:LArPandoraTrackCreation            1.87018       5.91868       12.5722       5.30162       2.66665        35     
produce:pandoraShower:LArPandoraShowerCreation          1.69111       6.14726       18.642        5.22839       3.32534        35     
produce:pandoracalo:Calorimetry                        0.777187       1.91316       4.46892       1.65086      0.872643        35     
produce:pandoracalonosce:Calorimetry                   0.700984       1.80482       3.99939       1.57492      0.807094        35     
produce:pandorapid:Chi2ParticleID                     0.00154323    0.00266824    0.00353443    0.00261273    0.00048388       35     
produce:pandoraShowercalo:ShowerCalorimetry             1.44746       3.85304       11.4983       3.12441       1.97879        35     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.34952       3.69432       11.0821       3.0086        1.93545        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0952321     0.135108      0.204114      0.131873      0.0222493       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0397041     0.061601      0.0965548     0.0585403     0.0114541       35     
produce:emtrkmichelid:EmTrackMichelId                   11.1178       15.7783       22.1728       15.4558       2.43133        35     
[art]:TriggerResults:TriggerResultInserter            3.6783e-05    5.72066e-05   0.000128398   5.5802e-05    1.50471e-05      35     
end_path:out1:RootOutput                               9.387e-06    1.54111e-05   2.2075e-05     1.593e-05    2.59074e-06      35     
end_path:michelremoving:michelremoving                 0.0329668     0.0687812     0.196016      0.054444      0.0381763       35     
end_path:michelremovinggnocchi:michelremoving          0.0307166     0.0668215     0.194556      0.0506594     0.042051        35     
end_path:calibanagnocchi:CalibAnaTree                  0.536342       1.23225       2.97094       1.13617      0.576867        35     
end_path:out1:RootOutput(write)                        0.627067      0.876568       1.3173       0.856103      0.145651        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 6143.71 MB
  Peak resident set size usage (VmHWM): 2821.74 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027334_0231_dataflow0_datawriter_0_20240621T045308_reco_stage1_reco_stage2_20240927T221646_keepup.root
\tHists: np04hd_raw_run027334_0231_dataflow0_datawriter_0_20240621T045308_reco_stage1_reco_stage2_20240927T221646_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027334_0231_dataflow0_datawriter_0_20240621T045308_reco_stage1_reco_stage2_20240927T221646_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027334_0231_dataflow0_datawriter_0_20240621T045308_reco_stage1_reco_stage2_20240927T221646_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727470606.0,
    "core.end_time": 1727475407.0,
    "core.events": [
      32348,
      32352,
      32356,
      32360,
      32364,
      32368,
      32372,
      32376,
      32380,
      32384,
      32388,
      32392,
      32396,
      32400,
      32404,
      32408,
      32412,
      32416,
      32420,
      32424,
      32428,
      32432,
      32436,
      32440,
      32444,
      32448,
      32452,
      32456,
      32460,
      32464,
      32468,
      32472,
      32476,
      32480,
      32484
    ],
    "core.event_count": 35,
    "core.first_event_number": 32348,
    "core.last_event_number": 32484,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27334
    ],
    "core.runs_subruns": [
      2733400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027334_0231_dataflow0_datawriter_0_20240621T045308.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027334_0231_dataflow0_datawriter_0_20240621T045308_reco_stage1_reco_stage2_20240927T221646_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727470606.0,
    "core.end_time": 1727475407.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27334
    ],
    "core.runs_subruns": [
      2733400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027334_0231_dataflow0_datawriter_0_20240621T045308.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:26:46 UTC       justIN version: 01.01.08