justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 79949.25@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID79949.25@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3511
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 08:03:57
SiteUS_UChicago
EntryEngage_US_MWT2_uct2_gk02_condce_mcore
Last heartbeat2024-09-27 17:05:37
From worker nodeHostnameiut2-c396.iu.edu
cpuinfoAMD EPYC 7443 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit86400 (24 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 13:33:50
Input fileshd-protodune:np04hd_raw_run027334_0059_dataflow0_datawriter_0_20240621T034123.hdf5
Outputting started2024-09-27 16:26:36
Output files
Finished2024-09-27 17:05:37
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

iew 1: 0.00188786 9.0003e-05 9.00626e-05 9.0003e-05 0.00105184 0.000293851 0.000133932 1.45435e-05 1.45435e-05 1.45435e-05 1.46031e-05 1.45435e-05 1.45435e-05 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 1.90735e-06 1.90735e-06 1.84774e-06 1.90735e-06 1.90735e-06 1.84774e-06 1.90735e-06 1.84774e-06 1.90735e-06 1.90735e-06 1.84774e-06 1.90735e-06 1.90735e-06 
----view 1: 9.0003e-05 9.00626e-05 9.0003e-05 0.00105184 0.000293851 0.000133932 1.45435e-05 1.45435e-05 1.45435e-05 1.46031e-05 1.45435e-05 1.45435e-05 0.000370741 
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  8   event 8400 TrkackID 23 startx, y, z 57.5053 596.58 132.591  wireno, peakt tpcno 313 1549.28 1 dist 1.08436min T, max_T1007.8 1729.12
no of hits closeby  8   event 8400 TrkackID 23 startx, y, z 57.5053 596.58 132.591  wireno, peakt tpcno 313 1549.28 1 dist 1.08436min T, max_T1007.8 1729.12
27-Sep-2024 12:26:25 EDT  Closed output file "np04hd_raw_run027334_0059_dataflow0_datawriter_0_20240621T034123_reco_stage1_reco_stage2_20240927T162625_keepup.root"
27-Sep-2024 12:26:25 EDT  Closed input file "np04hd_raw_run027334_0059_dataflow0_datawriter_0_20240621T034123_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              56.8856       116.674       282.652       110.915       42.5765        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000772883   0.00283544     0.0059808     0.0027432    0.00126793       35     
produce:fembfilter:PDHDFEMBFilter                      0.491853      0.696917      0.762579      0.711549      0.0519131       35     
produce:wclsdatahd:WireCellToolkit                      27.4696       33.5284       38.4975       33.4834       2.03042        35     
produce:gaushit:GausHitFinder                          0.420163      0.898806       1.35838       0.88922      0.231075        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000254088   0.000436412   0.00113715    0.000420911   0.000142008      35     
produce:reco3d:SpacePointSolver                        0.286972       1.37962       6.46011       1.22212       1.2222         35     
produce:hitpdune:DisambigFromSpacePoints               0.276656      0.935175       2.24629      0.865087      0.488004        35     
produce:pandora:StandardPandora                         3.2714        35.9254       161.671       30.0922       29.6752        35     
produce:pandoraWriter:StandardPandora                  0.0617547     0.199515      0.307373       0.20511      0.0515602       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.464402       1.9647        4.20089       1.78701      0.862037        35     
produce:pandoraShower:LArPandoraShowerCreation         0.406762       1.92803       5.0284        1.77295       0.97689        35     
produce:pandoracalo:Calorimetry                        0.272903       1.05022       2.28985      0.947509      0.478795        35     
produce:pandoracalonosce:Calorimetry                   0.220985      0.948099       1.90189      0.863267      0.421518        35     
produce:pandorapid:Chi2ParticleID                     0.000980943    0.0026177    0.00517344    0.00268163    0.000764735      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.388531       1.88745       4.43691       1.63169       1.01093        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.375577       1.79281       4.4527        1.54023       0.95665        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0866946     0.156689      0.236398      0.158527      0.0384119       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0253826     0.0536339     0.0783724     0.0537266     0.0123561       35     
produce:emtrkmichelid:EmTrackMichelId                   17.2168       31.2989       49.7383       31.639        7.41842        35     
[art]:TriggerResults:TriggerResultInserter            2.8915e-05    5.05791e-05   0.00013838    4.1117e-05    2.27911e-05      35     
end_path:out1:RootOutput                               9.778e-06    1.43731e-05   4.6818e-05    1.2764e-05    6.27877e-06      35     
end_path:michelremoving:michelremoving                 0.0150255     0.0681976     0.243257      0.0324522     0.0670608       35     
end_path:michelremovinggnocchi:michelremoving          0.0144046     0.065753       0.23836      0.0287162     0.066552        35     
end_path:calibanagnocchi:CalibAnaTree                  0.167356      0.778577       1.75827      0.654846       0.37641        35     
end_path:out1:RootOutput(write)                        0.518523      0.959941       1.38905      0.961513      0.233442        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5050.54 MB
  Peak resident set size usage (VmHWM): 2697.38 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027334_0059_dataflow0_datawriter_0_20240621T034123_reco_stage1_reco_stage2_20240927T162625_keepup.root
\tHists: np04hd_raw_run027334_0059_dataflow0_datawriter_0_20240621T034123_reco_stage1_reco_stage2_20240927T162625_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027334_0059_dataflow0_datawriter_0_20240621T034123_reco_stage1_reco_stage2_20240927T162625_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027334_0059_dataflow0_datawriter_0_20240621T034123_reco_stage1_reco_stage2_20240927T162625_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727450260.0,
    "core.end_time": 1727454386.0,
    "core.events": [
      8264,
      8268,
      8272,
      8276,
      8280,
      8284,
      8288,
      8292,
      8296,
      8300,
      8304,
      8308,
      8312,
      8316,
      8320,
      8324,
      8328,
      8332,
      8336,
      8340,
      8344,
      8348,
      8352,
      8356,
      8360,
      8364,
      8368,
      8372,
      8376,
      8380,
      8384,
      8388,
      8392,
      8396,
      8400
    ],
    "core.event_count": 35,
    "core.first_event_number": 8264,
    "core.last_event_number": 8400,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27334
    ],
    "core.runs_subruns": [
      2733400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027334_0059_dataflow0_datawriter_0_20240621T034123.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027334_0059_dataflow0_datawriter_0_20240621T034123_reco_stage1_reco_stage2_20240927T162625_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727450260.0,
    "core.end_time": 1727454386.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27334
    ],
    "core.runs_subruns": [
      2733400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027334_0059_dataflow0_datawriter_0_20240621T034123.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:38:23 UTC       justIN version: 01.01.08