justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 270234.107@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID270234.107@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3594
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-05 17:40:25
SiteCA_SFU
EntryDUNE_CA_SFU_lcg-ce3
Last heartbeat2024-10-05 22:22:20
From worker nodeHostnamecdr545.int.cedar.computecanada.ca
cpuinfoIntel(R) Xeon(R) CPU E5-2683 v4 @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit84598 (23 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-05 20:13:52
Input fileshd-protodune:np04hd_raw_run027937_0779_dataflow2_datawriter_0_20240710T014244.hdf5
Outputting started2024-10-05 22:20:53
Output files
Finished2024-10-05 22:22:20
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

68 0.000646114 0.000646591 
----view 1: 0.000839233 0.00162888 0.00503922 0.0349007 0.0218582 0.0333176 0.033783 0.044342 0.0828857 0.0499268 0.0611572 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000700951 0.000700474 0.000694275 0.000646591 0.000647068 0.000646114 0.000646591 0.000647068 0.000646114 0.000646591 0.000647068 
----view 1: 0.00162888 0.00503922 0.0349007 0.0218582 0.0333176 0.033783 0.044342 0.0828857 0.0499268 0.0611572 0.0295181 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000700474 0.000694275 0.000646591 0.000647068 0.000646114 0.000646591 0.000647068 0.000646114 0.000646591 0.000647068 0.000646114 
----view 1: 0.00503922 0.0349007 0.0218582 0.0333176 0.033783 0.044342 0.0828857 0.0499268 0.0611572 0.0295181 0.0248795 
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

05-Oct-2024 15:20:42 PDT  Closed output file "np04hd_raw_run027937_0779_dataflow2_datawriter_0_20240710T014244_reco_stage1_reco_stage2_20241005T222042_keepup.root"
05-Oct-2024 15:20:42 PDT  Closed input file "np04hd_raw_run027937_0779_dataflow2_datawriter_0_20240710T014244_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              115.41        163.114       237.943       155.926       30.1777        31     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000701026   0.00285627    0.00485862     0.0027674    0.00117463       31     
produce:fembfilter:PDHDFEMBFilter                      0.904934      0.917895      0.998952       0.91492      0.0157714       31     
produce:wclsdatahd:WireCellToolkit                      55.1753       56.8996       59.2182       56.8087      0.928546        31     
produce:gaushit:GausHitFinder                          0.827541       1.23768       1.77504       1.20446      0.205156        31     
produce:nhitsfilter:NumberOfHitsFilter                0.000409045   0.000563941   0.000806139   0.000552727   9.75902e-05      31     
produce:reco3d:SpacePointSolver                        0.671542       6.73047       19.6771       5.38845       4.91385        31     
produce:hitpdune:DisambigFromSpacePoints               0.628977       1.68638       3.56592       1.71695      0.757222        31     
produce:pandora:StandardPandora                         15.3551       33.4942       67.8984       30.9327       12.0013        31     
produce:pandoraWriter:StandardPandora                  0.168681      0.257199      0.354778      0.258015      0.0462313       31     
produce:pandoraTrack:LArPandoraTrackCreation            1.83202       3.76294       7.52464       3.7136        1.29418        31     
produce:pandoraShower:LArPandoraShowerCreation          1.70731       4.71762       10.7877       4.1478        2.13248        31     
produce:pandoracalo:Calorimetry                        0.790186       1.58955       3.69935       1.44541      0.552582        31     
produce:pandoracalonosce:Calorimetry                   0.737154       1.50012       3.5837        1.36191      0.554029        31     
produce:pandorapid:Chi2ParticleID                     0.00208233     0.0027487    0.00449624    0.00266122    0.000473774      31     
produce:pandoraShowercalo:ShowerCalorimetry             1.60929       3.64388       9.36635       2.9879        1.73176        31     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.51374       3.50163       8.53264       2.76553       1.60615        31     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.141027      0.201406      0.279465      0.202143      0.041086        31     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0530388     0.0744233     0.100875      0.0741614     0.013309        31     
produce:emtrkmichelid:EmTrackMichelId                   27.2615       40.1043       55.5864       39.4829       7.57417        31     
[art]:TriggerResults:TriggerResultInserter            2.6568e-05    3.86151e-05   8.8096e-05     3.697e-05    1.11812e-05      31     
end_path:out1:RootOutput                               9.315e-06    1.20035e-05   2.9546e-05    1.1428e-05    3.49036e-06      31     
end_path:michelremoving:michelremoving                 0.0321794     0.137472      0.520212      0.0573082     0.139905        31     
end_path:michelremovinggnocchi:michelremoving          0.0291036     0.132104      0.511409      0.0501394     0.139097        31     
end_path:calibanagnocchi:CalibAnaTree                   0.62448       1.09179        1.963       0.952237      0.385494        31     
end_path:out1:RootOutput(write)                        0.919658       1.28101       1.8173        1.26588      0.237931        31     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4986.44 MB
  Peak resident set size usage (VmHWM): 2667.7 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027937_0779_dataflow2_datawriter_0_20240710T014244_reco_stage1_reco_stage2_20241005T222042_keepup.root
\tHists: np04hd_raw_run027937_0779_dataflow2_datawriter_0_20240710T014244_reco_stage1_reco_stage2_20241005T222042_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027937_0779_dataflow2_datawriter_0_20240710T014244_reco_stage1_reco_stage2_20241005T222042_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027937_0779_dataflow2_datawriter_0_20240710T014244_reco_stage1_reco_stage2_20241005T222042_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728161733.0,
    "core.end_time": 1728166843.0,
    "core.events": [
      193242,
      193250,
      193258,
      193266,
      193274,
      193282,
      193290,
      193298,
      193306,
      193314,
      193322,
      193330,
      193338,
      193346,
      193354,
      193362,
      193370,
      193378,
      193386,
      193394,
      193402,
      193410,
      193418,
      193426,
      193434,
      193442,
      193450,
      193458,
      193466,
      193474,
      193482
    ],
    "core.event_count": 31,
    "core.first_event_number": 193242,
    "core.last_event_number": 193482,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27937
    ],
    "core.runs_subruns": [
      2793700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027937_0779_dataflow2_datawriter_0_20240710T014244.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027937_0779_dataflow2_datawriter_0_20240710T014244_reco_stage1_reco_stage2_20241005T222042_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728161733.0,
    "core.end_time": 1728166843.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27937
    ],
    "core.runs_subruns": [
      2793700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027937_0779_dataflow2_datawriter_0_20240710T014244.hdf5"
    }
  ]
}
justIN time: 2024-11-24 02:13:41 UTC       justIN version: 01.01.09