justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266135.5@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID266135.5@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3552
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-29 02:21:47
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-09-29 04:31:53
From worker nodeHostnamewn1205090.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-29 02:23:38
Input fileshd-protodune:np04hd_raw_run029389_0037_dataflow0_datawriter_0_20240929T013339.hdf5
JobscriptExit code0
Real time2h (7521s)
CPU time1h (6717s = 89%)
Outputting started2024-09-29 04:28:59
Output fileshd-protodune-det-reco:np04hd_raw_run029389_0037_dataflow0_datawriter_0_20240929T013339_reco_stage1_reco_stage2_20240929T042843_keepup.root
hd-protodune-det-reco:np04hd_raw_run029389_0037_dataflow0_datawriter_0_20240929T013339_reco_stage1_reco_stage2_20240929T042843_keepup_hists.root
Finished2024-09-29 04:31:53
Saved logsjustin-logs:266135.5-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

1 
----view 1: 0.00176239 0.00176239 0.00792503 0.00737 0.0089798 0.0380936 0.0957947 0.0907898 0.0557251 0.0539246 0.0145874 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000880241 0.000881195 0.000880241 0.000880241 0.000880241 0.000959396 0.00107956 0.00107861 0.00107861 0.00107861 0.00108624 
----view 1: 0.00176239 0.00792503 0.00737 0.0089798 0.0380936 0.0957947 0.0907898 0.0557251 0.0539246 0.0145874 0.0282135 
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  1   event 2964 TrkackID 1 startx, y, z -142.562 500.812 457.602  wireno, peakt tpcno 36 1123.54 2 dist 0min T, max_T789.952 2616.23
no of hits closeby  2   event 2964 TrkackID 3 startx, y, z 259.712 537.753 49.1064  wireno, peakt tpcno 445 3003.37 5 dist 0min T, max_T3.84091 3311.36
no of hits closeby  1   event 2964 TrkackID 1 startx, y, z -142.562 500.812 457.602  wireno, peakt tpcno 36 1123.54 2 dist 0min T, max_T789.952 2616.23
no of hits closeby  2   event 2964 TrkackID 3 startx, y, z 259.712 537.753 49.1064  wireno, peakt tpcno 445 3003.37 5 dist 0min T, max_T3.84091 3311.36
29-Sep-2024 05:28:43 BST  Closed output file "np04hd_raw_run029389_0037_dataflow0_datawriter_0_20240929T013339_reco_stage1_reco_stage2_20240929T042843_keepup.root"
29-Sep-2024 05:28:43 BST  Closed input file "np04hd_raw_run029389_0037_dataflow0_datawriter_0_20240929T013339_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              97.5905       143.102       226.414       134.109       33.0082        39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000505083   0.00408276      0.01763     0.00383581    0.00264352       39     
produce:fembfilter:PDHDFEMBFilter                      0.866086      0.976804       1.04769      0.975035      0.0282683       39     
produce:wclsdatahd:WireCellToolkit                      50.6607       58.0475       71.2361       56.8697       5.64455        39     
produce:gaushit:GausHitFinder                          0.593554       1.0986        1.6752        1.03224      0.274804        39     
produce:nhitsfilter:NumberOfHitsFilter                0.000331776   0.000522163   0.00079489    0.00050354    0.000121488      39     
produce:reco3d:SpacePointSolver                        0.201088       3.51324       15.3971       1.17278       4.49411        39     
produce:hitpdune:DisambigFromSpacePoints               0.180085      0.883405       2.08425      0.818409      0.475984        39     
produce:pandora:StandardPandora                         7.75167       20.4852       48.0525       16.8654       10.4128        39     
produce:pandoraWriter:StandardPandora                  0.172631      0.286086      0.452501      0.277363      0.0743007       39     
produce:pandoraTrack:LArPandoraTrackCreation           0.857442       2.1837        4.55163       1.80373       1.03378        39     
produce:pandoraShower:LArPandoraShowerCreation         0.826614       2.70291       7.36802       2.0395        1.7112         39     
produce:pandoracalo:Calorimetry                        0.433054       1.09612       2.64692      0.924348      0.503446        39     
produce:pandoracalonosce:Calorimetry                   0.350421      0.985967       2.32665      0.846491      0.473272        39     
produce:pandorapid:Chi2ParticleID                     0.00206757    0.00300543    0.00598248    0.00282247    0.000711081      39     
produce:pandoraShowercalo:ShowerCalorimetry            0.634423       2.27629       5.3147        1.89791       1.31666        39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.581187       2.18637       5.57314       1.6642        1.30895        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.134292       0.25775       0.41874      0.245933      0.0707382       39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0471446     0.0905639     0.159709      0.083524      0.0273422       39     
produce:emtrkmichelid:EmTrackMichelId                   25.9121       43.4846       71.4449       41.9562       11.3029        39     
[art]:TriggerResults:TriggerResultInserter            3.0919e-05    5.84126e-05   0.000119806    5.864e-05    1.88994e-05      39     
end_path:out1:RootOutput                               4.499e-06    8.68813e-06   2.7732e-05     7.414e-06    4.01398e-06      39     
end_path:michelremoving:michelremoving                 0.0219891     0.129198      0.732098      0.0529536     0.157906        39     
end_path:michelremovinggnocchi:michelremoving          0.0217098     0.128795      0.745886      0.0535673     0.158864        39     
end_path:calibanagnocchi:CalibAnaTree                  0.250584      0.767975       1.77363      0.663963      0.381288        39     
end_path:out1:RootOutput(write)                        0.721319       1.29481       2.08953       1.24776       0.33028        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4931.17 MB
  Peak resident set size usage (VmHWM): 2577.12 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029389_0037_dataflow0_datawriter_0_20240929T013339_reco_stage1_reco_stage2_20240929T042843_keepup.root
\tHists: np04hd_raw_run029389_0037_dataflow0_datawriter_0_20240929T013339_reco_stage1_reco_stage2_20240929T042843_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029389_0037_dataflow0_datawriter_0_20240929T013339_reco_stage1_reco_stage2_20240929T042843_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029389_0037_dataflow0_datawriter_0_20240929T013339_reco_stage1_reco_stage2_20240929T042843_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727578474.0,
    "core.end_time": 1727584124.0,
    "core.events": [
      2888,
      2890,
      2892,
      2894,
      2896,
      2898,
      2900,
      2902,
      2904,
      2906,
      2908,
      2910,
      2912,
      2914,
      2916,
      2918,
      2920,
      2922,
      2924,
      2926,
      2928,
      2930,
      2932,
      2934,
      2936,
      2938,
      2940,
      2942,
      2944,
      2946,
      2948,
      2950,
      2952,
      2954,
      2956,
      2958,
      2960,
      2962,
      2964
    ],
    "core.event_count": 39,
    "core.first_event_number": 2888,
    "core.last_event_number": 2964,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0037_dataflow0_datawriter_0_20240929T013339.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029389_0037_dataflow0_datawriter_0_20240929T013339_reco_stage1_reco_stage2_20240929T042843_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727578474.0,
    "core.end_time": 1727584124.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0037_dataflow0_datawriter_0_20240929T013339.hdf5"
    }
  ]
}
justIN time: 2024-11-17 03:16:12 UTC       justIN version: 01.01.09