justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266284.8@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID266284.8@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3553
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-29 09:16:28
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-09-29 10:52:55
From worker nodeHostnamewn2209251.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7513 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-29 09:17:24
Input fileshd-protodune:np04hd_raw_run029389_0068_dataflow1_datawriter_0_20240929T081700.hdf5
JobscriptExit code0
Real time1h (5636s)
CPU time1h (5034s = 89%)
Outputting started2024-09-29 10:51:21
Output fileshd-protodune-det-reco:np04hd_raw_run029389_0068_dataflow1_datawriter_0_20240929T081700_reco_stage1_reco_stage2_20240929T105108_keepup.root
hd-protodune-det-reco:np04hd_raw_run029389_0068_dataflow1_datawriter_0_20240929T081700_reco_stage1_reco_stage2_20240929T105108_keepup_hists.root
Finished2024-09-29 10:52:55
Saved logsjustin-logs:266284.8-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

XVs -> 221 XUVs
C:0 T:2 54097 XUs and 70300 XVs -> 8306 XUVs
C:0 T:3 522 XUs and 947 XVs -> 14 XUVs
C:0 T:4 101 XUs and 133 XVs -> 9 XUVs
C:0 T:5 15280 XUs and 16404 XVs -> 466 XUVs
C:0 T:6 18894 XUs and 19576 XVs -> 850 XUVs
C:0 T:7 80 XUs and 49 XVs -> 0 XUVs
9866 XUVs total
2839 collection wire objects
9866 potential space points
Neighbour search...
1792586 tests to find 614412 neighbours
Iterating with no regularization...
Begin: 2.58485e+07
0 2.16477e+07
1 2.1243e+07
2 2.11855e+07
3 2.11701e+07
Now with regularization...
Begin: 1.89279e+07
0 1.88926e+07
1 1.88847e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 5383 TrkackID 28 startx, y, z -51.1251 132.709 257.425  wireno, peakt tpcno 467 5438.31 2 dist 4.16647min T, max_T4576.23 5444.75
no of hits closeby  0   event 5383 TrkackID 28 startx, y, z -51.1251 132.709 257.425  wireno, peakt tpcno 467 5438.31 2 dist 4.16647min T, max_T4576.23 5444.75
29-Sep-2024 11:51:08 BST  Closed output file "np04hd_raw_run029389_0068_dataflow1_datawriter_0_20240929T081700_reco_stage1_reco_stage2_20240929T105108_keepup.root"
29-Sep-2024 11:51:08 BST  Closed input file "np04hd_raw_run029389_0068_dataflow1_datawriter_0_20240929T081700_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              65.3685       105.079       176.728       99.959        25.566         39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000743399   0.00299211    0.00486695    0.00327846    0.00126067       39     
produce:fembfilter:PDHDFEMBFilter                      0.796548      0.850974      0.988426      0.834624      0.0413363       39     
produce:wclsdatahd:WireCellToolkit                      39.0755       45.5982       52.2326       46.4621       2.99911        39     
produce:gaushit:GausHitFinder                          0.360758      0.827223       1.31323      0.779138      0.226382        39     
produce:nhitsfilter:NumberOfHitsFilter                0.00025007    0.000374188   0.000751845   0.000372852   8.0356e-05       39     
produce:reco3d:SpacePointSolver                        0.103126      0.860243       2.68026      0.558081      0.650191        39     
produce:hitpdune:DisambigFromSpacePoints               0.169994      0.629502       1.88388       0.51234       0.36157        39     
produce:pandora:StandardPandora                         3.6627        13.6268       33.4909       11.077        7.42952        39     
produce:pandoraWriter:StandardPandora                  0.110079      0.212021      0.387933      0.209965      0.0609591       39     
produce:pandoraTrack:LArPandoraTrackCreation           0.372038       1.37219       3.50916       1.13043      0.719764        39     
produce:pandoraShower:LArPandoraShowerCreation         0.377449       1.62554       5.46971       1.33194       1.10777        39     
produce:pandoracalo:Calorimetry                         0.24895      0.717376       1.75376      0.626535      0.329064        39     
produce:pandoracalonosce:Calorimetry                   0.214812      0.651081       1.89478      0.566967      0.327923        39     
produce:pandorapid:Chi2ParticleID                     0.00114895    0.00221906     0.0053376    0.00217338    0.000665328      39     
produce:pandoraShowercalo:ShowerCalorimetry            0.344986       1.5458        5.2264        1.30557       1.06418        39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.333063       1.47065       4.57401       1.24496      0.964133        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.103106      0.168652      0.259978       0.16591      0.0405172       39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0377224     0.0577171     0.0948246     0.0559263     0.0133042       39     
produce:emtrkmichelid:EmTrackMichelId                   15.5549       32.9038       62.8804       32.6448       11.0204        39     
[art]:TriggerResults:TriggerResultInserter            3.4745e-05    6.11304e-05   0.000115678   5.9652e-05    1.5546e-05       39     
end_path:out1:RootOutput                              1.1461e-05    1.82934e-05   5.9372e-05     1.597e-05    8.83625e-06      39     
end_path:michelremoving:michelremoving                 0.0254653     0.134065      0.666367      0.117372      0.130757        39     
end_path:michelremovinggnocchi:michelremoving          0.0215551     0.128732       0.65432      0.111764      0.129879        39     
end_path:calibanagnocchi:CalibAnaTree                  0.213888       0.53324       1.28866      0.530037      0.244229        39     
end_path:out1:RootOutput(write)                        0.555798      0.987191       1.56598      0.965268      0.255366        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4941.61 MB
  Peak resident set size usage (VmHWM): 2565.21 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029389_0068_dataflow1_datawriter_0_20240929T081700_reco_stage1_reco_stage2_20240929T105108_keepup.root
\tHists: np04hd_raw_run029389_0068_dataflow1_datawriter_0_20240929T081700_reco_stage1_reco_stage2_20240929T105108_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029389_0068_dataflow1_datawriter_0_20240929T081700_reco_stage1_reco_stage2_20240929T105108_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029389_0068_dataflow1_datawriter_0_20240929T081700_reco_stage1_reco_stage2_20240929T105108_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727602917.0,
    "core.end_time": 1727607069.0,
    "core.events": [
      5307,
      5309,
      5311,
      5313,
      5315,
      5317,
      5319,
      5321,
      5323,
      5325,
      5327,
      5329,
      5331,
      5333,
      5335,
      5337,
      5339,
      5341,
      5343,
      5345,
      5347,
      5349,
      5351,
      5353,
      5355,
      5357,
      5359,
      5361,
      5363,
      5365,
      5367,
      5369,
      5371,
      5373,
      5375,
      5377,
      5379,
      5381,
      5383
    ],
    "core.event_count": 39,
    "core.first_event_number": 5307,
    "core.last_event_number": 5383,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0068_dataflow1_datawriter_0_20240929T081700.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029389_0068_dataflow1_datawriter_0_20240929T081700_reco_stage1_reco_stage2_20240929T105108_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727602917.0,
    "core.end_time": 1727607069.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0068_dataflow1_datawriter_0_20240929T081700.hdf5"
    }
  ]
}
justIN time: 2024-09-29 13:32:50 UTC       justIN version: 01.01.08