justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264214.4@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID264214.4@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3459
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 16:17:07
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2024-09-26 17:51:21
From worker nodeHostnamewn1207240.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 16:19:04
Input fileshd-protodune:np04hd_raw_run029125_0600_dataflow4_datawriter_0_20240911T043723.hdf5
JobscriptExit code0
Real time1h (5435s)
CPU time1h (4818s = 88%)
Outputting started2024-09-26 17:49:40
Output fileshd-protodune-det-reco:np04hd_raw_run029125_0600_dataflow4_datawriter_0_20240911T043723_reco_stage1_reco_stage2_20240926T174928_keepup.root
hd-protodune-det-reco:np04hd_raw_run029125_0600_dataflow4_datawriter_0_20240911T043723_reco_stage1_reco_stage2_20240926T174928_keepup_hists.root
Finished2024-09-26 17:51:21
Saved logsjustin-logs:264214.4-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

V coincidences...
C:0 T:1 323 XUs and 454 XVs -> 102 XUVs
C:0 T:2 23721 XUs and 32973 XVs -> 1010 XUVs
C:0 T:3 311 XUs and 323 XVs -> 13 XUVs
C:0 T:4 29 XUs and 50 XVs -> 0 XUVs
C:0 T:5 32415 XUs and 33785 XVs -> 1587 XUVs
C:0 T:6 31373 XUs and 27545 XVs -> 760 XUVs
C:0 T:7 491 XUs and 567 XVs -> 20 XUVs
3492 XUVs total
1830 collection wire objects
3492 potential space points
Neighbour search...
75614 tests to find 45060 neighbours
Iterating with no regularization...
Begin: 1.00527e+07
0 9.46994e+06
1 9.40644e+06
2 9.40089e+06
Now with regularization...
Begin: 8.88639e+06
0 8.88429e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  1   event 144268 TrkackID 6 startx, y, z 228.086 480.167 102.61  wireno, peakt tpcno 136 2862.41 2 dist 152.99min T, max_T5.95765 2893.02
no of hits closeby  1   event 144268 TrkackID 6 startx, y, z 228.086 480.167 102.61  wireno, peakt tpcno 136 2862.41 2 dist 152.99min T, max_T5.95765 2893.02
26-Sep-2024 18:49:28 BST  Closed output file "np04hd_raw_run029125_0600_dataflow4_datawriter_0_20240911T043723_reco_stage1_reco_stage2_20240926T174928_keepup.root"
26-Sep-2024 18:49:28 BST  Closed input file "np04hd_raw_run029125_0600_dataflow4_datawriter_0_20240911T043723_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              86.1876       121.276       175.16        119.776       21.537         30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000612005   0.00276494    0.00541467    0.00288234    0.00121139       30     
produce:fembfilter:PDHDFEMBFilter                       0.66421      0.908132       1.00651      0.947963      0.099643        30     
produce:wclsdatahd:WireCellToolkit                      43.1988       49.373        53.7367       49.6422       2.50054        30     
produce:gaushit:GausHitFinder                          0.572405      0.989166       1.66048      0.997019      0.255546        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000303392   0.000451186   0.000787065   0.000418681   0.000112069      30     
produce:reco3d:SpacePointSolver                        0.176205       1.35053       5.26846       1.21469      0.961503        30     
produce:hitpdune:DisambigFromSpacePoints               0.274704      0.727489       1.6436       0.664425      0.335351        30     
produce:pandora:StandardPandora                         9.39316       18.5856       49.8831       15.7991       9.28885        30     
produce:pandoraWriter:StandardPandora                  0.150307      0.242357      0.351682      0.242199      0.0519476       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.666841       1.94254       8.02795       1.74565       1.31639        30     
produce:pandoraShower:LArPandoraShowerCreation         0.596024       1.99162       3.97616       1.8056       0.935643        30     
produce:pandoracalo:Calorimetry                        0.387022      0.928445       2.87225      0.836194      0.465296        30     
produce:pandoracalonosce:Calorimetry                   0.330829      0.812775       2.67304      0.753077      0.436097        30     
produce:pandorapid:Chi2ParticleID                     0.00164106    0.00276073    0.00604935    0.00285665    0.000822699      30     
produce:pandoraShowercalo:ShowerCalorimetry             0.51604       1.80439       3.62233       1.64459      0.803338        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.495347       1.75984       3.44599       1.60018      0.760941        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.122125      0.224974      0.336331      0.216115      0.0608856       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0439903     0.0773166     0.110594      0.0797465     0.0200239       30     
produce:emtrkmichelid:EmTrackMichelId                   23.6729       37.366        52.3964       37.6263       7.51868        30     
[art]:TriggerResults:TriggerResultInserter            1.9617e-05    4.67338e-05   9.5189e-05    4.3928e-05    1.76413e-05      30     
end_path:out1:RootOutput                               4.198e-06    7.88477e-06   3.8262e-05     5.65e-06     6.69144e-06      30     
end_path:michelremoving:michelremoving                 0.0221668     0.0841654     0.323482      0.0385428     0.0948389       30     
end_path:michelremovinggnocchi:michelremoving          0.021043      0.0818412     0.319887      0.0378348     0.0932312       30     
end_path:calibanagnocchi:CalibAnaTree                  0.276111      0.664137       2.29726      0.608502      0.368436        30     
end_path:out1:RootOutput(write)                        0.696863       1.1884        1.68134       1.18166      0.258786        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4921.97 MB
  Peak resident set size usage (VmHWM): 2285.37 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029125_0600_dataflow4_datawriter_0_20240911T043723_reco_stage1_reco_stage2_20240926T174928_keepup.root
\tHists: np04hd_raw_run029125_0600_dataflow4_datawriter_0_20240911T043723_reco_stage1_reco_stage2_20240926T174928_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029125_0600_dataflow4_datawriter_0_20240911T043723_reco_stage1_reco_stage2_20240926T174928_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029125_0600_dataflow4_datawriter_0_20240911T043723_reco_stage1_reco_stage2_20240926T174928_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727369272.0,
    "core.end_time": 1727372969.0,
    "core.events": [
      144036,
      144044,
      144052,
      144060,
      144068,
      144076,
      144084,
      144092,
      144100,
      144108,
      144116,
      144124,
      144132,
      144140,
      144148,
      144156,
      144164,
      144172,
      144180,
      144188,
      144196,
      144204,
      144212,
      144220,
      144228,
      144236,
      144244,
      144252,
      144260,
      144268
    ],
    "core.event_count": 30,
    "core.first_event_number": 144036,
    "core.last_event_number": 144268,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29125
    ],
    "core.runs_subruns": [
      2912500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029125_0600_dataflow4_datawriter_0_20240911T043723.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029125_0600_dataflow4_datawriter_0_20240911T043723_reco_stage1_reco_stage2_20240926T174928_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727369272.0,
    "core.end_time": 1727372969.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29125
    ],
    "core.runs_subruns": [
      2912500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029125_0600_dataflow4_datawriter_0_20240911T043723.hdf5"
    }
  ]
}
justIN time: 2024-11-17 08:33:13 UTC       justIN version: 01.01.09