justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 79401.2@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID79401.2@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3448
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 16:40:17
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-09-26 18:43:24
From worker nodeHostnamewn1906251.tier2.hep.manchester.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 16:41:48
Input fileshd-protodune:np04hd_raw_run029097_0274_dataflow1_datawriter_0_20240906T160031.hdf5
JobscriptExit code0
Real time1h (7188s)
CPU time1h (6332s = 88%)
Outputting started2024-09-26 18:41:37
Output fileshd-protodune-det-reco:np04hd_raw_run029097_0274_dataflow1_datawriter_0_20240906T160031_reco_stage1_reco_stage2_20240926T184123_keepup.root
hd-protodune-det-reco:np04hd_raw_run029097_0274_dataflow1_datawriter_0_20240906T160031_reco_stage1_reco_stage2_20240926T184123_keepup_hists.root
Finished2024-09-26 18:43:24
Saved logsjustin-logs:79401.2-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ving 60028 traces tagged "gauss"
FrameSaver: q=1.28665e+06 n=1101316 tag=gauss
wclsFrameSaver: saving 81649 traces tagged "wiener"
FrameSaver: q=1.40657e+06 n=998968 tag=wiener
2965 hits in TPC 0
3950 hits in TPC 1
9195 hits in TPC 2
5319 hits in TPC 3
3944 hits in TPC 4
5243 hits in TPC 5
7742 hits in TPC 6
4390 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 730 XUs and 951 XVs -> 24 XUVs
C:0 T:2 81772 XUs and 104028 XVs -> 4663 XUVs
C:0 T:3 305 XUs and 394 XVs -> 5 XUVs
C:0 T:4 124 XUs and 107 XVs -> 4 XUVs
C:0 T:5 11989 XUs and 12788 XVs -> 478 XUVs
C:0 T:6 38291 XUs and 46444 XVs -> 1946 XUVs
C:0 T:7 549 XUs and 841 XVs -> 17 XUVs
7137 XUVs total
2019 collection wire objects
7137 potential space points
Neighbour search...
572431 tests to find 307956 neighbours
Iterating with no regularization...
Begin: 1.14358e+07
0 9.88606e+06
1 9.75049e+06
2 9.73053e+06
3 9.7232e+06
Now with regularization...
Begin: 9.14754e+06
0 9.14251e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

26-Sep-2024 19:41:23 BST  Closed output file "np04hd_raw_run029097_0274_dataflow1_datawriter_0_20240906T160031_reco_stage1_reco_stage2_20240926T184123_keepup.root"
26-Sep-2024 19:41:23 BST  Closed input file "np04hd_raw_run029097_0274_dataflow1_datawriter_0_20240906T160031_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              109.968       158.659       370.022       151.384       47.4982        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00044511    0.00329943    0.00516293    0.00372633    0.00135085       30     
produce:fembfilter:PDHDFEMBFilter                      0.717462       1.03506       1.41554       1.1078        0.17852        30     
produce:wclsdatahd:WireCellToolkit                      57.1146       66.8874       73.148        66.9305       3.36913        30     
produce:gaushit:GausHitFinder                          0.543985       1.26443       2.18601       1.28069      0.364022        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000330255   0.000579645   0.000971097   0.000563292   0.000145531      30     
produce:reco3d:SpacePointSolver                        0.333162       2.35411       13.7881        1.514        2.8056         30     
produce:hitpdune:DisambigFromSpacePoints                0.35088       1.16643       3.45914       1.03793      0.667473        30     
produce:pandora:StandardPandora                         10.3631       25.7138       175.504       20.3729       28.8602        30     
produce:pandoraWriter:StandardPandora                  0.164479      0.265325      0.391299      0.266552      0.0607638       30     
produce:pandoraTrack:LArPandoraTrackCreation            1.0945        3.13024       9.7982        2.68576       1.82366        30     
produce:pandoraShower:LArPandoraShowerCreation         0.856067       3.33195       8.96651       3.02255       2.0598         30     
produce:pandoracalo:Calorimetry                         0.43338       1.29228       4.06613       1.10233      0.731286        30     
produce:pandoracalonosce:Calorimetry                    0.38014       1.22554       4.0589        1.05086      0.724028        30     
produce:pandorapid:Chi2ParticleID                     0.00149435    0.00312969    0.00574762    0.00301315    0.000844008      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.789503       2.73167       7.30696       2.50373       1.54764        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.805821       2.64841       7.25207       2.44945       1.5394         30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.116538      0.235541      0.370173      0.226341       0.06424        30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0355204     0.0928853     0.139466      0.0891769     0.0245262       30     
produce:emtrkmichelid:EmTrackMichelId                   28.6376       42.4804       65.5978       43.1018       9.36137        30     
[art]:TriggerResults:TriggerResultInserter            3.8388e-05    5.74124e-05   0.000128831   5.5305e-05    1.44679e-05      30     
end_path:out1:RootOutput                              1.1202e-05    1.77857e-05   3.9796e-05    1.66575e-05   5.37267e-06      30     
end_path:michelremoving:michelremoving                 0.035181      0.175349      0.805697      0.0745227     0.217886        30     
end_path:michelremovinggnocchi:michelremoving          0.0317225     0.158319      0.787904      0.0630391     0.197845        30     
end_path:calibanagnocchi:CalibAnaTree                   0.35312       0.94833       2.95817      0.764193      0.558357        30     
end_path:out1:RootOutput(write)                        0.828299       1.3257        2.36389       1.24489      0.376942        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4929.26 MB
  Peak resident set size usage (VmHWM): 2599.68 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029097_0274_dataflow1_datawriter_0_20240906T160031_reco_stage1_reco_stage2_20240926T184123_keepup.root
\tHists: np04hd_raw_run029097_0274_dataflow1_datawriter_0_20240906T160031_reco_stage1_reco_stage2_20240926T184123_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029097_0274_dataflow1_datawriter_0_20240906T160031_reco_stage1_reco_stage2_20240926T184123_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029097_0274_dataflow1_datawriter_0_20240906T160031_reco_stage1_reco_stage2_20240926T184123_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727371262.0,
    "core.end_time": 1727376085.0,
    "core.events": [
      65769,
      65777,
      65785,
      65793,
      65801,
      65809,
      65817,
      65825,
      65833,
      65841,
      65849,
      65857,
      65865,
      65873,
      65881,
      65889,
      65897,
      65905,
      65913,
      65921,
      65929,
      65937,
      65945,
      65953,
      65961,
      65969,
      65977,
      65985,
      65993,
      66001
    ],
    "core.event_count": 30,
    "core.first_event_number": 65769,
    "core.last_event_number": 66001,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29097
    ],
    "core.runs_subruns": [
      2909700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029097_0274_dataflow1_datawriter_0_20240906T160031.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029097_0274_dataflow1_datawriter_0_20240906T160031_reco_stage1_reco_stage2_20240926T184123_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727371262.0,
    "core.end_time": 1727376085.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29097
    ],
    "core.runs_subruns": [
      2909700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029097_0274_dataflow1_datawriter_0_20240906T160031.hdf5"
    }
  ]
}
justIN time: 2024-11-17 08:46:21 UTC       justIN version: 01.01.09