justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 244817.66@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID244817.66@justin-prod-sched01.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 08:11:07
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_klomp_multicore
Last heartbeat2024-08-19 09:13:13
From worker nodeHostnamewn-snel-002.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 08:13:00
Input fileshd-protodune:np04hd_raw_run028762_1632_dataflow3_datawriter_0_20240819T045432.hdf5
JobscriptExit code0
Real time58m (3539s)
CPU time53m (3231s = 91%)
Outputting started2024-08-19 09:11:59
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1632_dataflow3_datawriter_0_20240819T045432_reco_stage1_reco_stage2_20240819T091149_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1632_dataflow3_datawriter_0_20240819T045432_reco_stage1_reco_stage2_20240819T091149_keepup_hists.root
Finished2024-08-19 09:13:13
Saved logsjustin-logs:244817.66-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

08 hits in TPC 0
6765 hits in TPC 1
2052 hits in TPC 2
799 hits in TPC 3
3614 hits in TPC 4
4134 hits in TPC 5
1294 hits in TPC 6
700 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 12170 XUs and 7103 XVs -> 813 XUVs
C:0 T:2 1871 XUs and 2107 XVs -> 76 XUVs
C:0 T:3 210 XUs and 303 XVs -> 27 XUVs
C:0 T:4 157 XUs and 186 XVs -> 4 XUVs
C:0 T:5 20057 XUs and 13131 XVs -> 284 XUVs
C:0 T:6 636 XUs and 864 XVs -> 74 XUVs
C:0 T:7 4 XUs and 7 XVs -> 0 XUVs
1278 XUVs total
511 collection wire objects
1278 potential space points
Neighbour search...
45740 tests to find 19332 neighbours
Iterating with no regularization...
Begin: 9.33225e+06
0 9.06995e+06
1 9.05208e+06
2 9.052e+06
Now with regularization...
Begin: 8.96101e+06
0 8.96094e+06
PcaShowerParticleBuildingAlgorithm::OpeningAngle - principal eigenvalue less than or equal to 0.
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

19-Aug-2024 11:11:49 CEST  Closed output file "np04hd_raw_run028762_1632_dataflow3_datawriter_0_20240819T045432_reco_stage1_reco_stage2_20240819T091149_keepup.root"
19-Aug-2024 11:11:49 CEST  Closed input file "np04hd_raw_run028762_1632_dataflow3_datawriter_0_20240819T045432_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              60.2751       78.911        111.249       75.7074       13.3992        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000457751   0.00182392    0.00345395    0.00186156    0.000800026      30     
produce:fembfilter:PDHDFEMBFilter                      0.504449      0.576331      0.938369      0.544564      0.0968313       30     
produce:wclsdatahd:WireCellToolkit                      28.1064       29.8765       31.3801       30.1384      0.992077        30     
produce:gaushit:GausHitFinder                          0.389725      0.575713      0.755043      0.564463      0.0957911       30     
produce:nhitsfilter:NumberOfHitsFilter                0.000237937   0.000336815   0.000501432   0.00034242    6.13854e-05      30     
produce:reco3d:SpacePointSolver                        0.176293      0.860747       3.39502      0.609332      0.723713        30     
produce:hitpdune:DisambigFromSpacePoints                0.20598      0.419691      0.810781      0.394242      0.152472        30     
produce:pandora:StandardPandora                         5.94191       14.0366       36.7467       11.6449       7.34797        30     
produce:pandoraWriter:StandardPandora                  0.0911464     0.151678      0.250314       0.14812      0.038443        30     
produce:pandoraTrack:LArPandoraTrackCreation           0.443762       1.12086       2.13293       1.00937       0.45123        30     
produce:pandoraShower:LArPandoraShowerCreation         0.403979       1.20127       2.0549        1.13695      0.463539        30     
produce:pandoracalo:Calorimetry                        0.246399      0.509118      0.793608      0.488102      0.145902        30     
produce:pandoracalonosce:Calorimetry                    0.21598      0.460242      0.719472      0.447067      0.136857        30     
produce:pandorapid:Chi2ParticleID                     0.00116987    0.00169487    0.00252829    0.00171084    0.000278307      30     
produce:pandoraShowercalo:ShowerCalorimetry             0.38374      0.993442       1.58926      0.970624      0.317847        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.375148      0.948114       1.52002      0.940286      0.298058        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0657454     0.117442      0.170273      0.118441      0.0235227       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0251288     0.0419567     0.0587865     0.0436447    0.00786281       30     
produce:emtrkmichelid:EmTrackMichelId                   16.7227       24.9269       31.8201       25.1244       4.20035        30     
[art]:TriggerResults:TriggerResultInserter            1.9616e-05    2.83543e-05   9.6572e-05    2.4857e-05    1.35506e-05      30     
end_path:out1:RootOutput                               4.058e-06    5.68477e-06   2.7492e-05     4.679e-06    4.08969e-06      30     
end_path:michelremoving:michelremoving                 0.0242497     0.114508      0.431496      0.0479022     0.0994788       30     
end_path:michelremovinggnocchi:michelremoving          0.0236074     0.113176      0.431065      0.0427504     0.0994676       30     
end_path:calibanagnocchi:CalibAnaTree                  0.321165      0.631523       1.03662      0.606571      0.182126        30     
end_path:out1:RootOutput(write)                        0.654873       1.10786       1.43528       1.12412       0.17594        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4949.23 MB
  Peak resident set size usage (VmHWM): 2627.35 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1632_dataflow3_datawriter_0_20240819T045432_reco_stage1_reco_stage2_20240819T091149_keepup.root
\tHists: np04hd_raw_run028762_1632_dataflow3_datawriter_0_20240819T045432_reco_stage1_reco_stage2_20240819T091149_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1632_dataflow3_datawriter_0_20240819T045432_reco_stage1_reco_stage2_20240819T091149_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1632_dataflow3_datawriter_0_20240819T045432_reco_stage1_reco_stage2_20240819T091149_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724056307.0,
    "core.end_time": 1724058710.0,
    "core.events": [
      391659,
      391667,
      391675,
      391683,
      391691,
      391723,
      391731,
      391739,
      391747,
      391755,
      391763,
      391771,
      391779,
      391787,
      391795,
      391803,
      391811,
      391819,
      391827,
      391835,
      391843,
      391851,
      391859,
      391867,
      391875,
      391883,
      391891,
      391899,
      391907,
      391915
    ],
    "core.event_count": 30,
    "core.first_event_number": 391659,
    "core.last_event_number": 391915,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1632_dataflow3_datawriter_0_20240819T045432.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1632_dataflow3_datawriter_0_20240819T045432_reco_stage1_reco_stage2_20240819T091149_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724056307.0,
    "core.end_time": 1724058710.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1632_dataflow3_datawriter_0_20240819T045432.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:59:17 UTC       justIN version: 01.01.09