justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264224.2@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID264224.2@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3453
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 16:22:30
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce05
Last heartbeat2024-09-26 17:25:08
From worker nodeHostnamedune001-2125435.0-lcg2710.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 16:23:15
Input fileshd-protodune:np04hd_raw_run029107_3646_dataflow2_datawriter_0_20240909T043801.hdf5
JobscriptExit code0
Real time1h (3613s)
CPU time52m (3134s = 86%)
Outputting started2024-09-26 17:23:29
Output fileshd-protodune-det-reco:np04hd_raw_run029107_3646_dataflow2_datawriter_0_20240909T043801_reco_stage1_reco_stage2_20240926T172316_keepup.root
hd-protodune-det-reco:np04hd_raw_run029107_3646_dataflow2_datawriter_0_20240909T043801_reco_stage1_reco_stage2_20240926T172316_keepup_hists.root
Finished2024-09-26 17:25:08
Saved logsjustin-logs:264224.2-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

with 50458 traces, 50458 summary
Retagger: tagging trace set: gauss with 37503 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 37503 traces tagged "gauss"
FrameSaver: q=829560 n=704057 tag=gauss
wclsFrameSaver: saving 50458 traces tagged "wiener"
FrameSaver: q=887464 n=633619 tag=wiener
754 hits in TPC 0
1413 hits in TPC 1
3219 hits in TPC 2
2447 hits in TPC 3
4113 hits in TPC 4
7390 hits in TPC 5
4402 hits in TPC 6
2218 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 1 XUs and 1 XVs -> 0 XUVs
C:0 T:1 49 XUs and 78 XVs -> 13 XUVs
C:0 T:2 5454 XUs and 6375 XVs -> 256 XUVs
C:0 T:3 71 XUs and 112 XVs -> 3 XUVs
C:0 T:4 105 XUs and 108 XVs -> 7 XUVs
C:0 T:5 24637 XUs and 42595 XVs -> 1844 XUVs
C:0 T:6 11413 XUs and 21965 XVs -> 1295 XUVs
C:0 T:7 60 XUs and 115 XVs -> 4 XUVs
3422 XUVs total
1300 collection wire objects
3422 potential space points
Neighbour search...
115658 tests to find 69646 neighbours
Iterating with no regularization...
Begin: 9.37058e+06
0 8.66663e+06
1 8.61132e+06
2 8.60052e+06
3 8.59757e+06
Now with regularization...
Begin: 8.0381e+06
0 8.03638e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

26-Sep-2024 17:23:16 UTC  Closed output file "np04hd_raw_run029107_3646_dataflow2_datawriter_0_20240909T043801_reco_stage1_reco_stage2_20240926T172316_keepup.root"
26-Sep-2024 17:23:16 UTC  Closed input file "np04hd_raw_run029107_3646_dataflow2_datawriter_0_20240909T043801_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              54.071        76.0339       107.468       76.7752       13.0674        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000536379   0.00178388    0.00557168    0.00143925    0.00132833       30     
produce:fembfilter:PDHDFEMBFilter                      0.576132      0.689332      0.743436      0.697909      0.0324133       30     
produce:wclsdatahd:WireCellToolkit                      31.2935       33.8063        35.33        33.9658       0.96883        30     
produce:gaushit:GausHitFinder                          0.433365      0.745943       1.04391      0.732724      0.150637        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000195585   0.000356242    0.0020274    0.000295525   0.000318002      30     
produce:reco3d:SpacePointSolver                        0.178744       1.09485       6.18026      0.776316       1.20341        30     
produce:hitpdune:DisambigFromSpacePoints               0.203041      0.539385       1.14272      0.494145      0.231878        30     
produce:pandora:StandardPandora                         5.70384       13.7575       32.6009       12.9407       6.47744        30     
produce:pandoraWriter:StandardPandora                  0.106907      0.161878      0.258943      0.160364      0.0361535       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.593572       1.59215       3.96425       1.62983      0.713297        30     
produce:pandoraShower:LArPandoraShowerCreation         0.661244       1.68215       3.13353       1.59876      0.716315        30     
produce:pandoracalo:Calorimetry                        0.308015      0.723821       1.34422      0.675016      0.253675        30     
produce:pandoracalonosce:Calorimetry                   0.270842      0.643381       1.07993       0.6181       0.222073        30     
produce:pandorapid:Chi2ParticleID                     0.00144904    0.00214753    0.00323846    0.00206556    0.000419707      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.557132       1.36517       2.46554       1.25541      0.541286        30     
produce:pandoraShowercalonosce:ShowerCalorimetry        0.5133        1.34111       2.44301       1.22669      0.526483        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0945907     0.163526       0.2307       0.168965      0.0329183       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0322457     0.0569626     0.100553      0.0562094     0.0135724       30     
produce:emtrkmichelid:EmTrackMichelId                   9.21672       15.9561       22.0596       16.1404       3.17636        30     
[art]:TriggerResults:TriggerResultInserter            2.1673e-05    6.13227e-05   0.000118749   5.56835e-05   2.08989e-05      30     
end_path:out1:RootOutput                               7.962e-06    2.20133e-05   0.000156887    1.659e-05    2.58562e-05      30     
end_path:michelremoving:michelremoving                 0.0184713     0.0699766     0.194228      0.0360841     0.0595792       30     
end_path:michelremovinggnocchi:michelremoving          0.0190452     0.0644996     0.193032      0.0342725     0.0574422       30     
end_path:calibanagnocchi:CalibAnaTree                  0.191955      0.478668      0.914488      0.474346      0.170867        30     
end_path:out1:RootOutput(write)                        0.464898      0.819823       1.19499      0.866645      0.174663        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5808.85 MB
  Peak resident set size usage (VmHWM): 2628.16 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_3646_dataflow2_datawriter_0_20240909T043801_reco_stage1_reco_stage2_20240926T172316_keepup.root
\tHists: np04hd_raw_run029107_3646_dataflow2_datawriter_0_20240909T043801_reco_stage1_reco_stage2_20240926T172316_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_3646_dataflow2_datawriter_0_20240909T043801_reco_stage1_reco_stage2_20240926T172316_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029107_3646_dataflow2_datawriter_0_20240909T043801_reco_stage1_reco_stage2_20240926T172316_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727369070.0,
    "core.end_time": 1727371397.0,
    "core.events": [
      875066,
      875074,
      875082,
      875090,
      875098,
      875106,
      875114,
      875122,
      875130,
      875138,
      875146,
      875154,
      875162,
      875170,
      875178,
      875186,
      875194,
      875202,
      875210,
      875218,
      875226,
      875234,
      875242,
      875250,
      875258,
      875266,
      875274,
      875282,
      875290,
      875306
    ],
    "core.event_count": 30,
    "core.first_event_number": 875066,
    "core.last_event_number": 875306,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_3646_dataflow2_datawriter_0_20240909T043801.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029107_3646_dataflow2_datawriter_0_20240909T043801_reco_stage1_reco_stage2_20240926T172316_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727369070.0,
    "core.end_time": 1727371397.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_3646_dataflow2_datawriter_0_20240909T043801.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:15:40 UTC       justIN version: 01.01.09