justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266114.5@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID266114.5@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3552
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-29 01:24:18
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2024-09-29 03:03:34
From worker nodeHostnamewn2207290.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7513 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-29 01:26:24
Input fileshd-protodune:np04hd_raw_run029389_0034_dataflow0_datawriter_0_20240929T005446.hdf5
JobscriptExit code0
Real time1h (5735s)
CPU time1h (5122s = 89%)
Outputting started2024-09-29 03:02:01
Output fileshd-protodune-det-reco:np04hd_raw_run029389_0034_dataflow0_datawriter_0_20240929T005446_reco_stage1_reco_stage2_20240929T030148_keepup.root
hd-protodune-det-reco:np04hd_raw_run029389_0034_dataflow0_datawriter_0_20240929T005446_reco_stage1_reco_stage2_20240929T030148_keepup_hists.root
Finished2024-09-29 03:03:34
Saved logsjustin-logs:266114.5-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ss"
FrameSaver: q=1.13199e+06 n=919747 tag=gauss
wclsFrameSaver: saving 76274 traces tagged "wiener"
FrameSaver: q=1.22934e+06 n=815633 tag=wiener
4403 hits in TPC 0
3456 hits in TPC 1
3438 hits in TPC 2
2879 hits in TPC 3
4546 hits in TPC 4
7301 hits in TPC 5
6144 hits in TPC 6
4470 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1729 XUs and 1224 XVs -> 85 XUVs
C:0 T:2 13513 XUs and 10658 XVs -> 163 XUVs
C:0 T:3 166 XUs and 272 XVs -> 9 XUVs
C:0 T:4 195 XUs and 285 XVs -> 6 XUVs
C:0 T:5 39639 XUs and 39113 XVs -> 3009 XUVs
C:0 T:6 45820 XUs and 27844 XVs -> 1838 XUVs
C:0 T:7 62 XUs and 35 XVs -> 2 XUVs
5112 XUVs total
1360 collection wire objects
5112 potential space points
Neighbour search...
242890 tests to find 139816 neighbours
Iterating with no regularization...
Begin: 9.35868e+06
0 8.32514e+06
1 8.18205e+06
2 8.15819e+06
3 8.15067e+06
Now with regularization...
Begin: 7.48005e+06
0 7.47506e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

29-Sep-2024 04:01:48 BST  Closed output file "np04hd_raw_run029389_0034_dataflow0_datawriter_0_20240929T005446_reco_stage1_reco_stage2_20240929T030148_keepup.root"
29-Sep-2024 04:01:48 BST  Closed input file "np04hd_raw_run029389_0034_dataflow0_datawriter_0_20240929T005446_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              67.7302       107.577       198.303       101.018       27.7632        39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000811174   0.00317201    0.00633959    0.00358715    0.00114994       39     
produce:fembfilter:PDHDFEMBFilter                      0.567589      0.761922      0.836479      0.774773      0.0619228       39     
produce:wclsdatahd:WireCellToolkit                      38.9615       42.0446       45.396        41.9106       1.43349        39     
produce:gaushit:GausHitFinder                          0.521051      0.872878       1.41344      0.868363      0.232932        39     
produce:nhitsfilter:NumberOfHitsFilter                0.000280758    0.0003981    0.000673075   0.000398499   8.35904e-05      39     
produce:reco3d:SpacePointSolver                        0.148517       3.17133       21.703        0.68208       5.07737        39     
produce:hitpdune:DisambigFromSpacePoints               0.208892      0.804684       2.69611      0.688657      0.561717        39     
produce:pandora:StandardPandora                         5.30953       15.4223       36.379        14.0701       7.14667        39     
produce:pandoraWriter:StandardPandora                  0.125694      0.250421      0.452782      0.236889      0.0708472       39     
produce:pandoraTrack:LArPandoraTrackCreation           0.417095       1.62851       4.32653       1.36716      0.897928        39     
produce:pandoraShower:LArPandoraShowerCreation         0.391369       1.85868       6.04121       1.57171       1.29628        39     
produce:pandoracalo:Calorimetry                        0.291322      0.839391       2.22598      0.772981      0.429402        39     
produce:pandoracalonosce:Calorimetry                   0.247577      0.758676       2.13689      0.668376      0.414395        39     
produce:pandorapid:Chi2ParticleID                      0.001439     0.00235379    0.00372683    0.00220609    0.000507085      39     
produce:pandoraShowercalo:ShowerCalorimetry            0.316244       1.74316       6.03242       1.49327       1.26284        39     
produce:pandoraShowercalonosce:ShowerCalorimetry        0.30809       1.6728        5.6089        1.47216       1.13865        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0922976     0.186268      0.339448      0.186761      0.0512291       39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0322007     0.0658757     0.121382      0.0650819     0.0181381       39     
produce:emtrkmichelid:EmTrackMichelId                   17.3599       33.3686       59.3444       32.6229       9.04848        39     
[art]:TriggerResults:TriggerResultInserter            3.4024e-05    6.13018e-05   0.000141646    5.875e-05    1.98252e-05      39     
end_path:out1:RootOutput                               1.07e-05     1.70186e-05   4.9263e-05    1.5108e-05    6.85899e-06      39     
end_path:michelremoving:michelremoving                 0.0172259     0.121069      0.612485      0.0705052      0.11502        39     
end_path:michelremovinggnocchi:michelremoving          0.0164885     0.117707      0.600507      0.0590879     0.114915        39     
end_path:calibanagnocchi:CalibAnaTree                  0.151456      0.581644       1.56742       0.51207      0.309363        39     
end_path:out1:RootOutput(write)                        0.614148       1.11183       2.01856       1.07461      0.322528        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4997.21 MB
  Peak resident set size usage (VmHWM): 2642.51 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029389_0034_dataflow0_datawriter_0_20240929T005446_reco_stage1_reco_stage2_20240929T030148_keepup.root
\tHists: np04hd_raw_run029389_0034_dataflow0_datawriter_0_20240929T005446_reco_stage1_reco_stage2_20240929T030148_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029389_0034_dataflow0_datawriter_0_20240929T005446_reco_stage1_reco_stage2_20240929T030148_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029389_0034_dataflow0_datawriter_0_20240929T005446_reco_stage1_reco_stage2_20240929T030148_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727574663.0,
    "core.end_time": 1727578909.0,
    "core.events": [
      2654,
      2656,
      2658,
      2660,
      2662,
      2664,
      2666,
      2668,
      2670,
      2672,
      2674,
      2676,
      2678,
      2680,
      2682,
      2684,
      2686,
      2688,
      2690,
      2692,
      2694,
      2696,
      2698,
      2700,
      2702,
      2704,
      2706,
      2708,
      2710,
      2712,
      2714,
      2716,
      2718,
      2720,
      2722,
      2724,
      2726,
      2728,
      2730
    ],
    "core.event_count": 39,
    "core.first_event_number": 2654,
    "core.last_event_number": 2730,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0034_dataflow0_datawriter_0_20240929T005446.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029389_0034_dataflow0_datawriter_0_20240929T005446_reco_stage1_reco_stage2_20240929T030148_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727574663.0,
    "core.end_time": 1727578909.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0034_dataflow0_datawriter_0_20240929T005446.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:37:32 UTC       justIN version: 01.01.08