justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 262675.34@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID262675.34@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3451
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 02:43:12
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce514
Last heartbeat2024-09-26 05:18:32
From worker nodeHostnameb9p26p5310.cern.ch
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 03:47:38
Input fileshd-protodune:np04hd_raw_run029107_2085_dataflow5_datawriter_0_20240908T013147.hdf5
Outputting started2024-09-26 04:50:13
Output files
Finished2024-09-26 05:18:32
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

2e+06 n=1279998 tag=wiener
7465 hits in TPC 0
3558 hits in TPC 1
10411 hits in TPC 2
6508 hits in TPC 3
4831 hits in TPC 4
6441 hits in TPC 5
9272 hits in TPC 6
5629 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1120 XUs and 927 XVs -> 52 XUVs
C:0 T:2 55502 XUs and 44008 XVs -> 1022 XUVs
C:0 T:3 321 XUs and 360 XVs -> 9 XUVs
C:0 T:4 179 XUs and 474 XVs -> 17 XUVs
C:0 T:5 42877 XUs and 25295 XVs -> 1018 XUVs
C:0 T:6 72235 XUs and 51134 XVs -> 2201 XUVs
C:0 T:7 2930 XUs and 4100 XVs -> 127 XUVs
4446 XUVs total
2217 collection wire objects
4446 potential space points
Neighbour search...
150090 tests to find 88620 neighbours
Iterating with no regularization...
Begin: 1.24909e+07
0 1.1111e+07
1 1.10039e+07
2 1.09892e+07
3 1.09854e+07
Now with regularization...
Begin: 1.03834e+07
0 1.03812e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 500661 TrkackID 9 startx, y, z 126.876 600.924 101.046  wireno, peakt tpcno 222 2939 2 dist 369.245min T, max_T11.9835 2972.42
no of hits closeby  0   event 500661 TrkackID 9 startx, y, z 126.876 600.924 101.046  wireno, peakt tpcno 222 2939 2 dist 369.245min T, max_T11.9835 2972.42
26-Sep-2024 06:50:02 CEST  Closed output file "np04hd_raw_run029107_2085_dataflow5_datawriter_0_20240908T013147_reco_stage1_reco_stage2_20240926T045002_keepup.root"
26-Sep-2024 06:50:02 CEST  Closed input file "np04hd_raw_run029107_2085_dataflow5_datawriter_0_20240908T013147_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              52.0961       88.0413       141.225       83.4703       18.6232        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000606463   0.00309411    0.00741301     0.0030847    0.00166857       30     
produce:fembfilter:PDHDFEMBFilter                      0.586288      0.740408       1.05252      0.744121      0.0778928       30     
produce:wclsdatahd:WireCellToolkit                      30.9041       37.2749       49.7164       36.6529       4.36531        30     
produce:gaushit:GausHitFinder                          0.415656      0.792826       1.41353      0.785487      0.242729        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000261316   0.000474195   0.00178815    0.000413088   0.000273045      30     
[art]:TriggerResults:TriggerResultInserter            2.4651e-05    5.66109e-05   0.000161333   5.0421e-05    2.77055e-05      30     
end_path:out1:RootOutput                               8.45e-06     1.30222e-05    2.849e-05    1.1325e-05    4.98004e-06      30     
end_path:michelremoving:michelremoving                0.000328607    0.0751111     0.313665      0.0405433     0.0710368       30     
end_path:michelremovinggnocchi:michelremoving         9.7962e-05     0.0660939     0.207885      0.0336988     0.0609452       30     
end_path:calibanagnocchi:CalibAnaTree                 8.7022e-05     0.477814       1.03199      0.455703      0.211029        30     
end_path:out1:RootOutput(write)                        0.397091      0.861494       1.5722       0.802529      0.230815        30     
produce:reco3d:SpacePointSolver                        0.122393      0.907341       2.1043       0.727648      0.613907        29     
produce:hitpdune:DisambigFromSpacePoints               0.126945      0.546171       1.65942      0.566248      0.324325        29     
produce:pandora:StandardPandora                         4.21964       12.1497       30.5445       10.8815       5.88541        29     
produce:pandoraWriter:StandardPandora                  0.104791      0.186349      0.310513      0.179973      0.0512762       29     
produce:pandoraTrack:LArPandoraTrackCreation            0.42362       1.22123       3.30314       1.16463      0.589416        29     
produce:pandoraShower:LArPandoraShowerCreation         0.508899       1.45719       4.9798        1.14289      0.974144        29     
produce:pandoracalo:Calorimetry                        0.310368      0.643376       1.53364      0.623656      0.279759        29     
produce:pandoracalonosce:Calorimetry                   0.255927       0.56758       1.37973      0.511248      0.260006        29     
produce:pandorapid:Chi2ParticleID                     0.00120662    0.00199329    0.00356306    0.00182597    0.000521962      29     
produce:pandoraShowercalo:ShowerCalorimetry            0.490977       1.34197       4.42382       1.06816      0.911919        29     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.478304       1.30631       4.23566       1.12405      0.792504        29     
produce:pandoraGnocchiCalo:GnocchiCalorimetry           0.10185      0.153796      0.277481       0.14454      0.0391694       29     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0325845     0.053155      0.0923977     0.0499398     0.0122193       29     
produce:emtrkmichelid:EmTrackMichelId                   17.5904       28.7168       45.9867       26.774        6.62062        29     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4917.88 MB
  Peak resident set size usage (VmHWM): 2572.44 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_2085_dataflow5_datawriter_0_20240908T013147_reco_stage1_reco_stage2_20240926T045002_keepup.root
\tHists: np04hd_raw_run029107_2085_dataflow5_datawriter_0_20240908T013147_reco_stage1_reco_stage2_20240926T045002_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_2085_dataflow5_datawriter_0_20240908T013147_reco_stage1_reco_stage2_20240926T045002_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029107_2085_dataflow5_datawriter_0_20240908T013147_reco_stage1_reco_stage2_20240926T045002_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727323513.0,
    "core.end_time": 1727326203.0,
    "core.events": [
      500397,
      500405,
      500413,
      500421,
      500461,
      500469,
      500477,
      500485,
      500493,
      500501,
      500509,
      500517,
      500525,
      500533,
      500541,
      500549,
      500557,
      500565,
      500573,
      500581,
      500589,
      500597,
      500605,
      500613,
      500621,
      500629,
      500637,
      500645,
      500653,
      500661
    ],
    "core.event_count": 30,
    "core.first_event_number": 500397,
    "core.last_event_number": 500661,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_2085_dataflow5_datawriter_0_20240908T013147.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029107_2085_dataflow5_datawriter_0_20240908T013147_reco_stage1_reco_stage2_20240926T045002_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727323513.0,
    "core.end_time": 1727326203.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_2085_dataflow5_datawriter_0_20240908T013147.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:26:56 UTC       justIN version: 01.01.08