justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 262553.158@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID262553.158@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3451
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-25 22:50:36
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce504
Last heartbeat2024-09-26 02:45:09
From worker nodeHostnameb9g29p4764.cern.ch
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 00:49:32
Input fileshd-protodune:np04hd_raw_run029107_2021_dataflow0_datawriter_0_20240908T003815.hdf5
Outputting started2024-09-26 02:09:24
Output files
Finished2024-09-26 02:45:09
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

832 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 12 XUs and 7 XVs -> 0 XUVs
C:0 T:1 315 XUs and 202 XVs -> 44 XUVs
C:0 T:2 6017 XUs and 6011 XVs -> 592 XUVs
C:0 T:3 113 XUs and 143 XVs -> 16 XUVs
C:0 T:4 452 XUs and 539 XVs -> 9 XUVs
C:0 T:5 33983 XUs and 20900 XVs -> 470 XUVs
C:0 T:6 17627 XUs and 19563 XVs -> 1787 XUVs
C:0 T:7 52 XUs and 41 XVs -> 3 XUVs
2921 XUVs total
1186 collection wire objects
2921 potential space points
Neighbour search...
92621 tests to find 55174 neighbours
Iterating with no regularization...
Begin: 5.33455e+06
0 4.85344e+06
1 4.81466e+06
2 4.80773e+06
3 4.80556e+06
Now with regularization...
Begin: 4.39305e+06
0 4.39195e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  11   event 485320 TrkackID 0 startx, y, z 240.595 503.738 233.567  wireno, peakt tpcno 43 329.355 5 dist 0min T, max_T7 3050.5
no of hits closeby  11   event 485320 TrkackID 0 startx, y, z 240.595 503.738 233.567  wireno, peakt tpcno 43 329.355 5 dist 0min T, max_T7 3050.5
26-Sep-2024 04:09:10 CEST  Closed output file "np04hd_raw_run029107_2021_dataflow0_datawriter_0_20240908T003815_reco_stage1_reco_stage2_20240926T020910_keepup.root"
26-Sep-2024 04:09:10 CEST  Closed input file "np04hd_raw_run029107_2021_dataflow0_datawriter_0_20240908T003815_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              85.1994       122.048       329.604       112.716       44.9429        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00065507     0.0036139    0.00680134    0.00362082    0.00148436       30     
produce:fembfilter:PDHDFEMBFilter                      0.699469      0.828869       1.02021       0.8306       0.0509964       30     
produce:wclsdatahd:WireCellToolkit                      42.9748       48.8025       52.0065       49.6322       2.26774        30     
produce:gaushit:GausHitFinder                          0.469122      0.817385       1.48311      0.815684      0.196152        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000305484   0.000460055    0.0006922    0.000448377   8.64541e-05      30     
produce:reco3d:SpacePointSolver                         0.17122       1.74264       11.3468       1.01952       2.20886        30     
produce:hitpdune:DisambigFromSpacePoints               0.211127      0.668242       2.06154       0.58374      0.408755        30     
produce:pandora:StandardPandora                         5.5993        20.5041       168.211       13.1107       29.4128        30     
produce:pandoraWriter:StandardPandora                  0.120075      0.197542      0.310496      0.189417      0.0507392       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.538335       1.61123       7.50602       1.29982       1.24708        30     
produce:pandoraShower:LArPandoraShowerCreation         0.488908       1.80688       6.80024       1.52351       1.23099        30     
produce:pandoracalo:Calorimetry                        0.300172      0.784084       3.02553      0.655562       0.50254        30     
produce:pandoracalonosce:Calorimetry                   0.261064      0.710406       2.63829      0.576471      0.444537        30     
produce:pandorapid:Chi2ParticleID                     0.00141855    0.00230397    0.00460159    0.00213302    0.000621513      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.419294       1.66866       5.5448         1.475        1.05314        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.410876       1.61443       4.96493       1.46235      0.983304        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0863397     0.195257      0.281612      0.199358      0.0441847       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0353567     0.0655142     0.0937445     0.0660638     0.0137727       30     
produce:emtrkmichelid:EmTrackMichelId                   23.6723       38.0822       61.9931       36.078        9.65896        30     
[art]:TriggerResults:TriggerResultInserter             2.894e-05    5.97635e-05   0.000107591   5.8521e-05    1.77949e-05      30     
end_path:out1:RootOutput                               9.69e-06     1.33862e-05   4.5931e-05    1.12505e-05   6.88389e-06      30     
end_path:michelremoving:michelremoving                 0.0208434     0.108597      0.414725      0.0521762     0.0976074       30     
end_path:michelremovinggnocchi:michelremoving          0.0177542     0.104188      0.430598      0.0391993     0.100531        30     
end_path:calibanagnocchi:CalibAnaTree                  0.170781       0.58497       2.37283      0.508112      0.402004        30     
end_path:out1:RootOutput(write)                        0.557602      0.981433       1.66711      0.977862      0.238001        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4948.96 MB
  Peak resident set size usage (VmHWM): 2600.85 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_2021_dataflow0_datawriter_0_20240908T003815_reco_stage1_reco_stage2_20240926T020910_keepup.root
\tHists: np04hd_raw_run029107_2021_dataflow0_datawriter_0_20240908T003815_reco_stage1_reco_stage2_20240926T020910_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_2021_dataflow0_datawriter_0_20240908T003815_reco_stage1_reco_stage2_20240926T020910_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029107_2021_dataflow0_datawriter_0_20240908T003815_reco_stage1_reco_stage2_20240926T020910_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727312839.0,
    "core.end_time": 1727316551.0,
    "core.events": [
      485072,
      485080,
      485088,
      485096,
      485104,
      485112,
      485120,
      485128,
      485136,
      485144,
      485152,
      485160,
      485168,
      485176,
      485184,
      485192,
      485200,
      485208,
      485216,
      485224,
      485232,
      485240,
      485248,
      485256,
      485264,
      485272,
      485280,
      485288,
      485312,
      485320
    ],
    "core.event_count": 30,
    "core.first_event_number": 485072,
    "core.last_event_number": 485320,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_2021_dataflow0_datawriter_0_20240908T003815.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029107_2021_dataflow0_datawriter_0_20240908T003815_reco_stage1_reco_stage2_20240926T020910_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727312839.0,
    "core.end_time": 1727316551.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_2021_dataflow0_datawriter_0_20240908T003815.hdf5"
    }
  ]
}
justIN time: 2024-11-17 06:00:46 UTC       justIN version: 01.01.09