justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 253598.60@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID253598.60@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3163
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-10 05:57:42
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce4
Last heartbeat2024-09-10 08:22:30
From worker nodeHostnamen254.dur.scotgrid.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-10 06:44:41
Input fileshd-protodune:np04hd_raw_run028550_1141_dataflow0_datawriter_0_20240806T003650.hdf5
Outputting started2024-09-10 08:20:51
Output files
Finished2024-09-10 08:22:30
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

r: tagging trace set: gauss with 45040 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 45040 traces tagged "gauss"
FrameSaver: q=959812 n=757076 tag=gauss
wclsFrameSaver: saving 65510 traces tagged "wiener"
FrameSaver: q=1.06697e+06 n=666832 tag=wiener
3637 hits in TPC 0
2825 hits in TPC 1
6566 hits in TPC 2
3988 hits in TPC 3
2158 hits in TPC 4
2783 hits in TPC 5
6433 hits in TPC 6
3375 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1139 XUs and 1661 XVs -> 145 XUVs
C:0 T:2 35849 XUs and 69312 XVs -> 3035 XUVs
C:0 T:3 49 XUs and 70 XVs -> 18 XUVs
C:0 T:4 74 XUs and 92 XVs -> 5 XUVs
C:0 T:5 17795 XUs and 24153 XVs -> 586 XUVs
C:0 T:6 31347 XUs and 44328 XVs -> 585 XUVs
C:0 T:7 99 XUs and 447 XVs -> 5 XUVs
4379 XUVs total
1230 collection wire objects
4379 potential space points
Neighbour search...
406711 tests to find 230456 neighbours
Iterating with no regularization...
Begin: 1.50372e+07
0 1.409e+07
1 1.40317e+07
2 1.40249e+07
Now with regularization...
Begin: 1.33841e+07
0 1.3381e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

10-Sep-2024 09:20:38 BST  Closed output file "np04hd_raw_run028550_1141_dataflow0_datawriter_0_20240806T003650_reco_stage1_reco_stage2_20240910T082038_keepup.root"
10-Sep-2024 09:20:38 BST  Closed input file "np04hd_raw_run028550_1141_dataflow0_datawriter_0_20240806T003650_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              62.6151       93.6854       150.033       89.9957       19.2767        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000478971   0.00269272    0.00482209    0.00260854    0.00120652       30     
produce:fembfilter:PDHDFEMBFilter                      0.689132      0.751383      0.801348      0.770072      0.0394962       30     
produce:wclsdatahd:WireCellToolkit                      34.1825       36.2881       38.2716       36.3492      0.997779        30     
produce:gaushit:GausHitFinder                          0.495421      0.814599       1.33884      0.828959      0.196461        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000295627   0.000395177   0.000562348   0.000393455   6.46602e-05      30     
produce:reco3d:SpacePointSolver                        0.335938       2.01762       10.5639       1.27084       2.0305         30     
produce:hitpdune:DisambigFromSpacePoints               0.203728      0.737616       1.80829      0.610188      0.359411        30     
produce:pandora:StandardPandora                         4.81134       15.0574       40.5641       13.8841       7.33316        30     
produce:pandoraWriter:StandardPandora                  0.104083       0.18607      0.276617      0.176125      0.0404135       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.419739       1.47937       3.44912       1.23861      0.694388        30     
produce:pandoraShower:LArPandoraShowerCreation         0.398461       1.62601       4.1332        1.25384      0.931921        30     
produce:pandoracalo:Calorimetry                        0.260495      0.730092       1.52257      0.632365       0.27406        30     
produce:pandoracalonosce:Calorimetry                   0.220564      0.658176       1.51349       0.56102      0.265439        30     
produce:pandorapid:Chi2ParticleID                     0.00135031    0.00215999    0.00419713    0.00207078    0.000530026      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.345868       1.42874       3.89725       1.19091      0.754796        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.338873       1.35957       3.61846       1.12401      0.691972        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0950896     0.167941      0.248356      0.162697      0.0344283       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0339758     0.0552582     0.0801536     0.0522967     0.0105815       30     
produce:emtrkmichelid:EmTrackMichelId                   16.7725       28.5833       43.0581       27.0327       6.11597        30     
[art]:TriggerResults:TriggerResultInserter            3.0678e-05    4.99325e-05   8.4799e-05    4.9743e-05    1.10204e-05      30     
end_path:out1:RootOutput                               8.646e-06    1.31393e-05   2.9295e-05    1.2368e-05    3.85965e-06      30     
end_path:michelremoving:michelremoving                 0.0208187     0.076285      0.406899      0.0359556     0.0906213       30     
end_path:michelremovinggnocchi:michelremoving          0.0190948     0.0729485     0.405711      0.0311046     0.0916197       30     
end_path:calibanagnocchi:CalibAnaTree                  0.222987      0.515934       1.18782      0.447483      0.217708        30     
end_path:out1:RootOutput(write)                        0.532844      0.904043       1.37629      0.842335      0.188451        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4963.33 MB
  Peak resident set size usage (VmHWM): 2635.82 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028550_1141_dataflow0_datawriter_0_20240806T003650_reco_stage1_reco_stage2_20240910T082038_keepup.root
\tHists: np04hd_raw_run028550_1141_dataflow0_datawriter_0_20240806T003650_reco_stage1_reco_stage2_20240910T082038_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028550_1141_dataflow0_datawriter_0_20240806T003650_reco_stage1_reco_stage2_20240910T082038_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028550_1141_dataflow0_datawriter_0_20240806T003650_reco_stage1_reco_stage2_20240910T082038_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1725953581.0,
    "core.end_time": 1725956439.0,
    "core.events": [
      273856,
      273864,
      273872,
      273880,
      273888,
      273896,
      273904,
      273912,
      273920,
      273928,
      273936,
      273944,
      273952,
      273960,
      273968,
      273976,
      273984,
      273992,
      274000,
      274008,
      274016,
      274024,
      274032,
      274040,
      274048,
      274056,
      274064,
      274072,
      274096,
      274104
    ],
    "core.event_count": 30,
    "core.first_event_number": 273856,
    "core.last_event_number": 274104,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28550
    ],
    "core.runs_subruns": [
      2855000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028550_1141_dataflow0_datawriter_0_20240806T003650.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028550_1141_dataflow0_datawriter_0_20240806T003650_reco_stage1_reco_stage2_20240910T082038_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1725953581.0,
    "core.end_time": 1725956439.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28550
    ],
    "core.runs_subruns": [
      2855000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028550_1141_dataflow0_datawriter_0_20240806T003650.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:23:58 UTC       justIN version: 01.01.08