justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 59391.150@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID59391.150@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2866
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-18 17:58:13
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_dissel
Last heartbeat2024-08-18 20:37:09
From worker nodeHostnamewn-sate-044.farm.nikhef.nl
cpuinfoAMD EPYC 7551P 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-18 18:53:29
Input fileshd-protodune:np04hd_raw_run028762_0463_dataflow7_datawriter_0_20240818T164723.hdf5
Outputting started2024-08-18 20:35:39
Output files
Finished2024-08-18 20:37:09
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

er: tagging trace set: wiener with 48416 traces, 48416 summary
Retagger: tagging trace set: gauss with 35876 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 35876 traces tagged "gauss"
FrameSaver: q=803137 n=641374 tag=gauss
wclsFrameSaver: saving 48416 traces tagged "wiener"
FrameSaver: q=863379 n=578281 tag=wiener
772 hits in TPC 0
639 hits in TPC 1
4587 hits in TPC 2
1796 hits in TPC 3
2806 hits in TPC 4
5588 hits in TPC 5
5537 hits in TPC 6
2594 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 101 XUs and 43 XVs -> 6 XUVs
C:0 T:2 9593 XUs and 7855 XVs -> 212 XUVs
C:0 T:3 93 XUs and 164 XVs -> 4 XUVs
C:0 T:4 107 XUs and 158 XVs -> 2 XUVs
C:0 T:5 17486 XUs and 18874 XVs -> 4331 XUVs
C:0 T:6 25801 XUs and 16623 XVs -> 2079 XUVs
C:0 T:7 672 XUs and 629 XVs -> 13 XUVs
6647 XUVs total
1359 collection wire objects
6647 potential space points
Neighbour search...
635909 tests to find 348222 neighbours
Iterating with no regularization...
Begin: 4.97949e+06
0 4.53688e+06
1 4.48659e+06
2 4.4771e+06
3 4.47371e+06
Now with regularization...
Begin: 3.97731e+06
0 3.97429e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

18-Aug-2024 22:35:26 CEST  Closed output file "np04hd_raw_run028762_0463_dataflow7_datawriter_0_20240818T164723_reco_stage1_reco_stage2_20240818T203526_keepup.root"
18-Aug-2024 22:35:26 CEST  Closed input file "np04hd_raw_run028762_0463_dataflow7_datawriter_0_20240818T164723_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              93.3227       155.572       308.211       144.482       45.5007        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000763624   0.00277603    0.00454844    0.00267711    0.00106094       30     
produce:fembfilter:PDHDFEMBFilter                      0.711284      0.726722      0.778245      0.722095      0.0142155       30     
produce:wclsdatahd:WireCellToolkit                      41.6079       46.0101       49.5477       46.0041       1.79647        30     
produce:gaushit:GausHitFinder                          0.592934       1.08421       1.68805       1.06714      0.261439        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000326694   0.000453184   0.000799281   0.000435523   9.69758e-05      30     
produce:reco3d:SpacePointSolver                        0.482805       1.58573       6.13202       1.17429       1.24144        30     
produce:hitpdune:DisambigFromSpacePoints               0.373978      0.820942       2.3171        0.70335      0.417279        30     
produce:pandora:StandardPandora                         6.88257       31.8753       117.887       27.0856       22.4882        30     
produce:pandoraWriter:StandardPandora                   0.14388      0.242493      0.390462      0.232167      0.0644254       30     
produce:pandoraTrack:LArPandoraTrackCreation            1.26778       3.16878       6.74816       2.72382       1.38982        30     
produce:pandoraShower:LArPandoraShowerCreation          1.44037       3.78597       8.93717       3.19308       2.10132        30     
produce:pandoracalo:Calorimetry                        0.562234       1.52516       3.66964       1.31074      0.727004        30     
produce:pandoracalonosce:Calorimetry                   0.508739       1.42943       3.44246       1.22625      0.716543        30     
produce:pandorapid:Chi2ParticleID                     0.00191703    0.00295246    0.00531305     0.002822     0.000694768      30     
produce:pandoraShowercalo:ShowerCalorimetry             1.07258       3.5071        10.0266       2.6378        2.32384        30     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.05846       3.35937       9.21182       2.49852       2.13437        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.140372      0.219186      0.311694      0.214376      0.0443368       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0495588     0.0736001     0.0977221     0.0725021     0.0137885       30     
produce:emtrkmichelid:EmTrackMichelId                   31.8787       53.4728       85.1032       54.104        12.1539        30     
[art]:TriggerResults:TriggerResultInserter            2.9135e-05    5.77061e-05   0.000168046   5.66165e-05   2.33327e-05      30     
end_path:out1:RootOutput                               8.496e-06    1.95764e-05   5.5214e-05    2.0523e-05    1.03023e-05      30     
end_path:michelremoving:michelremoving                 0.0312474     0.119332      0.516721      0.0578046     0.128852        30     
end_path:michelremovinggnocchi:michelremoving          0.0287208     0.113984      0.516892      0.0525174     0.129908        30     
end_path:calibanagnocchi:CalibAnaTree                   0.36598       1.07236       2.61605      0.855525      0.553208        30     
end_path:out1:RootOutput(write)                         0.74806       1.16888       1.83656       1.14932      0.261158        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4971.35 MB
  Peak resident set size usage (VmHWM): 2654.13 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_0463_dataflow7_datawriter_0_20240818T164723_reco_stage1_reco_stage2_20240818T203526_keepup.root
\tHists: np04hd_raw_run028762_0463_dataflow7_datawriter_0_20240818T164723_reco_stage1_reco_stage2_20240818T203526_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_0463_dataflow7_datawriter_0_20240818T164723_reco_stage1_reco_stage2_20240818T203526_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_0463_dataflow7_datawriter_0_20240818T164723_reco_stage1_reco_stage2_20240818T203526_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724008598.0,
    "core.end_time": 1724013327.0,
    "core.events": [
      111127,
      111135,
      111143,
      111151,
      111159,
      111167,
      111175,
      111183,
      111191,
      111199,
      111207,
      111215,
      111223,
      111231,
      111239,
      111247,
      111255,
      111263,
      111271,
      111279,
      111287,
      111295,
      111303,
      111311,
      111319,
      111327,
      111335,
      111343,
      111351,
      111359
    ],
    "core.event_count": 30,
    "core.first_event_number": 111127,
    "core.last_event_number": 111359,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_0463_dataflow7_datawriter_0_20240818T164723.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_0463_dataflow7_datawriter_0_20240818T164723_reco_stage1_reco_stage2_20240818T203526_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724008598.0,
    "core.end_time": 1724013327.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_0463_dataflow7_datawriter_0_20240818T164723.hdf5"
    }
  ]
}
justIN time: 2024-11-22 00:32:49 UTC       justIN version: 01.01.09