justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 262661.41@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID262661.41@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3453
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 02:12:20
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce3
Last heartbeat2024-09-26 06:01:48
From worker nodeHostnamen168.dur.scotgrid.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 5220 CPU @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 03:33:10
Input fileshd-protodune:np04hd_raw_run029107_3546_dataflow6_datawriter_0_20240909T031110.hdf5
Outputting started2024-09-26 05:22:27
Output files
Finished2024-09-26 06:01:48
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

gauss with 48932 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 48932 traces tagged "gauss"
FrameSaver: q=1.08235e+06 n=892284 tag=gauss
wclsFrameSaver: saving 67358 traces tagged "wiener"
FrameSaver: q=1.18293e+06 n=811193 tag=wiener
4043 hits in TPC 0
2132 hits in TPC 1
3392 hits in TPC 2
3010 hits in TPC 3
2796 hits in TPC 4
5687 hits in TPC 5
7882 hits in TPC 6
6309 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 77 XUs and 44 XVs -> 1 XUVs
C:0 T:2 10347 XUs and 29244 XVs -> 2025 XUVs
C:0 T:3 36 XUs and 71 XVs -> 0 XUVs
C:0 T:4 442 XUs and 506 XVs -> 32 XUVs
C:0 T:5 19384 XUs and 33018 XVs -> 1351 XUVs
C:0 T:6 47991 XUs and 45525 XVs -> 2217 XUVs
C:0 T:7 230 XUs and 430 XVs -> 4 XUVs
5630 XUVs total
1686 collection wire objects
5630 potential space points
Neighbour search...
315310 tests to find 190060 neighbours
Iterating with no regularization...
Begin: 1.20955e+07
0 1.04391e+07
1 1.03179e+07
2 1.02964e+07
3 1.02888e+07
Now with regularization...
Begin: 9.73163e+06
0 9.72718e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

26-Sep-2024 06:22:14 BST  Closed output file "np04hd_raw_run029107_3546_dataflow6_datawriter_0_20240909T031110_reco_stage1_reco_stage2_20240926T052214_keepup.root"
26-Sep-2024 06:22:14 BST  Closed input file "np04hd_raw_run029107_3546_dataflow6_datawriter_0_20240909T031110_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              76.6024       107.82        153.699       102.953       22.4187        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000321413   0.00148265    0.00638854     0.0010997    0.00129538       30     
produce:fembfilter:PDHDFEMBFilter                      0.789792       1.01794       1.24186       1.1428       0.182733        30     
produce:wclsdatahd:WireCellToolkit                      43.5777       53.8964       67.5074       48.8891       9.10887        30     
produce:gaushit:GausHitFinder                          0.534027      0.958694       1.5043       0.886769      0.279627        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000244125   0.000414521   0.000755695   0.000386246   0.000103979      30     
produce:reco3d:SpacePointSolver                        0.206666       1.23947       4.58294       1.00373       1.0213         30     
produce:hitpdune:DisambigFromSpacePoints               0.228603      0.795525       2.16473      0.648764      0.423295        30     
produce:pandora:StandardPandora                         7.11534       15.8947       30.9516       14.5616       6.91475        30     
produce:pandoraWriter:StandardPandora                  0.113629      0.188782      0.304424      0.172312      0.0559301       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.767977       1.6822        3.78019       1.61066      0.632508        30     
produce:pandoraShower:LArPandoraShowerCreation         0.648233       1.86606       4.05803       1.88378      0.716699        30     
produce:pandoracalo:Calorimetry                        0.372016      0.773149       1.49254      0.746652       0.26019        30     
produce:pandoracalonosce:Calorimetry                   0.342379      0.707595       1.41598      0.671868      0.249305        30     
produce:pandorapid:Chi2ParticleID                     0.00143413    0.00227089    0.00480228    0.00194968    0.000806614      30     
produce:pandoraShowercalo:ShowerCalorimetry             0.4714        1.63864       3.22107       1.60081      0.613633        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.471705       1.62258       3.35658       1.56337      0.630395        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0823492     0.173668      0.327591      0.151949      0.062463        30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0350338     0.0678296     0.117787      0.057792      0.0251457       30     
produce:emtrkmichelid:EmTrackMichelId                   16.0936       23.1777       31.5307       22.2504       4.43811        30     
[art]:TriggerResults:TriggerResultInserter            3.0728e-05    5.85221e-05   0.000500647   3.8354e-05    8.31386e-05      30     
end_path:out1:RootOutput                               6.992e-06    1.07178e-05   2.8144e-05     9.933e-06    4.2001e-06       30     
end_path:michelremoving:michelremoving                 0.0248697     0.119929      0.349085      0.051215      0.106326        30     
end_path:michelremovinggnocchi:michelremoving          0.0218898     0.113842      0.343327      0.0466375     0.105501        30     
end_path:calibanagnocchi:CalibAnaTree                  0.263039      0.654895       1.32847       0.63167      0.222465        30     
end_path:out1:RootOutput(write)                        0.589087       1.08062       1.77351      0.981683      0.302753        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5767.63 MB
  Peak resident set size usage (VmHWM): 2860.27 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_3546_dataflow6_datawriter_0_20240909T031110_reco_stage1_reco_stage2_20240926T052214_keepup.root
\tHists: np04hd_raw_run029107_3546_dataflow6_datawriter_0_20240909T031110_reco_stage1_reco_stage2_20240926T052214_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_3546_dataflow6_datawriter_0_20240909T031110_reco_stage1_reco_stage2_20240926T052214_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029107_3546_dataflow6_datawriter_0_20240909T031110_reco_stage1_reco_stage2_20240926T052214_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727324845.0,
    "core.end_time": 1727328134.0,
    "core.events": [
      851070,
      851078,
      851086,
      851094,
      851102,
      851110,
      851118,
      851126,
      851134,
      851142,
      851150,
      851158,
      851166,
      851174,
      851182,
      851190,
      851198,
      851206,
      851214,
      851222,
      851230,
      851238,
      851246,
      851254,
      851262,
      851270,
      851278,
      851286,
      851294,
      851302
    ],
    "core.event_count": 30,
    "core.first_event_number": 851070,
    "core.last_event_number": 851302,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_3546_dataflow6_datawriter_0_20240909T031110.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029107_3546_dataflow6_datawriter_0_20240909T031110_reco_stage1_reco_stage2_20240926T052214_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727324845.0,
    "core.end_time": 1727328134.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_3546_dataflow6_datawriter_0_20240909T031110.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:32:39 UTC       justIN version: 01.01.08