justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 262615.0@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID262615.0@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3448
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 01:05:59
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce3
Last heartbeat2024-09-26 05:16:13
From worker nodeHostnamen257.dur.scotgrid.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 03:03:29
Input fileshd-protodune:np04hd_raw_run029072_0407_dataflow3_datawriter_0_20240903T224159.hdf5
Outputting started2024-09-26 04:30:21
Output files
Finished2024-09-26 05:16:13
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

7504 hits in TPC 5
8677 hits in TPC 6
4728 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 465 XUs and 442 XVs -> 15 XUVs
C:0 T:2 38865 XUs and 48545 XVs -> 1063 XUVs
C:0 T:3 110 XUs and 223 XVs -> 2 XUVs
C:0 T:4 472 XUs and 446 XVs -> 29 XUVs
C:0 T:5 28343 XUs and 22183 XVs -> 735 XUVs
C:0 T:6 25115 XUs and 36853 XVs -> 1404 XUVs
C:0 T:7 847 XUs and 1152 XVs -> 88 XUVs
3336 XUVs total
1854 collection wire objects
3336 potential space points
Neighbour search...
81130 tests to find 46226 neighbours
Iterating with no regularization...
Begin: 8.30018e+06
0 7.69734e+06
1 7.65648e+06
2 7.65002e+06
Now with regularization...
Begin: 7.09992e+06
0 7.09748e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 97915 TrkackID 4 startx, y, z 154.047 599.133 297.135  wireno, peakt tpcno 0 417 5 dist 0min T, max_T415 3925.12
no of hits closeby  0   event 97915 TrkackID 4 startx, y, z 154.047 599.133 297.135  wireno, peakt tpcno 0 417 5 dist 0min T, max_T415 3925.12
26-Sep-2024 05:30:10 BST  Closed output file "np04hd_raw_run029072_0407_dataflow3_datawriter_0_20240903T224159_reco_stage1_reco_stage2_20240926T043010_keepup.root"
26-Sep-2024 05:30:10 BST  Closed input file "np04hd_raw_run029072_0407_dataflow3_datawriter_0_20240903T224159_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              56.756        89.0018       120.784       89.7151       16.0557        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000622684    0.0027366    0.00451555     0.0028474    0.00103344       30     
produce:fembfilter:PDHDFEMBFilter                      0.713752      0.753638      0.869763      0.764788      0.0345049       30     
produce:wclsdatahd:WireCellToolkit                      34.2654       35.6778       37.2973       35.7714      0.918937        30     
produce:gaushit:GausHitFinder                          0.364867      0.761914       1.17044       0.74598      0.185208        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000245547   0.000377916   0.000579912   0.000376591   6.78495e-05      30     
produce:reco3d:SpacePointSolver                        0.0992301      1.06474       2.65642      0.975348      0.617222        30     
produce:hitpdune:DisambigFromSpacePoints                0.14607      0.646254       1.30224      0.624949      0.279862        30     
produce:pandora:StandardPandora                         4.44376       13.9481       24.3643       13.4301       5.51826        30     
produce:pandoraWriter:StandardPandora                  0.0835114     0.165419      0.229252      0.166474      0.037126        30     
produce:pandoraTrack:LArPandoraTrackCreation           0.318416       1.43872       3.19118       1.38087      0.654628        30     
produce:pandoraShower:LArPandoraShowerCreation         0.219684       1.55436       3.95461       1.50666      0.802902        30     
produce:pandoracalo:Calorimetry                        0.186279      0.705566       1.31482       0.69553      0.256271        30     
produce:pandoracalonosce:Calorimetry                   0.158466      0.643848       1.20111      0.606882      0.252745        30     
produce:pandorapid:Chi2ParticleID                     0.00134554    0.00225913    0.00454659    0.00220569    0.000612939      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.195261       1.39333       3.0706        1.40855      0.688892        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.183951       1.34567       2.96649       1.37286      0.658451        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0713049     0.156212      0.238318      0.149771      0.0368528       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0272246     0.0536685     0.080278      0.0512636     0.0119207       30     
produce:emtrkmichelid:EmTrackMichelId                   13.0366       26.9772       37.5744       27.8727       5.95636        30     
[art]:TriggerResults:TriggerResultInserter            2.4737e-05    5.38938e-05   0.000114528   5.0751e-05    1.82992e-05      30     
end_path:out1:RootOutput                              1.1091e-05    1.57071e-05   3.8954e-05    1.3811e-05    5.34341e-06      30     
end_path:michelremoving:michelremoving                 0.0133576     0.102256       0.43618      0.0423732     0.106939        30     
end_path:michelremovinggnocchi:michelremoving          0.0118347     0.102596      0.436232      0.0348116     0.114525        30     
end_path:calibanagnocchi:CalibAnaTree                  0.113081      0.511122       1.11496      0.482612      0.207928        30     
end_path:out1:RootOutput(write)                        0.396785      0.836424       1.19317      0.855065      0.187715        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4917.24 MB
  Peak resident set size usage (VmHWM): 2587.71 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029072_0407_dataflow3_datawriter_0_20240903T224159_reco_stage1_reco_stage2_20240926T043010_keepup.root
\tHists: np04hd_raw_run029072_0407_dataflow3_datawriter_0_20240903T224159_reco_stage1_reco_stage2_20240926T043010_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029072_0407_dataflow3_datawriter_0_20240903T224159_reco_stage1_reco_stage2_20240926T043010_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029072_0407_dataflow3_datawriter_0_20240903T224159_reco_stage1_reco_stage2_20240926T043010_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727322291.0,
    "core.end_time": 1727325011.0,
    "core.events": [
      97643,
      97691,
      97699,
      97707,
      97715,
      97723,
      97731,
      97739,
      97747,
      97755,
      97763,
      97771,
      97779,
      97787,
      97795,
      97803,
      97811,
      97819,
      97827,
      97835,
      97843,
      97851,
      97859,
      97867,
      97875,
      97883,
      97891,
      97899,
      97907,
      97915
    ],
    "core.event_count": 30,
    "core.first_event_number": 97643,
    "core.last_event_number": 97915,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29072
    ],
    "core.runs_subruns": [
      2907200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029072_0407_dataflow3_datawriter_0_20240903T224159.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029072_0407_dataflow3_datawriter_0_20240903T224159_reco_stage1_reco_stage2_20240926T043010_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727322291.0,
    "core.end_time": 1727325011.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29072
    ],
    "core.runs_subruns": [
      2907200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029072_0407_dataflow3_datawriter_0_20240903T224159.hdf5"
    }
  ]
}
justIN time: 2024-11-17 03:20:59 UTC       justIN version: 01.01.09