justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261382.6@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID261382.6@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3357
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-24 04:38:24
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce4
Last heartbeat2024-09-24 08:17:18
From worker nodeHostnamen230.dur.scotgrid.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 5220 CPU @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-24 04:39:35
Input fileshd-protodune:np04hd_raw_run029247_0075_dataflow0_datawriter_0_20240924T033635.hdf5
Outputting started2024-09-24 06:39:25
Output files
Finished2024-09-24 08:17:18
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

: saving 40987 traces tagged "gauss"
FrameSaver: q=870454 n=787041 tag=gauss
wclsFrameSaver: saving 52426 traces tagged "wiener"
FrameSaver: q=922956 n=715428 tag=wiener
2871 hits in TPC 0
3856 hits in TPC 1
2849 hits in TPC 2
2639 hits in TPC 3
2231 hits in TPC 4
6578 hits in TPC 5
4367 hits in TPC 6
2812 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 254 XUs and 251 XVs -> 27 XUVs
C:0 T:2 4545 XUs and 4244 XVs -> 291 XUVs
C:0 T:3 73 XUs and 73 XVs -> 2 XUVs
C:0 T:4 233 XUs and 345 XVs -> 7 XUVs
C:0 T:5 29771 XUs and 31773 XVs -> 816 XUVs
C:0 T:6 7040 XUs and 10254 XVs -> 638 XUVs
C:0 T:7 236 XUs and 287 XVs -> 4 XUVs
1785 XUVs total
1130 collection wire objects
1785 potential space points
Neighbour search...
105659 tests to find 49712 neighbours
Iterating with no regularization...
Begin: 4.33284e+06
0 4.12007e+06
1 4.11393e+06
2 4.11326e+06
Now with regularization...
Begin: 3.80202e+06
0 3.80156e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

24-Sep-2024 07:39:16 BST  Closed output file "np04hd_raw_run029247_0075_dataflow0_datawriter_0_20240924T033635_reco_stage1_reco_stage2_20240924T063916_keepup.root"
24-Sep-2024 07:39:16 BST  Closed input file "np04hd_raw_run029247_0075_dataflow0_datawriter_0_20240924T033635_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              89.8439       125.437       177.981       122.148       20.819         39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000463286   0.00138229    0.00462128    0.00107172    0.000950049      39     
produce:fembfilter:PDHDFEMBFilter                       0.74959       1.08355       1.33759       1.0887       0.105263        39     
produce:wclsdatahd:WireCellToolkit                      55.2118       65.5774       75.8799       66.3171       4.02466        39     
produce:gaushit:GausHitFinder                          0.543015       1.13216       1.80308       1.09101      0.315542        39     
produce:nhitsfilter:NumberOfHitsFilter                0.000268807   0.000450617   0.000773529   0.000445282   9.52992e-05      39     
produce:reco3d:SpacePointSolver                        0.211909       1.25514       4.61343       1.05586      0.975266        39     
produce:hitpdune:DisambigFromSpacePoints               0.198192      0.859448       1.69665      0.782082       0.35464        39     
produce:pandora:StandardPandora                         6.77935       17.9966       45.5184       16.4782       8.18433        39     
produce:pandoraWriter:StandardPandora                  0.146968      0.218099      0.308973      0.201155      0.0453741       39     
produce:pandoraTrack:LArPandoraTrackCreation           0.877248       2.69623       4.88218       2.40982       1.07276        39     
produce:pandoraShower:LArPandoraShowerCreation         0.725821       3.0401        7.26105       2.32851       1.71603        39     
produce:pandoracalo:Calorimetry                        0.389906       1.11925       1.98399       1.00681      0.423845        39     
produce:pandoracalonosce:Calorimetry                   0.358946       1.02286       1.78894      0.901644      0.389146        39     
produce:pandorapid:Chi2ParticleID                     0.00155431    0.00269702    0.00457251    0.00271129    0.000594211      39     
produce:pandoraShowercalo:ShowerCalorimetry            0.623937       2.59142       5.85707       2.0842        1.39067        39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.604072       2.5073        5.82231       1.94957       1.31866        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.114795      0.203298       0.32995       0.19033      0.0547119       39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0446599     0.0795313     0.123292      0.0749826     0.0205459       39     
produce:emtrkmichelid:EmTrackMichelId                   14.3819       21.4759       30.8006       21.8708       4.42376        39     
[art]:TriggerResults:TriggerResultInserter            2.8963e-05    5.17222e-05   9.2584e-05    5.1915e-05    1.04683e-05      39     
end_path:out1:RootOutput                               9.46e-06     1.48743e-05   2.9764e-05    1.4446e-05    3.3288e-06       39     
end_path:michelremoving:michelremoving                 0.0316289     0.137158      0.533833      0.0729799      0.1166         39     
end_path:michelremovinggnocchi:michelremoving          0.030729      0.133335      0.524346      0.0706277     0.115282        39     
end_path:calibanagnocchi:CalibAnaTree                  0.276346      0.866944       1.53937      0.842795      0.315176        39     
end_path:out1:RootOutput(write)                        0.690827       1.19739       1.66205       1.16531      0.278181        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5798.89 MB
  Peak resident set size usage (VmHWM): 2863.6 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029247_0075_dataflow0_datawriter_0_20240924T033635_reco_stage1_reco_stage2_20240924T063916_keepup.root
\tHists: np04hd_raw_run029247_0075_dataflow0_datawriter_0_20240924T033635_reco_stage1_reco_stage2_20240924T063916_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029247_0075_dataflow0_datawriter_0_20240924T033635_reco_stage1_reco_stage2_20240924T063916_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029247_0075_dataflow0_datawriter_0_20240924T033635_reco_stage1_reco_stage2_20240924T063916_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727155015.0,
    "core.end_time": 1727159957.0,
    "core.events": [
      5852,
      5854,
      5856,
      5858,
      5860,
      5862,
      5864,
      5866,
      5868,
      5870,
      5872,
      5874,
      5876,
      5878,
      5880,
      5882,
      5884,
      5886,
      5888,
      5890,
      5892,
      5894,
      5896,
      5898,
      5900,
      5902,
      5904,
      5906,
      5908,
      5910,
      5912,
      5914,
      5916,
      5918,
      5920,
      5922,
      5924,
      5926,
      5928
    ],
    "core.event_count": 39,
    "core.first_event_number": 5852,
    "core.last_event_number": 5928,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29247
    ],
    "core.runs_subruns": [
      2924700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029247_0075_dataflow0_datawriter_0_20240924T033635.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029247_0075_dataflow0_datawriter_0_20240924T033635_reco_stage1_reco_stage2_20240924T063916_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727155015.0,
    "core.end_time": 1727159957.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29247
    ],
    "core.runs_subruns": [
      2924700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029247_0075_dataflow0_datawriter_0_20240924T033635.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:30:17 UTC       justIN version: 01.01.08