justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266135.1@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID266135.1@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3552
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-29 02:21:47
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-09-29 04:36:34
From worker nodeHostnamewn1207081.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-29 02:23:20
Input fileshd-protodune:np04hd_raw_run029389_0036_dataflow0_datawriter_0_20240929T012041.hdf5
JobscriptExit code0
Real time2h (7835s)
CPU time1h (7034s = 89%)
Outputting started2024-09-29 04:33:56
Output fileshd-protodune-det-reco:np04hd_raw_run029389_0036_dataflow0_datawriter_0_20240929T012041_reco_stage1_reco_stage2_20240929T043339_keepup.root
hd-protodune-det-reco:np04hd_raw_run029389_0036_dataflow0_datawriter_0_20240929T012041_reco_stage1_reco_stage2_20240929T043339_keepup_hists.root
Finished2024-09-29 04:36:34
Saved logsjustin-logs:266135.1-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

its in TPC 3
5789 hits in TPC 4
10379 hits in TPC 5
10796 hits in TPC 6
3617 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 4088 XUs and 2873 XVs -> 79 XUVs
C:0 T:2 132642 XUs and 127074 XVs -> 3267 XUVs
C:0 T:3 101 XUs and 170 XVs -> 1 XUVs
C:0 T:4 367 XUs and 336 XVs -> 29 XUVs
C:0 T:5 92164 XUs and 106423 XVs -> 6304 XUVs
C:0 T:6 110355 XUs and 148919 XVs -> 3278 XUVs
C:0 T:7 161 XUs and 403 XVs -> 0 XUVs
12958 XUVs total
3263 collection wire objects
12958 potential space points
Neighbour search...
1743832 tests to find 825484 neighbours
Iterating with no regularization...
Begin: 1.84671e+07
0 1.68254e+07
1 1.67294e+07
2 1.67165e+07
Now with regularization...
Begin: 1.61823e+07
0 1.6177e+07
Failure in algorithm Alg0065, LArTwoViewTransverseTracks, STATUS_CODE_INVALID_PARAMETER
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

29-Sep-2024 05:33:39 BST  Closed output file "np04hd_raw_run029389_0036_dataflow0_datawriter_0_20240929T012041_reco_stage1_reco_stage2_20240929T043339_keepup.root"
29-Sep-2024 05:33:39 BST  Closed input file "np04hd_raw_run029389_0036_dataflow0_datawriter_0_20240929T012041_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              91.2206       150.918       285.411       140.358       41.5865        39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00054835     0.0034017    0.00647099     0.0036704    0.00144495       39     
produce:fembfilter:PDHDFEMBFilter                      0.849692       1.00615       1.24468      0.999913      0.0522291       39     
produce:wclsdatahd:WireCellToolkit                      52.4315       57.7665       69.7818       55.5709       4.98898        39     
produce:gaushit:GausHitFinder                          0.614851       1.15159       1.96941       1.14276      0.301055        39     
produce:nhitsfilter:NumberOfHitsFilter                0.000350879   0.00055327    0.000943033   0.000541888   0.000141378      39     
produce:reco3d:SpacePointSolver                        0.210534       3.70668       18.5545       1.21689       4.84991        39     
produce:hitpdune:DisambigFromSpacePoints               0.224148      0.986974       2.91276      0.805043      0.611468        39     
produce:pandora:StandardPandora                         8.23655       24.3628       93.5191       19.4415       15.8155        39     
produce:pandoraWriter:StandardPandora                  0.178669      0.308937      0.577316      0.303195      0.0800567       39     
produce:pandoraTrack:LArPandoraTrackCreation           0.566513       2.32663       8.30022       1.90526       1.43311        39     
produce:pandoraShower:LArPandoraShowerCreation         0.454528       2.83626       10.2021       2.46228       1.89915        39     
produce:pandoracalo:Calorimetry                        0.333163       1.17205       4.01555       1.02007      0.682964        39     
produce:pandoracalonosce:Calorimetry                   0.286778       1.05008       3.55325      0.893717      0.620101        39     
produce:pandorapid:Chi2ParticleID                      0.0017979    0.00632205     0.128977     0.00295867     0.019908        39     
produce:pandoraShowercalo:ShowerCalorimetry            0.423863       2.52562        9.063        2.08669       1.66596        39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.398914       2.48867       10.1563       2.21139       1.72547        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.126365       0.26774      0.517092      0.253095      0.0839894       39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0436394     0.0895037     0.211965      0.0842093     0.0302041       39     
produce:emtrkmichelid:EmTrackMichelId                   23.7995       46.144        96.9164       45.0589       13.1086        39     
[art]:TriggerResults:TriggerResultInserter            3.5286e-05    6.03659e-05   0.000106551   5.6256e-05    1.83089e-05      39     
end_path:out1:RootOutput                               4.749e-06    8.79377e-06   2.8353e-05     6.763e-06    5.05278e-06      39     
end_path:michelremoving:michelremoving                 0.0277661     0.141694      0.746622      0.0714484     0.147542        39     
end_path:michelremovinggnocchi:michelremoving          0.0245661     0.134435      0.764645      0.068344      0.143318        39     
end_path:calibanagnocchi:CalibAnaTree                  0.253834      0.848915       2.95317      0.751738      0.507047        39     
end_path:out1:RootOutput(write)                         0.70299       1.37144       2.68987       1.33571       0.39391        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4975.5 MB
  Peak resident set size usage (VmHWM): 2605.36 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029389_0036_dataflow0_datawriter_0_20240929T012041_reco_stage1_reco_stage2_20240929T043339_keepup.root
\tHists: np04hd_raw_run029389_0036_dataflow0_datawriter_0_20240929T012041_reco_stage1_reco_stage2_20240929T043339_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029389_0036_dataflow0_datawriter_0_20240929T012041_reco_stage1_reco_stage2_20240929T043339_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029389_0036_dataflow0_datawriter_0_20240929T012041_reco_stage1_reco_stage2_20240929T043339_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727578459.0,
    "core.end_time": 1727584420.0,
    "core.events": [
      2810,
      2812,
      2814,
      2816,
      2818,
      2820,
      2822,
      2824,
      2826,
      2828,
      2830,
      2832,
      2834,
      2836,
      2838,
      2840,
      2842,
      2844,
      2846,
      2848,
      2850,
      2852,
      2854,
      2856,
      2858,
      2860,
      2862,
      2864,
      2866,
      2868,
      2870,
      2872,
      2874,
      2876,
      2878,
      2880,
      2882,
      2884,
      2886
    ],
    "core.event_count": 39,
    "core.first_event_number": 2810,
    "core.last_event_number": 2886,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0036_dataflow0_datawriter_0_20240929T012041.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029389_0036_dataflow0_datawriter_0_20240929T012041_reco_stage1_reco_stage2_20240929T043339_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727578459.0,
    "core.end_time": 1727584420.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0036_dataflow0_datawriter_0_20240929T012041.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:30:59 UTC       justIN version: 01.01.08