justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266284.1@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID266284.1@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3553
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-29 09:16:27
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2024-09-29 11:11:00
From worker nodeHostnamewn5916300.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-29 09:17:24
Input fileshd-protodune:np04hd_raw_run029389_0071_dataflow1_datawriter_0_20240929T085609.hdf5
JobscriptExit code0
Real time1h (6657s)
CPU time1h (5990s = 89%)
Outputting started2024-09-29 11:08:22
Output fileshd-protodune-det-reco:np04hd_raw_run029389_0071_dataflow1_datawriter_0_20240929T085609_reco_stage1_reco_stage2_20240929T110804_keepup.root
hd-protodune-det-reco:np04hd_raw_run029389_0071_dataflow1_datawriter_0_20240929T085609_reco_stage1_reco_stage2_20240929T110804_keepup_hists.root
Finished2024-09-29 11:11:00
Saved logsjustin-logs:266284.1-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ces, 53983 summary
Retagger: tagging trace set: gauss with 39943 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 39943 traces tagged "gauss"
FrameSaver: q=913894 n=744539 tag=gauss
wclsFrameSaver: saving 53983 traces tagged "wiener"
FrameSaver: q=988850 n=678662 tag=wiener
3581 hits in TPC 0
3712 hits in TPC 1
3714 hits in TPC 2
1995 hits in TPC 3
1838 hits in TPC 4
3594 hits in TPC 5
4702 hits in TPC 6
3643 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1614 XUs and 1720 XVs -> 130 XUVs
C:0 T:2 6793 XUs and 5871 XVs -> 648 XUVs
C:0 T:3 29 XUs and 9 XVs -> 1 XUVs
C:0 T:4 112 XUs and 144 XVs -> 6 XUVs
C:0 T:5 7829 XUs and 21429 XVs -> 1414 XUVs
C:0 T:6 22075 XUs and 17697 XVs -> 1609 XUVs
C:0 T:7 237 XUs and 353 XVs -> 13 XUVs
3821 XUVs total
895 collection wire objects
3821 potential space points
Neighbour search...
198029 tests to find 119712 neighbours
Iterating with no regularization...
Begin: 9.50694e+06
0 8.35684e+06
1 8.26107e+06
2 8.24788e+06
3 8.2443e+06
Now with regularization...
Begin: 7.71003e+06
0 7.70768e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

29-Sep-2024 12:08:04 BST  Closed output file "np04hd_raw_run029389_0071_dataflow1_datawriter_0_20240929T085609_reco_stage1_reco_stage2_20240929T110804_keepup.root"
29-Sep-2024 12:08:04 BST  Closed input file "np04hd_raw_run029389_0071_dataflow1_datawriter_0_20240929T085609_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              80.8905       122.461       210.692       116.23        30.4121        39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000646828   0.00285107    0.00504492    0.00300746    0.00123854       39     
produce:fembfilter:PDHDFEMBFilter                      0.692167      0.961269       1.06018      0.972849      0.0685271       39     
produce:wclsdatahd:WireCellToolkit                      49.3042       55.0388       69.8842       53.0704       5.16689        39     
produce:gaushit:GausHitFinder                          0.360385      0.921407       1.66198      0.928429       0.2757         39     
produce:nhitsfilter:NumberOfHitsFilter                0.000269698   0.000472563   0.00083842    0.000452493   0.000121884      39     
produce:reco3d:SpacePointSolver                        0.085882       1.2086        7.52632      0.708126       1.56004        39     
produce:hitpdune:DisambigFromSpacePoints               0.0980082     0.635015       1.98054      0.521038      0.412307        39     
produce:pandora:StandardPandora                         3.87451       15.5493       39.804        14.0733       8.58255        39     
produce:pandoraWriter:StandardPandora                  0.119005      0.243674      0.431889      0.235302      0.0723599       39     
produce:pandoraTrack:LArPandoraTrackCreation            0.44039       1.70731       5.46274       1.37815        1.054         39     
produce:pandoraShower:LArPandoraShowerCreation         0.286237       1.97582       7.8757        1.41913       1.67638        39     
produce:pandoracalo:Calorimetry                        0.217789      0.853114       2.59151      0.739614      0.498058        39     
produce:pandoracalonosce:Calorimetry                   0.175437      0.767839       1.98897      0.666713      0.425621        39     
produce:pandorapid:Chi2ParticleID                     0.00123663     0.0027504    0.00528533    0.00261173    0.000798405      39     
produce:pandoraShowercalo:ShowerCalorimetry            0.198563       1.79377       7.16027       1.3599        1.50663        39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.193784       1.67748       6.84829       1.46002       1.3024         39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0650467     0.213705      0.418825      0.215143      0.068599        39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0235149     0.0719447     0.142459      0.0707708     0.0233892       39     
produce:emtrkmichelid:EmTrackMichelId                   15.8004       36.6246       66.4474       34.4129       12.2127        39     
[art]:TriggerResults:TriggerResultInserter             3.201e-05    6.1084e-05    0.000100108   6.1766e-05    1.60736e-05      39     
end_path:out1:RootOutput                               4.819e-06    8.89731e-06   2.9255e-05     8.927e-06    4.20786e-06      39     
end_path:michelremoving:michelremoving                 0.0164136     0.161882      0.730667      0.0981562     0.161692        39     
end_path:michelremovinggnocchi:michelremoving          0.017076      0.156249       0.72825      0.0955281     0.159904        39     
end_path:calibanagnocchi:CalibAnaTree                  0.147567      0.622253       1.85467      0.554941      0.357202        39     
end_path:out1:RootOutput(write)                        0.501508       1.06506       2.08509        1.019       0.343916        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4993.1 MB
  Peak resident set size usage (VmHWM): 2642.76 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029389_0071_dataflow1_datawriter_0_20240929T085609_reco_stage1_reco_stage2_20240929T110804_keepup.root
\tHists: np04hd_raw_run029389_0071_dataflow1_datawriter_0_20240929T085609_reco_stage1_reco_stage2_20240929T110804_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029389_0071_dataflow1_datawriter_0_20240929T085609_reco_stage1_reco_stage2_20240929T110804_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029389_0071_dataflow1_datawriter_0_20240929T085609_reco_stage1_reco_stage2_20240929T110804_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727603242.0,
    "core.end_time": 1727608086.0,
    "core.events": [
      5541,
      5543,
      5545,
      5547,
      5549,
      5551,
      5553,
      5555,
      5557,
      5559,
      5561,
      5563,
      5565,
      5567,
      5569,
      5571,
      5573,
      5575,
      5577,
      5579,
      5581,
      5583,
      5585,
      5587,
      5589,
      5591,
      5593,
      5595,
      5597,
      5599,
      5601,
      5603,
      5605,
      5607,
      5609,
      5611,
      5613,
      5615,
      5617
    ],
    "core.event_count": 39,
    "core.first_event_number": 5541,
    "core.last_event_number": 5617,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0071_dataflow1_datawriter_0_20240929T085609.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029389_0071_dataflow1_datawriter_0_20240929T085609_reco_stage1_reco_stage2_20240929T110804_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727603242.0,
    "core.end_time": 1727608086.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0071_dataflow1_datawriter_0_20240929T085609.hdf5"
    }
  ]
}
justIN time: 2024-11-17 08:06:08 UTC       justIN version: 01.01.09