justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269446.3@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID269446.3@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3599
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-04 18:25:43
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-10-04 23:16:09
From worker nodeHostnamewn1904250.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7513 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-04 21:49:18
Input fileshd-protodune:np04hd_raw_run029405_0066_dataflow1_datawriter_0_20241002T021535.hdf5
JobscriptExit code0
Real time1h (5122s)
CPU time1h (4458s = 87%)
Outputting started2024-10-04 23:14:41
Output fileshd-protodune-det-reco:np04hd_raw_run029405_0066_dataflow1_datawriter_0_20241002T021535_reco_stage1_reco_stage2_20241004T231425_keepup.root
hd-protodune-det-reco:np04hd_raw_run029405_0066_dataflow1_datawriter_0_20241002T021535_reco_stage1_reco_stage2_20241004T231425_keepup_hists.root
Finished2024-10-04 23:16:09
Saved logsjustin-logs:269446.3-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

5 27116 XUs and 35607 XVs -> 1891 XUVs
C:0 T:6 75129 XUs and 117437 XVs -> 2501 XUVs
C:0 T:7 142 XUs and 103 XVs -> 2 XUVs
6461 XUVs total
2501 collection wire objects
6461 potential space points
Neighbour search...
479387 tests to find 228116 neighbours
Iterating with no regularization...
Begin: 1.36953e+07
0 1.24399e+07
1 1.23975e+07
2 1.23916e+07
Now with regularization...
Begin: 1.1802e+07
0 1.17997e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 5225 TrkackID 21 startx, y, z 66.1999 478.304 61.7246  wireno, peakt tpcno 114 792.843 2 dist 88.5072min T, max_T5 829.153
no of hits closeby  8   event 5225 TrkackID 24 startx, y, z 52.2315 557.314 436.608  wireno, peakt tpcno 329 5089.31 5 dist 0min T, max_T4869.67 5500.66
no of hits closeby  0   event 5225 TrkackID 21 startx, y, z 66.1999 478.304 61.7246  wireno, peakt tpcno 114 792.843 2 dist 88.5072min T, max_T5 829.153
no of hits closeby  8   event 5225 TrkackID 24 startx, y, z 52.2315 557.314 436.608  wireno, peakt tpcno 329 5089.31 5 dist 0min T, max_T4869.67 5500.66
05-Oct-2024 00:14:25 BST  Closed output file "np04hd_raw_run029405_0066_dataflow1_datawriter_0_20241002T021535_reco_stage1_reco_stage2_20241004T231425_keepup.root"
05-Oct-2024 00:14:25 BST  Closed input file "np04hd_raw_run029405_0066_dataflow1_datawriter_0_20241002T021535_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              59.473        89.9929       139.728       87.098        18.0283        39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000846061   0.00245392    0.00476108    0.00234789    0.000850065      39     
produce:fembfilter:PDHDFEMBFilter                      0.504534      0.763031      0.923804       0.79033      0.100031        39     
produce:wclsdatahd:WireCellToolkit                      31.0594       38.6308       42.7602       39.2579       2.55257        39     
produce:gaushit:GausHitFinder                          0.282479      0.767041       1.4057       0.738974      0.243382        39     
produce:nhitsfilter:NumberOfHitsFilter                0.000246824   0.000353918   0.000684787   0.000337354   8.70371e-05      39     
produce:reco3d:SpacePointSolver                        0.159235       1.29136       7.53355      0.681984       1.39734        39     
produce:hitpdune:DisambigFromSpacePoints               0.0783611     0.618912       2.04928      0.526872      0.402492        39     
produce:pandora:StandardPandora                         3.21763       12.1906       30.2744       10.0756       6.48884        39     
produce:pandoraWriter:StandardPandora                  0.100913      0.200201      0.336502      0.192521      0.0549447       39     
produce:pandoraTrack:LArPandoraTrackCreation           0.323886       1.01263       2.41937      0.872851      0.476998        39     
produce:pandoraShower:LArPandoraShowerCreation         0.214388       1.2235        3.11364       1.02682      0.683849        39     
produce:pandoracalo:Calorimetry                        0.208362      0.594338       1.51056       0.52827      0.278993        39     
produce:pandoracalonosce:Calorimetry                   0.174591      0.527556       1.42509      0.461501      0.255201        39     
produce:pandorapid:Chi2ParticleID                     0.00123327    0.00203763    0.00559281    0.00194347    0.000715764      39     
produce:pandoraShowercalo:ShowerCalorimetry            0.192863       1.15649       2.94604      0.976313      0.672635        39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.193306       1.10195       2.79982      0.953281       0.60816        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0723079     0.154748       0.31718      0.147203      0.0531121       39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0246954     0.0533688     0.108215      0.0525653     0.0167774       39     
produce:emtrkmichelid:EmTrackMichelId                   14.1295       27.945        45.3906       26.7834       6.46056        39     
[art]:TriggerResults:TriggerResultInserter            2.7812e-05    4.55635e-05   0.000112822   4.2079e-05    1.62445e-05      39     
end_path:out1:RootOutput                               8.095e-06    1.28452e-05   3.7511e-05    1.1482e-05    5.21112e-06      39     
end_path:michelremoving:michelremoving                 0.0179745     0.110348      0.626687      0.0507267     0.122889        39     
end_path:michelremovinggnocchi:michelremoving          0.0159602     0.0990863     0.583217      0.0351288     0.116021        39     
end_path:calibanagnocchi:CalibAnaTree                  0.162545      0.432026      0.963605      0.382476      0.165634        39     
end_path:out1:RootOutput(write)                        0.567475       1.00315       1.63164      0.986758      0.249603        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4918.67 MB
  Peak resident set size usage (VmHWM): 2556.88 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029405_0066_dataflow1_datawriter_0_20241002T021535_reco_stage1_reco_stage2_20241004T231425_keepup.root
\tHists: np04hd_raw_run029405_0066_dataflow1_datawriter_0_20241002T021535_reco_stage1_reco_stage2_20241004T231425_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029405_0066_dataflow1_datawriter_0_20241002T021535_reco_stage1_reco_stage2_20241004T231425_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029405_0066_dataflow1_datawriter_0_20241002T021535_reco_stage1_reco_stage2_20241004T231425_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728080090.0,
    "core.end_time": 1728083666.0,
    "core.events": [
      5149,
      5151,
      5153,
      5155,
      5157,
      5159,
      5161,
      5163,
      5165,
      5167,
      5169,
      5171,
      5173,
      5175,
      5177,
      5179,
      5181,
      5183,
      5185,
      5187,
      5189,
      5191,
      5193,
      5195,
      5197,
      5199,
      5201,
      5203,
      5205,
      5207,
      5209,
      5211,
      5213,
      5215,
      5217,
      5219,
      5221,
      5223,
      5225
    ],
    "core.event_count": 39,
    "core.first_event_number": 5149,
    "core.last_event_number": 5225,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29405
    ],
    "core.runs_subruns": [
      2940500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029405_0066_dataflow1_datawriter_0_20241002T021535.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029405_0066_dataflow1_datawriter_0_20241002T021535_reco_stage1_reco_stage2_20241004T231425_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728080090.0,
    "core.end_time": 1728083666.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29405
    ],
    "core.runs_subruns": [
      2940500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029405_0066_dataflow1_datawriter_0_20241002T021535.hdf5"
    }
  ]
}
justIN time: 2024-11-24 09:29:23 UTC       justIN version: 01.01.09