justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 83005.9@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID83005.9@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3698
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-17 04:54:59
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2024-10-17 15:09:26
From worker nodeHostnamedunegli-3968279-0-fnpc7028.fnal.gov
cpuinfoAMD Opteron(tm) Processor 6376
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-17 11:40:42
Input fileshd-protodune:np04hd_raw_run027425_0367_dataflow1_datawriter_0_20240625T163832.hdf5
JobscriptExit code0
Real time3h (12441s)
CPU time2h (10487s = 84%)
Outputting started2024-10-17 15:08:04
Output fileshd-protodune-det-reco:np04hd_raw_run027425_0367_dataflow1_datawriter_0_20240625T163832_reco_stage1_reco_stage2_20241017T150750_keepup.root
hd-protodune-det-reco:np04hd_raw_run027425_0367_dataflow1_datawriter_0_20240625T163832_reco_stage1_reco_stage2_20241017T150750_keepup_hists.root
Finished2024-10-17 15:09:26
Saved logsjustin-logs:83005.9-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

XUs and 23973 XVs -> 463 XUVs
C:0 T:6 27241 XUs and 13790 XVs -> 878 XUVs
C:0 T:7 622 XUs and 407 XVs -> 25 XUVs
4713 XUVs total
1535 collection wire objects
4713 potential space points
Neighbour search...
351013 tests to find 176468 neighbours
Iterating with no regularization...
Begin: 2.59933e+07
0 2.42083e+07
1 2.41018e+07
2 2.40934e+07
Now with regularization...
Begin: 2.28846e+07
0 2.28823e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 51517 TrkackID 1 startx, y, z -195.895 486.291 131.274  wireno, peakt tpcno 429 1998.6 4 dist 1.94282min T, max_T1841 4820.01
no of hits closeby  0   event 51517 TrkackID 10 startx, y, z 109.454 600.339 79.3809  wireno, peakt tpcno 236 3067.57 2 dist 184.696min T, max_T1687.72 3119.65
no of hits closeby  0   event 51517 TrkackID 1 startx, y, z -195.895 486.291 131.274  wireno, peakt tpcno 429 1998.6 4 dist 1.94282min T, max_T1841 4820.01
no of hits closeby  0   event 51517 TrkackID 10 startx, y, z 109.454 600.339 79.3809  wireno, peakt tpcno 236 3067.57 2 dist 184.696min T, max_T1687.72 3119.65
17-Oct-2024 15:07:50 UTC  Closed output file "np04hd_raw_run027425_0367_dataflow1_datawriter_0_20240625T163832_reco_stage1_reco_stage2_20241017T150750_keepup.root"
17-Oct-2024 15:07:50 UTC  Closed input file "np04hd_raw_run027425_0367_dataflow1_datawriter_0_20240625T163832_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              148.258       244.844       476.71        233.873       64.6493        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000816091   0.00343638    0.00761665    0.00306588    0.00178679       35     
produce:fembfilter:PDHDFEMBFilter                       1.15212       1.24009       1.53007       1.2202       0.0824349       35     
produce:wclsdatahd:WireCellToolkit                      74.7269       81.7836       101.024       78.7375       7.46562        35     
produce:gaushit:GausHitFinder                          0.746424       1.64127       2.66357       1.61189      0.458288        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000579495   0.00109949     0.0017401    0.00115335    0.000291093      35     
produce:reco3d:SpacePointSolver                        0.237773       2.20203       26.9134       1.29705       4.33289        35     
produce:hitpdune:DisambigFromSpacePoints               0.252222       1.13692        2.876        1.01303      0.621622        35     
produce:pandora:StandardPandora                         7.18586       32.2944       154.575       26.5942       24.9672        35     
produce:pandoraWriter:StandardPandora                  0.178113      0.348332       0.57223      0.335084      0.0917414       35     
produce:pandoraTrack:LArPandoraTrackCreation            1.17769       3.25471       7.25567       3.17575       1.48737        35     
produce:pandoraShower:LArPandoraShowerCreation         0.714404       3.81029       12.1937       3.18849       2.29947        35     
produce:pandoracalo:Calorimetry                        0.512678       1.47505       3.53853       1.33117      0.636151        35     
produce:pandoracalonosce:Calorimetry                   0.463451       1.3672        3.36449       1.22178       0.61016        35     
produce:pandorapid:Chi2ParticleID                     0.00256082    0.00409439     0.0062574    0.00385589    0.000874911      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.572853       3.1148        11.1421       2.53921       1.92834        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.551173       2.97962       10.6309       2.42762       1.83911        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.127578       0.29398      0.498223      0.275199      0.0821666       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0448365     0.0931223     0.160496      0.091451      0.0246606       35     
produce:emtrkmichelid:EmTrackMichelId                   50.3028       104.823       175.774       106.427       28.5491        35     
[art]:TriggerResults:TriggerResultInserter            3.8062e-05    6.19432e-05   0.000142991   5.8349e-05    2.0197e-05       35     
end_path:out1:RootOutput                               9.624e-06    1.28646e-05   3.9136e-05    1.1256e-05    5.0271e-06       35     
end_path:michelremoving:michelremoving                 0.0296482     0.204377       1.13537      0.0620331     0.272807        35     
end_path:michelremovinggnocchi:michelremoving           0.02871      0.201693       1.1539       0.0632847     0.273775        35     
end_path:calibanagnocchi:CalibAnaTree                  0.335495       1.12015       3.24819       1.00871      0.520584        35     
end_path:out1:RootOutput(write)                        0.603375       1.30764       2.29537       1.25536      0.384514        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5010.44 MB
  Peak resident set size usage (VmHWM): 2676.21 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027425_0367_dataflow1_datawriter_0_20240625T163832_reco_stage1_reco_stage2_20241017T150750_keepup.root
\tHists: np04hd_raw_run027425_0367_dataflow1_datawriter_0_20240625T163832_reco_stage1_reco_stage2_20241017T150750_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027425_0367_dataflow1_datawriter_0_20240625T163832_reco_stage1_reco_stage2_20241017T150750_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027425_0367_dataflow1_datawriter_0_20240625T163832_reco_stage1_reco_stage2_20241017T150750_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1729169023.0,
    "core.end_time": 1729177672.0,
    "core.events": [
      51381,
      51385,
      51389,
      51393,
      51397,
      51401,
      51405,
      51409,
      51413,
      51417,
      51421,
      51425,
      51429,
      51433,
      51437,
      51441,
      51445,
      51449,
      51453,
      51457,
      51461,
      51465,
      51469,
      51473,
      51477,
      51481,
      51485,
      51489,
      51493,
      51497,
      51501,
      51505,
      51509,
      51513,
      51517
    ],
    "core.event_count": 35,
    "core.first_event_number": 51381,
    "core.last_event_number": 51517,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27425
    ],
    "core.runs_subruns": [
      2742500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027425_0367_dataflow1_datawriter_0_20240625T163832.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027425_0367_dataflow1_datawriter_0_20240625T163832_reco_stage1_reco_stage2_20241017T150750_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1729169023.0,
    "core.end_time": 1729177672.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27425
    ],
    "core.runs_subruns": [
      2742500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027425_0367_dataflow1_datawriter_0_20240625T163832.hdf5"
    }
  ]
}
justIN time: 2024-11-24 03:43:52 UTC       justIN version: 01.01.09