justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 59462.33@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID59462.33@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-18 20:24:21
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_dissel_multicore
Last heartbeat2024-08-18 21:57:36
From worker nodeHostnamewn-snel-002.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-18 20:55:14
Input fileshd-protodune:np04hd_raw_run028762_0775_dataflow3_datawriter_0_20240818T195453.hdf5
JobscriptExit code0
Real time1h (3669s)
CPU time55m (3351s = 91%)
Outputting started2024-08-18 21:56:24
Output fileshd-protodune-det-reco:np04hd_raw_run028762_0775_dataflow3_datawriter_0_20240818T195453_reco_stage1_reco_stage2_20240818T215614_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_0775_dataflow3_datawriter_0_20240818T195453_reco_stage1_reco_stage2_20240818T215614_keepup_hists.root
Finished2024-08-18 21:57:36
Saved logsjustin-logs:59462.33-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

3 hits in TPC 6
3227 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 8848 XUs and 15583 XVs -> 2167 XUVs
C:0 T:2 18355 XUs and 17603 XVs -> 670 XUVs
C:0 T:3 1317 XUs and 2156 XVs -> 129 XUVs
C:0 T:4 58 XUs and 42 XVs -> 1 XUVs
C:0 T:5 44266 XUs and 44130 XVs -> 1354 XUVs
C:0 T:6 42790 XUs and 27424 XVs -> 1259 XUVs
C:0 T:7 51 XUs and 46 XVs -> 6 XUVs
5586 XUVs total
1620 collection wire objects
5586 potential space points
Neighbour search...
632220 tests to find 331188 neighbours
Iterating with no regularization...
Begin: 1.10309e+07
0 9.65948e+06
1 9.59701e+06
2 9.589e+06
Now with regularization...
Begin: 9.00773e+06
0 9.00487e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 186251 TrkackID 6 startx, y, z 20.6303 588.757 374.223  wireno, peakt tpcno 205 5780.95 6 dist 446.902min T, max_T4462.6 5797.21
no of hits closeby  0   event 186251 TrkackID 6 startx, y, z 20.6303 588.757 374.223  wireno, peakt tpcno 205 5780.95 6 dist 446.902min T, max_T4462.6 5797.21
18-Aug-2024 23:56:14 CEST  Closed output file "np04hd_raw_run028762_0775_dataflow3_datawriter_0_20240818T195453_reco_stage1_reco_stage2_20240818T215614_keepup.root"
18-Aug-2024 23:56:14 CEST  Closed input file "np04hd_raw_run028762_0775_dataflow3_datawriter_0_20240818T195453_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              50.4993       84.6843       128.467       81.5482       18.4478        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000364826   0.00153262    0.00351233    0.00144402    0.000734943      30     
produce:fembfilter:PDHDFEMBFilter                      0.497008      0.547904      0.952924      0.508274      0.102677        30     
produce:wclsdatahd:WireCellToolkit                      29.0617       30.4615       32.6036       30.1956      0.878953        30     
produce:gaushit:GausHitFinder                          0.270132      0.577773       1.19083      0.590961      0.170228        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000237988   0.000471745   0.000797599   0.000455546   0.00013007       30     
produce:reco3d:SpacePointSolver                        0.0900127     0.992332       2.97983      0.892458       0.74637        30     
produce:hitpdune:DisambigFromSpacePoints               0.0883218     0.410444       0.72798      0.411948      0.163377        30     
produce:pandora:StandardPandora                         2.97606       14.9348       37.3863        13.4         7.85786        30     
produce:pandoraWriter:StandardPandora                  0.0564842     0.151742       0.23512      0.147507      0.0405605       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.250613       1.15937       2.71934       1.03331      0.600442        30     
produce:pandoraShower:LArPandoraShowerCreation         0.219632       1.1554        2.55976      0.981864      0.674813        30     
produce:pandoracalo:Calorimetry                        0.143774      0.558946       1.36638      0.492948      0.269829        30     
produce:pandoracalonosce:Calorimetry                   0.127009      0.507997       1.12924      0.457211      0.240153        30     
produce:pandorapid:Chi2ParticleID                     0.00105243    0.00183455    0.00304592    0.00172307    0.00045806       30     
produce:pandoraShowercalo:ShowerCalorimetry             0.18658      0.972693       2.25967      0.852823      0.511077        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.182017      0.958097       2.18923      0.831773       0.52142        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0498971     0.118519      0.262163      0.115552      0.0372104       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0190734     0.0439551     0.094306      0.0421363     0.0137133       30     
produce:emtrkmichelid:EmTrackMichelId                   14.4778       29.4549       48.8079       28.5481       7.29799        30     
[art]:TriggerResults:TriggerResultInserter            1.4918e-05    2.25281e-05   8.9308e-05    1.9657e-05    1.29023e-05      30     
end_path:out1:RootOutput                               3.296e-06    5.09213e-06   2.6419e-05     4.358e-06    3.98299e-06      30     
end_path:michelremoving:michelremoving                 0.0179038     0.119017      0.530833      0.0866092     0.120917        30     
end_path:michelremovinggnocchi:michelremoving          0.0168162     0.116174      0.528536      0.0835389     0.119558        30     
end_path:calibanagnocchi:CalibAnaTree                  0.164532      0.509291        1.344        0.50854      0.229423        30     
end_path:out1:RootOutput(write)                        0.462529      0.812386       1.31734      0.794585      0.208829        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4951.38 MB
  Peak resident set size usage (VmHWM): 2630.6 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_0775_dataflow3_datawriter_0_20240818T195453_reco_stage1_reco_stage2_20240818T215614_keepup.root
\tHists: np04hd_raw_run028762_0775_dataflow3_datawriter_0_20240818T195453_reco_stage1_reco_stage2_20240818T215614_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_0775_dataflow3_datawriter_0_20240818T195453_reco_stage1_reco_stage2_20240818T215614_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_0775_dataflow3_datawriter_0_20240818T195453_reco_stage1_reco_stage2_20240818T215614_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724015600.0,
    "core.end_time": 1724018175.0,
    "core.events": [
      185987,
      185995,
      186003,
      186011,
      186035,
      186043,
      186051,
      186059,
      186067,
      186075,
      186083,
      186091,
      186099,
      186107,
      186115,
      186123,
      186131,
      186139,
      186147,
      186155,
      186163,
      186171,
      186179,
      186187,
      186195,
      186203,
      186211,
      186219,
      186227,
      186251
    ],
    "core.event_count": 30,
    "core.first_event_number": 185987,
    "core.last_event_number": 186251,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_0775_dataflow3_datawriter_0_20240818T195453.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_0775_dataflow3_datawriter_0_20240818T195453_reco_stage1_reco_stage2_20240818T215614_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724015600.0,
    "core.end_time": 1724018175.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_0775_dataflow3_datawriter_0_20240818T195453.hdf5"
    }
  ]
}
justIN time: 2024-11-17 06:08:21 UTC       justIN version: 01.01.09