justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 63014.1@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID63014.1@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2918
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-28 16:29:02
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2024-08-28 17:25:26
From worker nodeHostnamedunegli-3937041-0-fnpc19122.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-28 16:31:02
Input fileshd-protodune:np04hd_raw_run028086_2535_dataflow1_datawriter_0_20240722T085450.hdf5
JobscriptExit code0
Real time53m (3216s)
CPU time51m (3114s = 96%)
Outputting started2024-08-28 17:24:39
Output fileshd-protodune-det-reco:np04hd_raw_run028086_2535_dataflow1_datawriter_0_20240722T085450_reco_stage1_reco_stage2_20240828T172432_keepup.root
hd-protodune-det-reco:np04hd_raw_run028086_2535_dataflow1_datawriter_0_20240722T085450_reco_stage1_reco_stage2_20240828T172432_keepup_hists.root
Finished2024-08-28 17:25:26
Saved logsjustin-logs:63014.1-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

tagged "wiener"
FrameSaver: q=2.28694e+06 n=883571 tag=wiener
3587 hits in TPC 0
3999 hits in TPC 1
12385 hits in TPC 2
5742 hits in TPC 3
3199 hits in TPC 4
5967 hits in TPC 5
6805 hits in TPC 6
2739 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 2012 XUs and 1413 XVs -> 100 XUVs
C:0 T:2 68794 XUs and 118143 XVs -> 2061 XUVs
C:0 T:3 6905 XUs and 10173 XVs -> 688 XUVs
C:0 T:4 44 XUs and 60 XVs -> 1 XUVs
C:0 T:5 20956 XUs and 22705 XVs -> 745 XUVs
C:0 T:6 48355 XUs and 65543 XVs -> 1453 XUVs
C:0 T:7 128 XUs and 195 XVs -> 4 XUVs
5052 XUVs total
1828 collection wire objects
5052 potential space points
Neighbour search...
ZERO DISTANCE SOMEHOW?
0x31d881a0 0x139ecc70 0x2dcb0de0
0x31d881a0 0x139ecc70 0x1c9e4f40
0 180.826 180.826 559.042 559.042 230.038 230.038
ZERO DISTANCE SOMEHOW?
0x31d881a0 0x139ecc70 0x1c9e4f40
0x31d881a0 0x139ecc70 0x2dcb0de0
0 180.826 180.826 559.042 559.042 230.038 230.038
228820 tests to find 121466 neighbours
Iterating with no regularization...
Begin: 4.12407e+07
0 3.68459e+07
1 3.65906e+07
2 3.65674e+07
Now with regularization...
Begin: 3.51454e+07
0 3.51374e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

28-Aug-2024 17:24:32 UTC  Closed output file "np04hd_raw_run028086_2535_dataflow1_datawriter_0_20240722T085450_reco_stage1_reco_stage2_20240828T172432_keepup.root"
28-Aug-2024 17:24:32 UTC  Closed input file "np04hd_raw_run028086_2535_dataflow1_datawriter_0_20240722T085450_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              58.0985       77.6373       128.081       75.4465       14.5001        31     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000365763   0.00228533     0.0039254    0.00242101    0.00101323       31     
produce:fembfilter:PDHDFEMBFilter                      0.558887      0.572072      0.601838      0.570877      0.0077514       31     
produce:wclsdatahd:WireCellToolkit                      26.3089       28.004        36.1743       27.4077       1.82777        31     
produce:gaushit:GausHitFinder                          0.416483      0.618901       0.82089      0.620247      0.0940984       31     
produce:nhitsfilter:NumberOfHitsFilter                0.000250992   0.000361467   0.000482103   0.000359123   4.81941e-05      31     
produce:reco3d:SpacePointSolver                        0.277831       1.50969       5.39923       1.10112       1.1051         31     
produce:hitpdune:DisambigFromSpacePoints               0.232173      0.522226      0.992362      0.528302      0.168818        31     
produce:pandora:StandardPandora                         6.62298       14.5431       56.2376       12.8634       8.60199        31     
produce:pandoraWriter:StandardPandora                  0.113915      0.151003      0.212026      0.151062      0.0238219       31     
produce:pandoraTrack:LArPandoraTrackCreation           0.583353       1.33533       3.25103       1.23478      0.490931        31     
produce:pandoraShower:LArPandoraShowerCreation         0.675917       1.5398        3.65391       1.37321      0.644983        31     
produce:pandoracalo:Calorimetry                        0.351229      0.652215       1.47738      0.610829      0.206569        31     
produce:pandoracalonosce:Calorimetry                   0.314643      0.599468       1.38698      0.564752      0.196185        31     
produce:pandorapid:Chi2ParticleID                     0.00103162    0.00163965     0.0030218    0.00161787    0.000343319      31     
produce:pandoraShowercalo:ShowerCalorimetry            0.648445       1.40187       3.44227       1.25712      0.585221        31     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.615661       1.33422       3.07367       1.2283       0.533866        31     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0942493     0.124528      0.166535       0.12272      0.0203241       31     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.033286      0.0433338     0.0558414     0.0426978    0.00677105       31     
produce:emtrkmichelid:EmTrackMichelId                   16.719        23.1838       31.0948       23.2417       3.52724        31     
[art]:TriggerResults:TriggerResultInserter             1.697e-05    2.27524e-05    5.916e-05     2.051e-05    8.19966e-06      31     
end_path:out1:RootOutput                               7.27e-06     9.20194e-06    2.05e-05      8.64e-06     3.01043e-06      31     
end_path:michelremoving:michelremoving                 0.0175921     0.0581698     0.150415      0.0265992     0.0481667       31     
end_path:michelremovinggnocchi:michelremoving          0.0166505     0.0561119     0.146866      0.0250728     0.0479873       31     
end_path:calibanagnocchi:CalibAnaTree                  0.235632      0.488158       1.04622      0.472612      0.152024        31     
end_path:out1:RootOutput(write)                        0.589016      0.787751       1.09452      0.792375      0.125233        31     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5026.12 MB
  Peak resident set size usage (VmHWM): 2681.14 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028086_2535_dataflow1_datawriter_0_20240722T085450_reco_stage1_reco_stage2_20240828T172432_keepup.root
\tHists: np04hd_raw_run028086_2535_dataflow1_datawriter_0_20240722T085450_reco_stage1_reco_stage2_20240828T172432_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028086_2535_dataflow1_datawriter_0_20240722T085450_reco_stage1_reco_stage2_20240828T172432_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028086_2535_dataflow1_datawriter_0_20240722T085450_reco_stage1_reco_stage2_20240828T172432_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724863433.0,
    "core.end_time": 1724865873.0,
    "core.events": [
      628601,
      628609,
      628617,
      628625,
      628633,
      628641,
      628649,
      628657,
      628665,
      628673,
      628681,
      628689,
      628697,
      628705,
      628713,
      628721,
      628729,
      628737,
      628745,
      628753,
      628761,
      628769,
      628777,
      628785,
      628793,
      628801,
      628809,
      628825,
      628833,
      628841,
      628849
    ],
    "core.event_count": 31,
    "core.first_event_number": 628601,
    "core.last_event_number": 628849,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28086
    ],
    "core.runs_subruns": [
      2808600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028086_2535_dataflow1_datawriter_0_20240722T085450.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028086_2535_dataflow1_datawriter_0_20240722T085450_reco_stage1_reco_stage2_20240828T172432_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724863433.0,
    "core.end_time": 1724865873.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28086
    ],
    "core.runs_subruns": [
      2808600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028086_2535_dataflow1_datawriter_0_20240722T085450.hdf5"
    }
  ]
}
justIN time: 2024-11-17 07:58:23 UTC       justIN version: 01.01.09