justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 265210.9@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID265210.9@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3493
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 17:46:45
SiteUS_UCSD
EntryCMSHTPC_T2_US_UCSD_gw6
Last heartbeat2024-09-27 20:23:20
From worker nodeHostnamemh-7662-11.t2.ucsd.edu
cpuinfoAMD EPYC 7662 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 17:48:27
Input fileshd-protodune:np04hd_raw_run027310_0741_dataflow0_datawriter_0_20240620T042548.hdf5
JobscriptExit code0
Real time2h (7724s)
CPU time1h (4377s = 56%)
Outputting started2024-09-27 19:57:12
Output fileshd-protodune-det-reco:np04hd_raw_run027310_0741_dataflow0_datawriter_0_20240620T042548_reco_stage1_reco_stage2_20240927T195703_keepup.root
hd-protodune-det-reco:np04hd_raw_run027310_0741_dataflow0_datawriter_0_20240620T042548_reco_stage1_reco_stage2_20240927T195703_keepup_hists.root
Finished2024-09-27 20:23:20
Saved logsjustin-logs:265210.9-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 43 XUs and 18 XVs -> 2 XUVs
C:0 T:1 38116 XUs and 26449 XVs -> 1488 XUVs
C:0 T:2 53089 XUs and 60393 XVs -> 2944 XUVs
C:0 T:3 2194 XUs and 1593 XVs -> 59 XUVs
C:0 T:4 66 XUs and 62 XVs -> 5 XUVs
C:0 T:5 26725 XUs and 23034 XVs -> 582 XUVs
C:0 T:6 35264 XUs and 35915 XVs -> 2553 XUVs
C:0 T:7 132 XUs and 139 XVs -> 3 XUVs
7636 XUVs total
2448 collection wire objects
7636 potential space points
Neighbour search...
486366 tests to find 252422 neighbours
Iterating with no regularization...
Begin: 4.22563e+07
0 3.93617e+07
1 3.90723e+07
2 3.90201e+07
3 3.90047e+07
Now with regularization...
Begin: 3.66998e+07
0 3.66873e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 12:57:03 PDT  Closed output file "np04hd_raw_run027310_0741_dataflow0_datawriter_0_20240620T042548_reco_stage1_reco_stage2_20240927T195703_keepup.root"
27-Sep-2024 12:57:03 PDT  Closed input file "np04hd_raw_run027310_0741_dataflow0_datawriter_0_20240620T042548_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              65.0977       101.275       168.191       98.7809       27.7567        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000592424   0.00192263    0.00410294    0.00155628    0.00118578       35     
produce:fembfilter:PDHDFEMBFilter                      0.560884      0.624119      0.730865      0.627219      0.033372        35     
produce:wclsdatahd:WireCellToolkit                      27.922        30.9534       33.7216       30.9412       1.62011        35     
produce:gaushit:GausHitFinder                          0.495595      0.786027       1.10698      0.802929      0.174025        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000249596   0.000370953   0.000518902   0.000380009   6.83472e-05      35     
produce:reco3d:SpacePointSolver                        0.219789       1.29537       3.54791       1.19281      0.799623        35     
produce:hitpdune:DisambigFromSpacePoints               0.261257      0.670453       1.41767      0.680102      0.285552        35     
produce:pandora:StandardPandora                         8.01489       28.5157       73.2404       23.4676       17.1125        35     
produce:pandoraWriter:StandardPandora                  0.100671      0.170437      0.271479       0.17102      0.0421273       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.651326       1.83014       4.32102       1.73487      0.878966        35     
produce:pandoraShower:LArPandoraShowerCreation         0.498786       1.95123       5.27436       1.89893       1.05924        35     
produce:pandoracalo:Calorimetry                        0.286171      0.867616       1.94261      0.847047      0.391431        35     
produce:pandoracalonosce:Calorimetry                   0.265181      0.810633       1.85791      0.808145       0.3758         35     
produce:pandorapid:Chi2ParticleID                     0.00136745    0.00203561    0.00287235    0.00205779    0.000431392      35     
produce:pandoraShowercalo:ShowerCalorimetry             0.40056       1.71988       4.67471       1.73764      0.964602        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.377247       1.62889       4.44224       1.63989      0.911027        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0546833     0.133038       0.2165       0.131005      0.0358007       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0212135     0.0459016     0.0744978     0.045283      0.0116107       35     
produce:emtrkmichelid:EmTrackMichelId                   16.8791       27.4605       43.9569       28.346        6.20095        35     
[art]:TriggerResults:TriggerResultInserter             1.644e-05    2.50671e-05   6.6532e-05     2.355e-05    8.57852e-06      35     
end_path:out1:RootOutput                               4.24e-06     8.65509e-06    2.343e-05     9.36e-06     3.28625e-06      35     
end_path:michelremoving:michelremoving                 0.0123592     0.0734837     0.307429      0.0296917     0.081315        35     
end_path:michelremovinggnocchi:michelremoving           0.0122       0.070553      0.307363      0.0273373     0.0801084       35     
end_path:calibanagnocchi:CalibAnaTree                  0.204809      0.653892       1.56005      0.645941      0.303265        35     
end_path:out1:RootOutput(write)                        0.510176      0.894333       1.46265      0.918483      0.207965        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5100.74 MB
  Peak resident set size usage (VmHWM): 2733.13 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027310_0741_dataflow0_datawriter_0_20240620T042548_reco_stage1_reco_stage2_20240927T195703_keepup.root
\tHists: np04hd_raw_run027310_0741_dataflow0_datawriter_0_20240620T042548_reco_stage1_reco_stage2_20240927T195703_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027310_0741_dataflow0_datawriter_0_20240620T042548_reco_stage1_reco_stage2_20240927T195703_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027310_0741_dataflow0_datawriter_0_20240620T042548_reco_stage1_reco_stage2_20240927T195703_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727463443.0,
    "core.end_time": 1727467023.0,
    "core.events": [
      103788,
      103792,
      103796,
      103800,
      103804,
      103808,
      103812,
      103816,
      103820,
      103824,
      103828,
      103832,
      103836,
      103840,
      103844,
      103848,
      103852,
      103856,
      103860,
      103864,
      103868,
      103872,
      103876,
      103880,
      103884,
      103888,
      103892,
      103896,
      103900,
      103904,
      103908,
      103912,
      103916,
      103920,
      103924
    ],
    "core.event_count": 35,
    "core.first_event_number": 103788,
    "core.last_event_number": 103924,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27310
    ],
    "core.runs_subruns": [
      2731000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027310_0741_dataflow0_datawriter_0_20240620T042548.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027310_0741_dataflow0_datawriter_0_20240620T042548_reco_stage1_reco_stage2_20240927T195703_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727463443.0,
    "core.end_time": 1727467023.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27310
    ],
    "core.runs_subruns": [
      2731000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027310_0741_dataflow0_datawriter_0_20240620T042548.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:34:24 UTC       justIN version: 01.01.08