justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 265290.0@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID265290.0@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3493
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 18:44:32
SiteUS_UCSD
EntryCMSHTPC_T2_US_UCSD_gw6
Last heartbeat2024-09-27 20:27:21
From worker nodeHostnamemh-7763-1.t2.ucsd.edu
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 18:46:05
Input fileshd-protodune:np04hd_raw_run027311_0014_dataflow1_datawriter_0_20240620T044756.hdf5
JobscriptExit code0
Real time1h (5968s)
CPU time1h (3644s = 61%)
Outputting started2024-09-27 20:25:34
Output fileshd-protodune-det-reco:np04hd_raw_run027311_0014_dataflow1_datawriter_0_20240620T044756_reco_stage1_reco_stage2_20240927T202527_keepup.root
hd-protodune-det-reco:np04hd_raw_run027311_0014_dataflow1_datawriter_0_20240620T044756_reco_stage1_reco_stage2_20240927T202527_keepup_hists.root
Finished2024-09-27 20:27:21
Saved logsjustin-logs:265290.0-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ener"
FrameSaver: q=1.90034e+06 n=864240 tag=wiener
7675 hits in TPC 0
7172 hits in TPC 1
5179 hits in TPC 2
1988 hits in TPC 3
4904 hits in TPC 4
6091 hits in TPC 5
6048 hits in TPC 6
2064 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 13089 XUs and 10661 XVs -> 679 XUVs
C:0 T:2 24786 XUs and 26691 XVs -> 696 XUVs
C:0 T:3 108 XUs and 97 XVs -> 9 XUVs
C:0 T:4 112 XUs and 109 XVs -> 8 XUVs
C:0 T:5 28925 XUs and 26306 XVs -> 434 XUVs
C:0 T:6 57693 XUs and 44982 XVs -> 908 XUVs
C:0 T:7 285 XUs and 247 XVs -> 3 XUVs
2737 XUVs total
1202 collection wire objects
2737 potential space points
Neighbour search...
93031 tests to find 52294 neighbours
Iterating with no regularization...
Begin: 1.97172e+07
0 1.84427e+07
1 1.8379e+07
2 1.83689e+07
Now with regularization...
Begin: 1.78683e+07
0 1.78643e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 13:25:27 PDT  Closed output file "np04hd_raw_run027311_0014_dataflow1_datawriter_0_20240620T044756_reco_stage1_reco_stage2_20240927T202527_keepup.root"
27-Sep-2024 13:25:27 PDT  Closed input file "np04hd_raw_run027311_0014_dataflow1_datawriter_0_20240620T044756_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              54.4871       85.7291       124.925       86.4551       17.1495        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000335237   0.00153476    0.00354919    0.00131787    0.00091288       35     
produce:fembfilter:PDHDFEMBFilter                      0.497352      0.512272      0.530847      0.512364     0.00730161       35     
produce:wclsdatahd:WireCellToolkit                      25.0254       26.1228       27.1166       26.1839      0.565722        35     
produce:gaushit:GausHitFinder                          0.371677       0.59529      0.779424      0.627036      0.113005        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000202348   0.00029846    0.000451467   0.000302818   5.54848e-05      35     
produce:reco3d:SpacePointSolver                        0.233599       1.11595       3.22473      0.806039      0.697005        35     
produce:hitpdune:DisambigFromSpacePoints               0.212324      0.590172       1.2327        0.52955      0.247117        35     
produce:pandora:StandardPandora                         7.33207       22.9322       50.7315       20.2058       10.3633        35     
produce:pandoraWriter:StandardPandora                  0.0733392     0.130054      0.196331      0.131609      0.0286879       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.521471       1.55061       3.41184       1.44835      0.616277        35     
produce:pandoraShower:LArPandoraShowerCreation         0.639606       1.55277       2.86153       1.35746      0.641629        35     
produce:pandoracalo:Calorimetry                        0.303772       0.80429       1.75661       0.76469      0.299521        35     
produce:pandoracalonosce:Calorimetry                   0.281363      0.758808       1.66526       0.73093       0.28659        35     
produce:pandorapid:Chi2ParticleID                     0.00103741    0.00177688    0.00282388     0.0017162    0.00038472       35     
produce:pandoraShowercalo:ShowerCalorimetry            0.655498       1.49875       2.76931       1.42246      0.620433        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.643287       1.43277       2.63956       1.35047      0.592157        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.049705      0.096458      0.128508      0.0987734     0.0220137       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.018947      0.0327609     0.0466906     0.0337549    0.00707937       35     
produce:emtrkmichelid:EmTrackMichelId                   16.5241       24.4911       32.1237       25.0763       4.06763        35     
[art]:TriggerResults:TriggerResultInserter            1.5849e-05    2.49039e-05    6.306e-05     2.133e-05    9.80158e-06      35     
end_path:out1:RootOutput                               6.76e-06     9.70991e-06    2.247e-05     9.33e-06     2.65408e-06      35     
end_path:michelremoving:michelremoving                 0.0122487     0.0459708     0.233808      0.0214916     0.0541574       35     
end_path:michelremovinggnocchi:michelremoving          0.0105599     0.0429393     0.227493      0.0193121     0.0533974       35     
end_path:calibanagnocchi:CalibAnaTree                  0.226879      0.611521       1.32413      0.574591      0.231391        35     
end_path:out1:RootOutput(write)                        0.437021      0.691432      0.978288      0.716871       0.13243        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5057.71 MB
  Peak resident set size usage (VmHWM): 2671.99 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027311_0014_dataflow1_datawriter_0_20240620T044756_reco_stage1_reco_stage2_20240927T202527_keepup.root
\tHists: np04hd_raw_run027311_0014_dataflow1_datawriter_0_20240620T044756_reco_stage1_reco_stage2_20240927T202527_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027311_0014_dataflow1_datawriter_0_20240620T044756_reco_stage1_reco_stage2_20240927T202527_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027311_0014_dataflow1_datawriter_0_20240620T044756_reco_stage1_reco_stage2_20240927T202527_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727465698.0,
    "core.end_time": 1727468727.0,
    "core.events": [
      1965,
      1969,
      1973,
      1977,
      1981,
      1985,
      1989,
      1993,
      1997,
      2001,
      2005,
      2009,
      2013,
      2017,
      2021,
      2025,
      2029,
      2033,
      2037,
      2041,
      2045,
      2049,
      2053,
      2057,
      2061,
      2065,
      2069,
      2073,
      2077,
      2081,
      2085,
      2089,
      2093,
      2097,
      2101
    ],
    "core.event_count": 35,
    "core.first_event_number": 1965,
    "core.last_event_number": 2101,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27311
    ],
    "core.runs_subruns": [
      2731100001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027311_0014_dataflow1_datawriter_0_20240620T044756.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027311_0014_dataflow1_datawriter_0_20240620T044756_reco_stage1_reco_stage2_20240927T202527_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727465698.0,
    "core.end_time": 1727468727.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27311
    ],
    "core.runs_subruns": [
      2731100001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027311_0014_dataflow1_datawriter_0_20240620T044756.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:33:47 UTC       justIN version: 01.01.08