justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 82898.0@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID82898.0@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3692
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-17 02:27:34
SiteUS_UCSD
EntryCMSHTPC_T2_US_UCSD_gw7
Last heartbeat2024-10-17 11:51:39
From worker nodeHostnamemh-7763-1.t2.ucsd.edu
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-17 09:03:08
Input fileshd-protodune:np04hd_raw_run027304_0007_dataflow3_datawriter_0_20240619T165115.hdf5
JobscriptExit code0
Real time2h (10025s)
CPU time49m (2990s = 29%)
Outputting started2024-10-17 11:50:15
Output fileshd-protodune-det-reco:np04hd_raw_run027304_0007_dataflow3_datawriter_0_20240619T165115_reco_stage1_reco_stage2_20241017T115008_keepup.root
hd-protodune-det-reco:np04hd_raw_run027304_0007_dataflow3_datawriter_0_20240619T165115_reco_stage1_reco_stage2_20241017T115008_keepup_hists.root
Finished2024-10-17 11:51:39
Saved logsjustin-logs:82898.0-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

C 4
10631 hits in TPC 5
3844 hits in TPC 6
2186 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 3546 XUs and 2510 XVs -> 90 XUVs
C:0 T:2 29556 XUs and 12289 XVs -> 330 XUVs
C:0 T:3 760 XUs and 651 XVs -> 23 XUVs
C:0 T:4 50 XUs and 60 XVs -> 1 XUVs
C:0 T:5 46514 XUs and 63433 XVs -> 1310 XUVs
C:0 T:6 6856 XUs and 6240 XVs -> 239 XUVs
C:0 T:7 405 XUs and 1200 XVs -> 91 XUVs
2084 XUVs total
979 collection wire objects
2084 potential space points
Neighbour search...
47944 tests to find 30244 neighbours
Iterating with no regularization...
Begin: 1.55484e+07
0 1.44038e+07
1 1.43231e+07
2 1.43184e+07
Now with regularization...
Begin: 1.38726e+07
0 1.38712e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  7   event 1119 TrkackID 15 startx, y, z -75.6901 60.1652 455.606  wireno, peakt tpcno 245 3149.89 6 dist 0min T, max_T2320.53 3253.72
no of hits closeby  7   event 1119 TrkackID 15 startx, y, z -75.6901 60.1652 455.606  wireno, peakt tpcno 245 3149.89 6 dist 0min T, max_T2320.53 3253.72
17-Oct-2024 04:50:08 PDT  Closed output file "np04hd_raw_run027304_0007_dataflow3_datawriter_0_20240619T165115_reco_stage1_reco_stage2_20241017T115008_keepup.root"
17-Oct-2024 04:50:08 PDT  Closed input file "np04hd_raw_run027304_0007_dataflow3_datawriter_0_20240619T165115_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              31.3291       67.2525       103.485       66.746        16.4495        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000560796   0.00156307    0.00266258    0.00152826    0.000500716      35     
produce:fembfilter:PDHDFEMBFilter                      0.482473      0.502308      0.585704       0.50022      0.0178281       35     
produce:wclsdatahd:WireCellToolkit                      24.898        26.1003       28.682        25.8798      0.984187        35     
produce:gaushit:GausHitFinder                          0.361927      0.539777       1.7917       0.516594      0.238458        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000159609   0.000276467   0.000842904   0.000255989   0.000115486      35     
produce:reco3d:SpacePointSolver                         0.12159      0.638123       3.20002       0.48711      0.548215        34     
produce:hitpdune:DisambigFromSpacePoints               0.123336      0.394936      0.789937      0.346892      0.162834        34     
produce:pandora:StandardPandora                         3.70709       13.8138       34.4312       11.6002       9.05437        34     
produce:pandoraWriter:StandardPandora                  0.0559508     0.0930436     0.137331      0.0885914     0.0225338       34     
produce:pandoraTrack:LArPandoraTrackCreation           0.295472      0.977763       2.17057      0.880984      0.425485        34     
produce:pandoraShower:LArPandoraShowerCreation         0.348783       1.06479       2.10493      0.818598      0.470412        34     
produce:pandoracalo:Calorimetry                        0.183668      0.525318       1.07946      0.456046      0.208014        34     
produce:pandoracalonosce:Calorimetry                    0.16579      0.487757       1.01829      0.419022       0.19752        34     
produce:pandorapid:Chi2ParticleID                     0.000982843   0.00149072    0.00330118    0.00141213    0.000396956      34     
produce:pandoraShowercalo:ShowerCalorimetry            0.322439       1.04008       1.88697       0.81364      0.438729        34     
produce:pandoraShowercalonosce:ShowerCalorimetry        0.30546      0.993317       1.81572      0.783927      0.408519        34     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0469884     0.0824091     0.112424      0.0800213     0.0173253       34     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0159692     0.0277011     0.0406948     0.0261708    0.00583585       34     
produce:emtrkmichelid:EmTrackMichelId                   11.7134       19.9906       27.9781       19.8748       4.15638        34     
[art]:TriggerResults:TriggerResultInserter             1.465e-05    2.24339e-05    6.996e-05     2.01e-05     9.76737e-06      35     
end_path:out1:RootOutput                               8.15e-06     1.19988e-05    2.301e-05     1.043e-05    3.97611e-06      35     
end_path:michelremoving:michelremoving                 1.538e-05     0.0442812      0.18396      0.0194766     0.0479686       35     
end_path:michelremovinggnocchi:michelremoving          5.19e-06      0.0427757     0.180368      0.0180276     0.0478577       35     
end_path:calibanagnocchi:CalibAnaTree                   4.5e-06      0.394748       0.89383       0.37112      0.177415        35     
end_path:out1:RootOutput(write)                        0.349618      0.562546      0.814714      0.535872      0.123714        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5053.17 MB
  Peak resident set size usage (VmHWM): 2689.02 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027304_0007_dataflow3_datawriter_0_20240619T165115_reco_stage1_reco_stage2_20241017T115008_keepup.root
\tHists: np04hd_raw_run027304_0007_dataflow3_datawriter_0_20240619T165115_reco_stage1_reco_stage2_20241017T115008_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027304_0007_dataflow3_datawriter_0_20240619T165115_reco_stage1_reco_stage2_20241017T115008_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027304_0007_dataflow3_datawriter_0_20240619T165115_reco_stage1_reco_stage2_20241017T115008_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1729163426.0,
    "core.end_time": 1729165809.0,
    "core.events": [
      983,
      987,
      991,
      995,
      999,
      1003,
      1007,
      1011,
      1015,
      1019,
      1023,
      1027,
      1031,
      1035,
      1039,
      1043,
      1047,
      1051,
      1055,
      1059,
      1063,
      1067,
      1071,
      1075,
      1079,
      1083,
      1087,
      1091,
      1095,
      1099,
      1103,
      1107,
      1111,
      1115,
      1119
    ],
    "core.event_count": 35,
    "core.first_event_number": 983,
    "core.last_event_number": 1119,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27304
    ],
    "core.runs_subruns": [
      2730400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027304_0007_dataflow3_datawriter_0_20240619T165115.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027304_0007_dataflow3_datawriter_0_20240619T165115_reco_stage1_reco_stage2_20241017T115008_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1729163426.0,
    "core.end_time": 1729165809.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27304
    ],
    "core.runs_subruns": [
      2730400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027304_0007_dataflow3_datawriter_0_20240619T165115.hdf5"
    }
  ]
}
justIN time: 2024-11-24 03:49:08 UTC       justIN version: 01.01.09