justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 265189.15@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID265189.15@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3517
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 17:37:10
SiteUS_UCSD
EntryCMSHTPC_T2_US_UCSD_gw6
Last heartbeat2024-09-27 19:25:29
From worker nodeHostnamemh-7763-7.t2.ucsd.edu
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 17:38:52
Input fileshd-protodune:np04hd_raw_run027398_0184_dataflow0_datawriter_0_20240624T005854.hdf5
JobscriptExit code0
Real time1h (6300s)
CPU time50m (3049s = 48%)
Outputting started2024-09-27 19:23:54
Output fileshd-protodune-det-reco:np04hd_raw_run027398_0184_dataflow0_datawriter_0_20240624T005854_reco_stage1_reco_stage2_20240927T192346_keepup.root
hd-protodune-det-reco:np04hd_raw_run027398_0184_dataflow0_datawriter_0_20240624T005854_reco_stage1_reco_stage2_20240927T192346_keepup_hists.root
Finished2024-09-27 19:25:29
Saved logsjustin-logs:265189.15-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

n TPC 5
4334 hits in TPC 6
1871 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 25 XUs and 50 XVs -> 0 XUVs
C:0 T:1 5971 XUs and 4643 XVs -> 577 XUVs
C:0 T:2 13437 XUs and 19241 XVs -> 627 XUVs
C:0 T:3 930 XUs and 1154 XVs -> 20 XUVs
C:0 T:4 3091 XUs and 4134 XVs -> 342 XUVs
C:0 T:5 36820 XUs and 32876 XVs -> 648 XUVs
C:0 T:6 18687 XUs and 28851 XVs -> 1186 XUVs
C:0 T:7 33 XUs and 38 XVs -> 6 XUVs
3406 XUVs total
1430 collection wire objects
3406 potential space points
Neighbour search...
128112 tests to find 70978 neighbours
Iterating with no regularization...
Begin: 2.41009e+07
0 2.22083e+07
1 2.20733e+07
2 2.20551e+07
Now with regularization...
Begin: 2.11387e+07
0 2.11321e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 12:23:46 PDT  Closed output file "np04hd_raw_run027398_0184_dataflow0_datawriter_0_20240624T005854_reco_stage1_reco_stage2_20240927T192346_keepup.root"
27-Sep-2024 12:23:46 PDT  Closed input file "np04hd_raw_run027398_0184_dataflow0_datawriter_0_20240624T005854_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              51.537        68.5332       101.254       68.3714       10.6154        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000306668   0.00153269    0.00388872    0.00164645    0.000833478      35     
produce:fembfilter:PDHDFEMBFilter                       0.49183      0.516348      0.566687      0.515282      0.0144337       35     
produce:wclsdatahd:WireCellToolkit                      25.1648       26.5018       27.7058       26.4992      0.679867        35     
produce:gaushit:GausHitFinder                          0.304977      0.528605      0.867711      0.524423      0.116123        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000183559   0.000266934   0.000463747   0.000262519   4.8222e-05       35     
produce:reco3d:SpacePointSolver                        0.278704      0.720437       1.43268      0.639403      0.348026        35     
produce:hitpdune:DisambigFromSpacePoints                0.15104      0.437701       1.06898      0.397203      0.177525        35     
produce:pandora:StandardPandora                         5.6096        11.8872       24.9909       10.577        4.72583        35     
produce:pandoraWriter:StandardPandora                  0.0634435     0.106863      0.171524      0.106538      0.0209407       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.463305      0.939069       1.62584      0.921312       0.26789        35     
produce:pandoraShower:LArPandoraShowerCreation         0.441217       1.12005       2.43488       1.07158      0.418057        35     
produce:pandoracalo:Calorimetry                        0.251574      0.513624      0.894778       0.51194      0.137454        35     
produce:pandoracalonosce:Calorimetry                   0.227317      0.473411      0.840795      0.479058      0.128611        35     
produce:pandorapid:Chi2ParticleID                     0.000902714   0.00144465    0.00318314     0.0014288    0.00036819       35     
produce:pandoraShowercalo:ShowerCalorimetry            0.377985       1.09852       2.65598       1.08441      0.429414        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.365427       1.05311        2.531        1.04137      0.411791        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0589607     0.0928392     0.126275      0.0954811     0.0182421       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0205436     0.0317216     0.0425297     0.0323327    0.00562377       35     
produce:emtrkmichelid:EmTrackMichelId                   14.1169       21.2979       32.5163       21.0689       3.81553        35     
[art]:TriggerResults:TriggerResultInserter             1.455e-05    2.62867e-05    8.344e-05     2.226e-05    1.3025e-05       35     
end_path:out1:RootOutput                               3.69e-06     7.69106e-06    2.767e-05     7.01e-06     5.59946e-06      35     
end_path:michelremoving:michelremoving                  0.01114      0.0637196     0.208255      0.0245668     0.058653        35     
end_path:michelremovinggnocchi:michelremoving          0.0118864     0.0614847     0.204106      0.0221703     0.0580697       35     
end_path:calibanagnocchi:CalibAnaTree                  0.218115      0.388708      0.683384      0.376254      0.104407        35     
end_path:out1:RootOutput(write)                        0.371611      0.609028      0.918132       0.60094      0.120565        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5036.88 MB
  Peak resident set size usage (VmHWM): 2679.23 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027398_0184_dataflow0_datawriter_0_20240624T005854_reco_stage1_reco_stage2_20240927T192346_keepup.root
\tHists: np04hd_raw_run027398_0184_dataflow0_datawriter_0_20240624T005854_reco_stage1_reco_stage2_20240927T192346_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027398_0184_dataflow0_datawriter_0_20240624T005854_reco_stage1_reco_stage2_20240927T192346_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027398_0184_dataflow0_datawriter_0_20240624T005854_reco_stage1_reco_stage2_20240927T192346_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727462600.0,
    "core.end_time": 1727465027.0,
    "core.events": [
      25764,
      25768,
      25772,
      25776,
      25780,
      25784,
      25788,
      25792,
      25796,
      25800,
      25804,
      25808,
      25812,
      25816,
      25820,
      25824,
      25828,
      25832,
      25836,
      25840,
      25844,
      25848,
      25852,
      25856,
      25860,
      25864,
      25868,
      25872,
      25876,
      25880,
      25884,
      25888,
      25892,
      25896,
      25900
    ],
    "core.event_count": 35,
    "core.first_event_number": 25764,
    "core.last_event_number": 25900,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27398
    ],
    "core.runs_subruns": [
      2739800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027398_0184_dataflow0_datawriter_0_20240624T005854.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027398_0184_dataflow0_datawriter_0_20240624T005854_reco_stage1_reco_stage2_20240927T192346_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727462600.0,
    "core.end_time": 1727465027.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27398
    ],
    "core.runs_subruns": [
      2739800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027398_0184_dataflow0_datawriter_0_20240624T005854.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:24:02 UTC       justIN version: 01.01.08