justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 80354.2@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID80354.2@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3511
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 17:45:22
SiteUS_UCSD
EntryCMSHTPC_T2_US_UCSD_gw6
Last heartbeat2024-09-27 19:37:39
From worker nodeHostnamemh-7662-14.t2.ucsd.edu
cpuinfoAMD EPYC 7662 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 17:56:46
Input fileshd-protodune:np04hd_raw_run027332_0398_dataflow1_datawriter_0_20240621T004956.hdf5
JobscriptExit code0
Real time1h (5972s)
CPU time1h (4714s = 78%)
Outputting started2024-09-27 19:36:19
Output fileshd-protodune-det-reco:np04hd_raw_run027332_0398_dataflow1_datawriter_0_20240621T004956_reco_stage1_reco_stage2_20240927T193611_keepup.root
hd-protodune-det-reco:np04hd_raw_run027332_0398_dataflow1_datawriter_0_20240621T004956_reco_stage1_reco_stage2_20240927T193611_keepup_hists.root
Finished2024-09-27 19:37:39
Saved logsjustin-logs:80354.2-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

these numbers
----view 0: 0 0 0 0 0 0 0 0 0 0 0 
----view 1: 2.48551e-05 2.49147e-05 0.000310659 0.000395775 0.00030309 0.00119394 0.000150502 0.000500977 0.00110555 0.000141799 0.000141859 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0 0 0 0 0 0 0 0 0 0 0 
----view 1: 2.49147e-05 0.000310659 0.000395775 0.00030309 0.00119394 0.000150502 0.000500977 0.00110555 0.000141799 0.000141859 0.000435889 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0 0 0 0 0 0 0 0 0 0 0 
----view 1: 0.000310659 0.000395775 0.00030309 0.00119394 0.000150502 0.000500977 0.00110555 0.000141799 0.000141859 0.000435889 0.000809133 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0 0 0 0 0 0 0 0 0 0 0 
----view 1: 0.000395775 0.00030309 0.00119394 0.000150502 0.000500977 0.00110555 0.000141799 0.000141859 0.000435889 0.000809133 0.000513136 
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 12:36:11 PDT  Closed output file "np04hd_raw_run027332_0398_dataflow1_datawriter_0_20240621T004956_reco_stage1_reco_stage2_20240927T193611_keepup.root"
27-Sep-2024 12:36:11 PDT  Closed input file "np04hd_raw_run027332_0398_dataflow1_datawriter_0_20240621T004956_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              70.3467       114.674       184.665       107.222       30.5225        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000470831   0.00214792    0.00457641    0.00150321    0.00139907       35     
produce:fembfilter:PDHDFEMBFilter                      0.591547      0.624324      0.707056      0.619324      0.024394        35     
produce:wclsdatahd:WireCellToolkit                      29.3017       31.4428       34.0239       31.3692       1.33083        35     
produce:gaushit:GausHitFinder                           0.54436      0.861213       1.31144      0.825935      0.177561        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000285677   0.000427965   0.000566024   0.00041467    7.00435e-05      35     
produce:reco3d:SpacePointSolver                         0.49924       1.53065       4.2967        1.33133      0.868045        35     
produce:hitpdune:DisambigFromSpacePoints               0.324358      0.791503       1.92078      0.727228      0.342684        35     
produce:pandora:StandardPandora                         9.41393       35.8797       83.0323       31.2311       18.4873        35     
produce:pandoraWriter:StandardPandora                  0.108898       0.1875       0.301283      0.189082      0.041803        35     
produce:pandoraTrack:LArPandoraTrackCreation            1.02307       2.27233       5.47296       1.95221       1.05799        35     
produce:pandoraShower:LArPandoraShowerCreation         0.891942       2.32416       7.06926       1.96249       1.26335        35     
produce:pandoracalo:Calorimetry                         0.4871         1.043        2.54332      0.939877      0.461897        35     
produce:pandoracalonosce:Calorimetry                   0.455111      0.962935       2.14453      0.837342      0.413398        35     
produce:pandorapid:Chi2ParticleID                     0.00141122    0.00226251    0.00362343    0.00222227    0.00047016       35     
produce:pandoraShowercalo:ShowerCalorimetry            0.816709       2.00716       5.73692       1.68523       1.05421        35     
produce:pandoraShowercalonosce:ShowerCalorimetry        0.77081       1.91506       5.44822       1.52353       1.01342        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0817581     0.140989      0.227368      0.137771      0.0331932       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0277793     0.0484241     0.0782082     0.047898      0.0112868       35     
produce:emtrkmichelid:EmTrackMichelId                   19.826        30.5872       48.5442       30.2091       6.30688        35     
[art]:TriggerResults:TriggerResultInserter             1.874e-05    3.18471e-05   0.000206555    2.328e-05    3.31094e-05      35     
end_path:out1:RootOutput                               7.411e-06    8.67734e-06   2.2451e-05     8.23e-06     2.41792e-06      35     
end_path:michelremoving:michelremoving                 0.0181848     0.0656616       0.301       0.0297812     0.073211        35     
end_path:michelremovinggnocchi:michelremoving          0.0174953     0.0633888     0.293108      0.0270833     0.0726743       35     
end_path:calibanagnocchi:CalibAnaTree                  0.367044      0.805069       1.72775      0.719229      0.342791        35     
end_path:out1:RootOutput(write)                        0.599225      0.979231       1.56783      0.963093      0.213461        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5127.38 MB
  Peak resident set size usage (VmHWM): 2738.71 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027332_0398_dataflow1_datawriter_0_20240621T004956_reco_stage1_reco_stage2_20240927T193611_keepup.root
\tHists: np04hd_raw_run027332_0398_dataflow1_datawriter_0_20240621T004956_reco_stage1_reco_stage2_20240927T193611_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027332_0398_dataflow1_datawriter_0_20240621T004956_reco_stage1_reco_stage2_20240927T193611_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027332_0398_dataflow1_datawriter_0_20240621T004956_reco_stage1_reco_stage2_20240927T193611_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727461721.0,
    "core.end_time": 1727465771.0,
    "core.events": [
      55721,
      55725,
      55729,
      55733,
      55737,
      55741,
      55745,
      55749,
      55753,
      55757,
      55761,
      55765,
      55769,
      55773,
      55777,
      55781,
      55785,
      55789,
      55793,
      55797,
      55801,
      55805,
      55809,
      55813,
      55817,
      55821,
      55825,
      55829,
      55833,
      55837,
      55841,
      55845,
      55849,
      55853,
      55857
    ],
    "core.event_count": 35,
    "core.first_event_number": 55721,
    "core.last_event_number": 55857,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27332
    ],
    "core.runs_subruns": [
      2733200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027332_0398_dataflow1_datawriter_0_20240621T004956.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027332_0398_dataflow1_datawriter_0_20240621T004956_reco_stage1_reco_stage2_20240927T193611_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727461721.0,
    "core.end_time": 1727465771.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27332
    ],
    "core.runs_subruns": [
      2733200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027332_0398_dataflow1_datawriter_0_20240621T004956.hdf5"
    }
  ]
}
justIN time: 2024-11-17 03:15:44 UTC       justIN version: 01.01.09