justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 277785.0@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID277785.0@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3717
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-20 13:22:19
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce503
Last heartbeat2024-10-21 16:44:48
From worker nodeHostnameb9p06p1159.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-20 13:25:33
Input fileshd-protodune:np04hd_raw_run031107_0029_dataflow0_datawriter_0_20241018T173545.hdf5
JobscriptExit code0
Real time1d (98281s)
CPU time1d (96352s = 98%)
Outputting started2024-10-21 16:43:35
Output fileshd-protodune-det-reco:np04hd_raw_run031107_0029_dataflow0_datawriter_0_20241018T173545_reco_stage1_reco_stage2_20241021T164324_keepup.root
hd-protodune-det-reco:np04hd_raw_run031107_0029_dataflow0_datawriter_0_20241018T173545_reco_stage1_reco_stage2_20241021T164324_keepup_hists.root
Finished2024-10-21 16:44:48
Saved logsjustin-logs:277785.0-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

1124 0.0024026 0.00668246 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 3.51667e-05 3.51667e-05 3.51667e-05 3.51667e-05 3.51071e-05 3.51667e-05 3.51667e-05 3.51667e-05 3.51667e-05 3.51071e-05 3.51667e-05 
----view 1: 0.00396454 0.00338596 0.00364506 0.00498492 0.00461668 0.00446028 0.00610393 0.0181124 0.0024026 0.00668246 0.00506634 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 3.51667e-05 3.51667e-05 3.51667e-05 3.51071e-05 3.51667e-05 3.51667e-05 3.51667e-05 3.51667e-05 3.51071e-05 3.51667e-05 3.51667e-05 
----view 1: 0.00338596 0.00364506 0.00498492 0.00461668 0.00446028 0.00610393 0.0181124 0.0024026 0.00668246 0.00506634 0.00675064 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 3.51667e-05 3.51667e-05 3.51071e-05 3.51667e-05 3.51667e-05 3.51667e-05 3.51667e-05 3.51071e-05 3.51667e-05 3.51667e-05 3.51667e-05 
----view 1: 0.00364506 0.00498492 0.00461668 0.00446028 0.00610393 0.0181124 0.0024026 0.00668246 0.00506634 0.00675064 0.00376779 
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

21-Oct-2024 18:43:24 CEST  Closed output file "np04hd_raw_run031107_0029_dataflow0_datawriter_0_20241018T173545_reco_stage1_reco_stage2_20241021T164324_keepup.root"
21-Oct-2024 18:43:24 CEST  Closed input file "np04hd_raw_run031107_0029_dataflow0_datawriter_0_20241018T173545_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              76.8215       4820.6         92623        181.254       20143.7        20     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000374053    0.0026493    0.00642332    0.00263098     0.0016894       20     
produce:fembfilter:PDHDFEMBFilter                      0.829025       1.0342        1.36356      0.991395      0.150384        20     
produce:wclsdatahd:WireCellToolkit                      71.6384       78.6395       85.6554       78.686        3.42104        20     
produce:gaushit:GausHitFinder                          0.540391      0.987938       2.85215      0.938267      0.482423        20     
produce:nhitsfilter:NumberOfHitsFilter                0.000282803   0.000504597   0.00178867    0.000426188   0.00032185       20     
[art]:TriggerResults:TriggerResultInserter             1.83e-05     4.3229e-05    7.9031e-05    3.9716e-05    1.67888e-05      20     
end_path:out1:RootOutput                               7.92e-06     1.3016e-05     2.991e-05    1.0225e-05    6.08816e-06      20     
end_path:michelremoving:michelremoving                 2.442e-05     0.130354       1.04792      0.0477918     0.233649        20     
end_path:michelremovinggnocchi:michelremoving          9.39e-06      0.117707       1.00467      0.0402827     0.221783        20     
end_path:calibanagnocchi:CalibAnaTree                  9.05e-06      0.967856       2.31887       1.05814      0.709904        20     
end_path:out1:RootOutput(write)                        0.264886      0.983569       2.28743      0.958751       0.45268        20     
produce:reco3d:SpacePointSolver                         1.98211       34.5117       306.744       6.57254       74.5534        15     
produce:hitpdune:DisambigFromSpacePoints               0.735692       1.83731       3.68917       1.75581      0.819728        15     
produce:pandora:StandardPandora                         19.5328       6221.42       92152.5       43.7987       22966.4        15     
produce:pandoraWriter:StandardPandora                  0.225659      0.281837      0.549738      0.248461      0.083476        15     
produce:pandoraTrack:LArPandoraTrackCreation            1.96701       3.17076       5.57706       2.83529      0.941683        15     
produce:pandoraShower:LArPandoraShowerCreation          2.09283       4.09259       7.23178       3.85031       1.38548        15     
produce:pandoracalo:Calorimetry                        0.799453       1.59183       3.13804       1.4385       0.619283        15     
produce:pandoracalonosce:Calorimetry                   0.814786       1.47158       3.16262       1.44837      0.585568        15     
produce:pandorapid:Chi2ParticleID                     0.00166023    0.00222469    0.00410257    0.00212597    0.000552564      15     
produce:pandoraShowercalo:ShowerCalorimetry             1.43311       3.39063       6.11765       3.43775       1.19383        15     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.40772       3.37077       6.20719       3.31529       1.24497        15     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0935957     0.138073      0.288432      0.112179      0.0531594       15     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0363056     0.0505012     0.107824      0.0455786     0.0169134       15     
produce:emtrkmichelid:EmTrackMichelId                   26.7149       41.2939       58.0673       40.0439       9.77944        15     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 6596.86 MB
  Peak resident set size usage (VmHWM): 4191.97 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run031107_0029_dataflow0_datawriter_0_20241018T173545_reco_stage1_reco_stage2_20241021T164324_keepup.root
\tHists: np04hd_raw_run031107_0029_dataflow0_datawriter_0_20241018T173545_reco_stage1_reco_stage2_20241021T164324_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run031107_0029_dataflow0_datawriter_0_20241018T173545_reco_stage1_reco_stage2_20241021T164324_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run031107_0029_dataflow0_datawriter_0_20241018T173545_reco_stage1_reco_stage2_20241021T164324_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1729432556.0,
    "core.end_time": 1729529005.0,
    "core.events": [
      1152,
      1156,
      1158,
      1160,
      1162,
      1164,
      1166,
      1168,
      1170,
      1172,
      1174,
      1176,
      1178,
      1180,
      1182,
      1184,
      1186,
      1188,
      1190,
      1192
    ],
    "core.event_count": 20,
    "core.first_event_number": 1152,
    "core.last_event_number": 1192,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      31107
    ],
    "core.runs_subruns": [
      3110700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run031107_0029_dataflow0_datawriter_0_20241018T173545.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run031107_0029_dataflow0_datawriter_0_20241018T173545_reco_stage1_reco_stage2_20241021T164324_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1729432556.0,
    "core.end_time": 1729529005.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      31107
    ],
    "core.runs_subruns": [
      3110700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run031107_0029_dataflow0_datawriter_0_20241018T173545.hdf5"
    }
  ]
}
justIN time: 2024-11-24 01:33:35 UTC       justIN version: 01.01.09