justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264713.77@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID264713.77@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3515
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 07:00:33
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2024-09-27 12:20:16
From worker nodeHostnamedunegli-35088-0-cmswn2324.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 08:08:32
Input fileshd-protodune:np04hd_raw_run027385_0539_dataflow2_datawriter_0_20240622T173608.hdf5
JobscriptExit code0
Real time4h (15055s)
CPU time1h (5648s = 37%)
Outputting started2024-09-27 12:19:28
Output fileshd-protodune-det-reco:np04hd_raw_run027385_0539_dataflow2_datawriter_0_20240622T173608_reco_stage1_reco_stage2_20240927T121918_keepup.root
hd-protodune-det-reco:np04hd_raw_run027385_0539_dataflow2_datawriter_0_20240622T173608_reco_stage1_reco_stage2_20240927T121918_keepup_hists.root
Finished2024-09-27 12:20:16
Saved logsjustin-logs:264713.77-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

05 2.37292e-05 2.37301e-05 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.00216459 8.0226e-05 8.02223e-05 8.0226e-05 8.02223e-05 8.0226e-05 8.02241e-05 0.000507063 1.83233e-05 1.83238e-05 1.83238e-05 
----view 1: 2.37292e-05 2.37301e-05 2.37292e-05 2.37301e-05 2.37292e-05 2.37301e-05 2.37301e-05 2.37301e-05 2.37292e-05 2.37301e-05 2.37301e-05 
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  5   event 75690 TrkackID 1 startx, y, z 52.708 593.719 156.237  wireno, peakt tpcno 350 1263.18 5 dist 0min T, max_T1010.94 2847.36
no of hits closeby  0   event 75690 TrkackID 20 startx, y, z 14.9799 595.208 102.842  wireno, peakt tpcno 214 863 2 dist 198.113min T, max_T5.14579 886.396
no of hits closeby  5   event 75690 TrkackID 1 startx, y, z 52.708 593.719 156.237  wireno, peakt tpcno 350 1263.18 5 dist 0min T, max_T1010.94 2847.36
no of hits closeby  0   event 75690 TrkackID 20 startx, y, z 14.9799 595.208 102.842  wireno, peakt tpcno 214 863 2 dist 198.113min T, max_T5.14579 886.396
27-Sep-2024 12:19:18 UTC  Closed output file "np04hd_raw_run027385_0539_dataflow2_datawriter_0_20240622T173608_reco_stage1_reco_stage2_20240927T121918_keepup.root"
27-Sep-2024 12:19:18 UTC  Closed input file "np04hd_raw_run027385_0539_dataflow2_datawriter_0_20240622T173608_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              86.3354       131.587       183.054       126.798       26.1115        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000365198   0.00264742    0.00513909    0.00285462    0.00130118       35     
produce:fembfilter:PDHDFEMBFilter                       0.83419       1.18601       1.97362       1.09596      0.276521        35     
produce:wclsdatahd:WireCellToolkit                      45.1193       58.1874       69.867        60.6255       7.09349        35     
produce:gaushit:GausHitFinder                          0.505708      0.968977       1.43483      0.936214      0.214914        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000222672   0.000401096   0.000583996   0.000398767   8.97536e-05      35     
produce:reco3d:SpacePointSolver                        0.248347       1.07468       2.12536      0.972957      0.576121        35     
produce:hitpdune:DisambigFromSpacePoints               0.181473      0.838516       1.8913       0.717496      0.419969        35     
produce:pandora:StandardPandora                         7.82358       22.7778       57.9313       19.8475       10.6325        35     
produce:pandoraWriter:StandardPandora                  0.101208      0.176286      0.276002      0.170778      0.0416972       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.688739       2.2701        4.65214       2.00881      0.937152        35     
produce:pandoraShower:LArPandoraShowerCreation         0.545283       2.64978       6.62526       2.09225       1.39405        35     
produce:pandoracalo:Calorimetry                        0.324253       1.08243       2.13878       0.97374      0.418387        35     
produce:pandoracalonosce:Calorimetry                   0.296358      0.997351       2.01962      0.907085      0.383864        35     
produce:pandorapid:Chi2ParticleID                     0.00162405    0.00230156    0.00353369    0.00225728    0.000475371      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.473303       2.39752       6.81806       2.04516       1.22278        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.467171       2.30334       6.53855       1.95967       1.18682        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.061525      0.152951      0.246006      0.152276      0.0383343       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0238503     0.0525406     0.080246      0.0521272     0.0120772       35     
produce:emtrkmichelid:EmTrackMichelId                   16.8602       32.3683        46.52        31.2774       7.38248        35     
[art]:TriggerResults:TriggerResultInserter            2.5951e-05    4.35375e-05   7.9046e-05    4.2245e-05    1.15848e-05      35     
end_path:out1:RootOutput                               7.58e-06     1.16723e-05   2.4198e-05    1.0083e-05    4.10676e-06      35     
end_path:michelremoving:michelremoving                 0.0225236     0.121065      0.453742      0.0552325     0.118695        35     
end_path:michelremovinggnocchi:michelremoving          0.018098      0.112628      0.379285      0.0463099     0.112855        35     
end_path:calibanagnocchi:CalibAnaTree                   0.23797       0.82736       1.53509      0.764836      0.326035        35     
end_path:out1:RootOutput(write)                        0.456038      0.919386       1.3802       0.912616      0.202292        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5038.65 MB
  Peak resident set size usage (VmHWM): 2685.86 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027385_0539_dataflow2_datawriter_0_20240622T173608_reco_stage1_reco_stage2_20240927T121918_keepup.root
\tHists: np04hd_raw_run027385_0539_dataflow2_datawriter_0_20240622T173608_reco_stage1_reco_stage2_20240927T121918_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027385_0539_dataflow2_datawriter_0_20240622T173608_reco_stage1_reco_stage2_20240927T121918_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027385_0539_dataflow2_datawriter_0_20240622T173608_reco_stage1_reco_stage2_20240927T121918_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727434904.0,
    "core.end_time": 1727439560.0,
    "core.events": [
      75554,
      75558,
      75562,
      75566,
      75570,
      75574,
      75578,
      75582,
      75586,
      75590,
      75594,
      75598,
      75602,
      75606,
      75610,
      75614,
      75618,
      75622,
      75626,
      75630,
      75634,
      75638,
      75642,
      75646,
      75650,
      75654,
      75658,
      75662,
      75666,
      75670,
      75674,
      75678,
      75682,
      75686,
      75690
    ],
    "core.event_count": 35,
    "core.first_event_number": 75554,
    "core.last_event_number": 75690,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27385
    ],
    "core.runs_subruns": [
      2738500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027385_0539_dataflow2_datawriter_0_20240622T173608.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027385_0539_dataflow2_datawriter_0_20240622T173608_reco_stage1_reco_stage2_20240927T121918_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727434904.0,
    "core.end_time": 1727439560.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27385
    ],
    "core.runs_subruns": [
      2738500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027385_0539_dataflow2_datawriter_0_20240622T173608.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:32:06 UTC       justIN version: 01.01.08