justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 263294.135@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID263294.135@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3452
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 09:58:33
SiteUK_Sheffield
EntryDUNE_UK_Sheffield_lcgce1
Last heartbeat2024-09-26 12:06:05
From worker nodeHostnamewn097.hep
cpuinfoIntel(R) Xeon(R) CPU E5-2698 v4 @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 10:02:47
Input fileshd-protodune:np04hd_raw_run029107_2806_dataflow2_datawriter_0_20240908T142929.hdf5
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Outputting started 
Output files
Finished2024-09-26 12:06:05
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

0905609 0.00913048 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000239968 0.000239849 0.000239849 0.000240505 0.000254154 0.000254035 0.000254035 0.000254035 0.000254154 0.000254035 0.000253975 
----view 1: 0.0156898 0.0159683 0.0378532 0.00981998 0.0367422 0.0222015 0.00484276 0.0103207 0.00905609 0.00913048 0.00506783 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000239849 0.000239849 0.000240505 0.000254154 0.000254035 0.000254035 0.000254035 0.000254154 0.000254035 0.000253975 0.000254035 
----view 1: 0.0159683 0.0378532 0.00981998 0.0367422 0.0222015 0.00484276 0.0103207 0.00905609 0.00913048 0.00506783 0.00669861 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000239849 0.000240505 0.000254154 0.000254035 0.000254035 0.000254035 0.000254154 0.000254035 0.000253975 0.000254035 5.1558e-05 
----view 1: 0.0378532 0.00981998 0.0367422 0.0222015 0.00484276 0.0103207 0.00905609 0.00913048 0.00506783 0.00669861 0.00409985 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000240505 0.000254154 0.000254035 0.000254035 0.000254035 0.000254154 0.000254035 0.000253975 0.000254035 5.1558e-05 4.20809e-05 
----view 1: 0.00981998 0.0367422 0.0222015 0.00484276 0.0103207 0.00905609 0.00913048 0.00506783 0.00669861 0.00409985 0.00313759 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000254154 0.000254035 0.000254035 0.000254035 0.000254154 0.000254035 0.000253975 0.000254035 5.1558e-05 4.20809e-05 4.20809e-05 
----view 1: 0.0367422 0.0222015 0.00484276 0.0103207 0.00905609 0.00913048 0.00506783 0.00669861 0.00409985 0.00313759 0.00305939 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000254035 0.000254035 0.000254035 0.000254154 0.000254035 0.000253975 0.000254035 5.1558e-05 4.20809e-05 4.20809e-05 4.20213e-05 
----view 1: 0.0222015 0.00484276 0.0103207 0.00905609 0.00913048 0.00506783 0.00669861 0.00409985 0.00313759 0.00305939 0.00314569 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000254154 0.000254035 0.000253975 0.000254035 5.1558e-05 4.20809e-05 4.20809e-05 4.20213e-05 4.20809e-05 4.20809e-05 4.20809e-05 
----view 1: 0.00905609 0.00913048 0.00506783 0.00669861 0.00409985 0.00313759 0.00305939 0.00314569 0.00196362 0.00186825 0.00181103 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000254035 0.000253975 0.000254035 5.1558e-05 4.20809e-05 4.20809e-05 4.20213e-05 4.20809e-05 4.20809e-05 4.20809e-05 4.20809e-05 
----view 1: 0.00913048 0.00506783 0.00669861 0.00409985 0.00313759 0.00305939 0.00314569 0.00196362 0.00186825 0.00181103 0.00138235 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000253975 0.000254035 5.1558e-05 4.20809e-05 4.20809e-05 4.20213e-05 4.20809e-05 4.20809e-05 4.20809e-05 4.20809e-05 4.20213e-05 
----view 1: 0.00506783 0.00669861 0.00409985 0.00313759 0.00305939 0.00314569 0.00196362 0.00186825 0.00181103 0.00138235 0.00111532 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000254035 5.1558e-05 4.20809e-05 4.20809e-05 4.20213e-05 4.20809e-05 4.20809e-05 4.20809e-05 4.20809e-05 4.20213e-05 4.20809e-05 
----view 1: 0.00669861 0.00409985 0.00313759 0.00305939 0.00314569 0.00196362 0.00186825 0.00181103 0.00138235 0.00111532 0.00111628 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 5.1558e-05 4.20809e-05 4.20809e-05 4.20213e-05 4.20809e-05 4.20809e-05 4.20809e-05 4.20809e-05 4.20213e-05 4.20809e-05 4.20809e-05 
----view 1: 0.00409985 0.00313759 0.00305939 0.00314569 0.00196362 0.00186825 0.00181103 0.00138235 0.00111532 0.00111628 0.00111532 
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

26-Sep-2024 12:41:30 BST  Closed output file "np04hd_raw_run029107_2806_dataflow2_datawriter_0_20240908T142929_reco_stage1_reco_stage2_20240926T114130_keepup.root"
26-Sep-2024 12:41:30 BST  Closed input file "np04hd_raw_run029107_2806_dataflow2_datawriter_0_20240908T142929_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              83.2798       118.89        191.584       114.598       24.4753        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000568259   0.00228423     0.0038574    0.00226866    0.00105332       30     
produce:fembfilter:PDHDFEMBFilter                      0.712645       0.74641       1.02445      0.727958      0.0562679       30     
produce:wclsdatahd:WireCellToolkit                      48.9314       54.0172       59.4453       53.7983       2.39242        30     
produce:gaushit:GausHitFinder                          0.497585      0.766424       1.3801       0.735712      0.193796        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000266593   0.00044428    0.00068104    0.000426032   0.000105871      30     
produce:reco3d:SpacePointSolver                        0.201696       1.1659        6.73721      0.704739       1.33405        30     
produce:hitpdune:DisambigFromSpacePoints               0.191134      0.634924       2.08762      0.508576      0.386143        30     
produce:pandora:StandardPandora                         6.57507       16.0195       48.5214       13.7225       9.64657        30     
produce:pandoraWriter:StandardPandora                  0.0973654     0.181991       0.2847       0.174918      0.0455832       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.575749       2.1326        4.53352       2.11546       0.97094        30     
produce:pandoraShower:LArPandoraShowerCreation          0.61893       2.57847       6.57041       2.13393       1.42695        30     
produce:pandoracalo:Calorimetry                        0.307488      0.972255       1.85025      0.964152      0.393873        30     
produce:pandoracalonosce:Calorimetry                   0.268518      0.896254       1.74287      0.871293      0.378113        30     
produce:pandorapid:Chi2ParticleID                     0.00121081     0.0019558    0.00346608    0.00192548    0.000460499      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.536672       2.18382       5.46257       1.91178       1.14865        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.517059       2.11284       5.25001       1.94839        1.085         30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.073067       0.14301      0.218116      0.137522      0.0333046       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry      0.02835      0.053468      0.084052      0.052096      0.012413        30     
produce:emtrkmichelid:EmTrackMichelId                   14.8819       32.4557       50.0601       31.5406       7.61827        30     
[art]:TriggerResults:TriggerResultInserter            2.6596e-05    4.33597e-05   8.1235e-05    4.15635e-05   1.16564e-05      30     
end_path:out1:RootOutput                               7.113e-06    1.00726e-05   2.2908e-05     9.03e-06     3.25985e-06      30     
end_path:michelremoving:michelremoving                 0.026736      0.0884708     0.308074      0.0574706     0.0623265       30     
end_path:michelremovinggnocchi:michelremoving          0.0234301     0.081962       0.29911      0.0487235     0.0620775       30     
end_path:calibanagnocchi:CalibAnaTree                  0.216152      0.705992       1.40518      0.662143      0.294108        30     
end_path:out1:RootOutput(write)                        0.502095       0.8034        1.26791      0.771233      0.187161        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4965.13 MB
  Peak resident set size usage (VmHWM): 2373.94 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_2806_dataflow2_datawriter_0_20240908T142929_reco_stage1_reco_stage2_20240926T114130_keepup.root
\tHists: np04hd_raw_run029107_2806_dataflow2_datawriter_0_20240908T142929_reco_stage1_reco_stage2_20240926T114130_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
justIN time: 2024-11-17 06:02:32 UTC       justIN version: 01.01.09