justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 78440.29@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID78440.29@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3447
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 09:39:18
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce03
Last heartbeat2024-09-26 11:03:35
From worker nodeHostnameccwcondor0699.in2p3.fr
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit106200 (29 hours)
Inner Apptainer?True
Job statejobscript_error
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 09:52:04
Input fileshd-protodune:np04hd_raw_run029092_0421_dataflow1_datawriter_0_20240906T000543.hdf5
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Outputting started 
Output files
Finished2024-09-26 11:03:35
Saved logsjustin-logs:78440.29-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

03e+06
0 5.92215e+06
1 5.88703e+06
2 5.88236e+06
Now with regularization...
Begin: 5.697e+06
0 5.69466e+06
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0 0 0 0 0 0 0 0 0 0 0 
----view 1: 0.00310159 0.000288486 0.000288725 0.000288248 0.000288486 0.000288486 0.000288248 0.000288486 0.000288725 0.000288248 0.000288486 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0 0 0 0 0 0 0 0 0 0 0 
----view 1: 0.000288486 0.000288725 0.000288248 0.000288486 0.000288486 0.000288248 0.000288486 0.000288725 0.000288248 0.000288486 0.000288486 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0 0 0 0 0 0 0 0 0 0 0 
----view 1: 0.000288725 0.000288248 0.000288486 0.000288486 0.000288248 0.000288486 0.000288725 0.000288248 0.000288486 0.000288486 0.000288248 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0 0 0 0 0 0 0 0 0 0 0 
----view 1: 0.000288248 0.000288486 0.000288486 0.000288248 0.000288486 0.000288725 0.000288248 0.000288486 0.000288486 0.000288248 0.00356126 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0 0 0 0 0 0 0 0 0 0 0 
----view 1: 0.000288486 0.000288486 0.000288248 0.000288486 0.000288725 0.000288248 0.000288486 0.000288486 0.000288248 0.00356126 0.00786591 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0 0 0 0 0 0 0 0 0 0 0 
----view 1: 0.000288486 0.000288248 0.000288486 0.000288725 0.000288248 0.000288486 0.000288486 0.000288248 0.00356126 0.00786591 0.00666046 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0 0 0 0 0 0 0 0 0 0 0 
----view 1: 0.000288248 0.000288486 0.000288725 0.000288248 0.000288486 0.000288486 0.000288248 0.00356126 0.00786591 0.00666046 0.00392342 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0 0 0 0 0 0 0 0 0 0 0 
----view 1: 0.000288486 0.000288725 0.000288248 0.000288486 0.000288486 0.000288248 0.00356126 0.00786591 0.00666046 0.00392342 0.00106096 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.00028944 0.00028944 0.00028944 0.00028944 0.00028944 0.000289679 0.00028944 0.00028944 0.00028944 0.00028944 0.000289917 
----view 1: 0.00192022 0.00405121 0.00466347 0.00366974 0.00762367 0.00881195 0.0144272 0.0804443 0.0956116 0.0866394 0.0520782 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.00028944 0.00028944 0.00028944 0.00028944 0.000289679 0.00028944 0.00028944 0.00028944 0.00028944 0.000289917 0.00028944 
----view 1: 0.00405121 0.00466347 0.00366974 0.00762367 0.00881195 0.0144272 0.0804443 0.0956116 0.0866394 0.0520782 0.0321808 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.00028944 0.00028944 0.00028944 0.000289679 0.00028944 0.00028944 0.00028944 0.00028944 0.000289917 0.00028944 0.00028944 
----view 1: 0.00466347 0.00366974 0.00762367 0.00881195 0.0144272 0.0804443 0.0956116 0.0866394 0.0520782 0.0321808 0.0268555 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.00028944 0.00028944 0.000289679 0.00028944 0.00028944 0.00028944 0.00028944 0.000289917 0.00028944 0.00028944 0.00028944 
----view 1: 0.00366974 0.00762367 0.00881195 0.0144272 0.0804443 0.0956116 0.0866394 0.0520782 0.0321808 0.0268555 0.0199509 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.00028944 0.000289679 0.00028944 0.00028944 0.00028944 0.00028944 0.000289917 0.00028944 0.00028944 0.00028944 0.00028944 
----view 1: 0.00762367 0.00881195 0.0144272 0.0804443 0.0956116 0.0866394 0.0520782 0.0321808 0.0268555 0.0199509 0.00704956 
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

26-Sep-2024 12:54:16 CEST  Closed output file "np04hd_raw_run029092_0421_dataflow1_datawriter_0_20240906T000543_reco_stage1_reco_stage2_20240926T105416_keepup.root"
26-Sep-2024 12:54:16 CEST  Closed input file "np04hd_raw_run029092_0421_dataflow1_datawriter_0_20240906T000543_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              68.7845       85.4702       110.982       85.394        11.7488        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000522105   0.00236286    0.00435353    0.00221961    0.00102873       30     
produce:fembfilter:PDHDFEMBFilter                      0.539432      0.660514      0.840985      0.639095      0.0871612       30     
produce:wclsdatahd:WireCellToolkit                      36.1551       40.4184       47.3043       40.5859       2.50558        30     
produce:gaushit:GausHitFinder                           0.34351      0.557548      0.837005      0.544341      0.115524        30     
produce:nhitsfilter:NumberOfHitsFilter                0.00024881    0.000376526   0.000628777   0.000360486   8.59049e-05      30     
produce:reco3d:SpacePointSolver                        0.150994      0.753061       2.48973       0.59504      0.568644        30     
produce:hitpdune:DisambigFromSpacePoints               0.136248      0.404596      0.836197      0.445811       0.16917        30     
produce:pandora:StandardPandora                         4.67947       9.5091        17.5156       8.80338       3.39019        30     
produce:pandoraWriter:StandardPandora                  0.0678955     0.136184      0.216056      0.127416      0.0396696       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.340978      0.997497       1.90223      0.924487       0.40076        30     
produce:pandoraShower:LArPandoraShowerCreation          0.40054       1.13957       2.18001       1.13919      0.403096        30     
produce:pandoracalo:Calorimetry                        0.215372      0.502015       0.84479      0.492577      0.162334        30     
produce:pandoracalonosce:Calorimetry                   0.189854      0.448075      0.832349      0.423395      0.157314        30     
produce:pandorapid:Chi2ParticleID                     0.00102766     0.0017321    0.00426688    0.00145988    0.00070066       30     
produce:pandoraShowercalo:ShowerCalorimetry            0.344973       1.04587       2.07061       1.02759      0.398564        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.353965      0.970687       1.74908      0.922376      0.335396        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0676397     0.123665       0.20964      0.116082      0.0342145       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0222236     0.0456813     0.0793125     0.0393693     0.015211        30     
produce:emtrkmichelid:EmTrackMichelId                   17.9739       26.3119       38.7949       25.9041       5.24607        30     
[art]:TriggerResults:TriggerResultInserter            1.8996e-05    4.12132e-05   0.000103887   3.66845e-05   1.87585e-05      30     
end_path:out1:RootOutput                               8.346e-06    1.08479e-05   3.3222e-05    9.7235e-06    4.31201e-06      30     
end_path:michelremoving:michelremoving                 0.0151454     0.0541211     0.175512      0.0345977     0.0477264       30     
end_path:michelremovinggnocchi:michelremoving          0.0123464     0.0490309     0.177397      0.028678      0.0471687       30     
end_path:calibanagnocchi:CalibAnaTree                  0.138127      0.397833      0.660845      0.415086      0.141979        30     
end_path:out1:RootOutput(write)                        0.425147      0.741068       1.09164      0.731489      0.160587        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4919.39 MB
  Peak resident set size usage (VmHWM): 2342.96 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029092_0421_dataflow1_datawriter_0_20240906T000543_reco_stage1_reco_stage2_20240926T105416_keepup.root
\tHists: np04hd_raw_run029092_0421_dataflow1_datawriter_0_20240906T000543_reco_stage1_reco_stage2_20240926T105416_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
justIN time: 2024-11-17 03:15:21 UTC       justIN version: 01.01.09