Jobsub ID 78665.85@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 78665.85@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3447 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 11:15:53 |
| Site | IT_CNAF |
| Entry | CMSHTPC_T1_IT_CNAF_condor_ce02 |
| Last heartbeat | 2024-09-26 13:43:15 |
| From worker node | Hostname | wn-205-08-09-02-a.cr.cnaf.infn.it |
| cpuinfo | AMD EPYC 7282 16-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 12:04:14 |
| Input files | hd-protodune:np04hd_raw_run029081_0757_dataflow5_datawriter_0_20240905T045432.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 13:43:15 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
es, 63614 summary
Retagger: tagging trace set: gauss with 48251 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 48251 traces tagged "gauss"
FrameSaver: q=1.06363e+06 n=942561 tag=gauss
wclsFrameSaver: saving 63614 traces tagged "wiener"
FrameSaver: q=1.1531e+06 n=864165 tag=wiener
5218 hits in TPC 0
4456 hits in TPC 1
3240 hits in TPC 2
2206 hits in TPC 3
5257 hits in TPC 4
11886 hits in TPC 5
2136 hits in TPC 6
1839 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1099 XUs and 1272 XVs -> 65 XUVs
C:0 T:2 5726 XUs and 5872 XVs -> 139 XUVs
C:0 T:3 197 XUs and 487 XVs -> 24 XUVs
C:0 T:4 245 XUs and 322 XVs -> 9 XUVs
C:0 T:5 98182 XUs and 105013 XVs -> 5954 XUVs
C:0 T:6 3869 XUs and 3354 XVs -> 171 XUVs
C:0 T:7 7 XUs and 1 XVs -> 0 XUVs
6362 XUVs total
1536 collection wire objects
6362 potential space points
Neighbour search...
836340 tests to find 271884 neighbours
Iterating with no regularization...
Begin: 1.13969e+07
0 8.7993e+06
1 8.59095e+06
2 8.55266e+06
3 8.53841e+06
4 8.53114e+06
Now with regularization...
Begin: 8.16718e+06
0 8.16185e+06
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.00285953 0.0461836 0.005261 0.0141922 0.0195609 0.0560154 0.0298697 0.00149244 0.00064975 0.0059368 0.00114357 0.00784838 0.00374728
----view 1: 0.00128305 0.00133407 0.00140882 0.00141752 0.00143474 0.00141883 0.00137621 0.00137758 0.00138235 0.00137353 0.00131696 0.00130802 0.00118566
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.00285953 0.0461836 0.005261 0.0141922 0.0195609 0.0560154 0.0298697 0.00149244 0.00064975 0.0059368 0.00114357
----view 1: 0.00128305 0.00133407 0.00140882 0.00141752 0.00143474 0.00141883 0.00137621 0.00137758 0.00138235 0.00137353 0.00131696
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.0461836 0.005261 0.0141922 0.0195609 0.0560154 0.0298697 0.00149244 0.00064975 0.0059368 0.00114357 0.00784838
----view 1: 0.00133407 0.00140882 0.00141752 0.00143474 0.00141883 0.00137621 0.00137758 0.00138235 0.00137353 0.00131696 0.00130802
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.005261 0.0141922 0.0195609 0.0560154 0.0298697 0.00149244 0.00064975 0.0059368 0.00114357 0.00784838 0.00374728
----view 1: 0.00140882 0.00141752 0.00143474 0.00141883 0.00137621 0.00137758 0.00138235 0.00137353 0.00131696 0.00130802 0.00118566
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.0038271 0.017745 0.00633013 0.013947 0.0138875 0.0369006 0.0147027 0.00678045 0.00400573 0.0200978 0.00275397 0.0116137 0.0212331
----view 1: 0.00128305 0.00133407 0.00140882 0.00141752 0.00143474 0.00141883 0.00137621 0.00137758 0.00138235 0.00137353 0.00131696 0.00130802 0.00118566
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.0038271 0.017745 0.00633013 0.013947 0.0138875 0.0369006 0.0147027 0.00678045 0.00400573 0.0200978 0.00275397
----view 1: 0.00128305 0.00133407 0.00140882 0.00141752 0.00143474 0.00141883 0.00137621 0.00137758 0.00138235 0.00137353 0.00131696
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.017745 0.00633013 0.013947 0.0138875 0.0369006 0.0147027 0.00678045 0.00400573 0.0200978 0.00275397 0.0116137
----view 1: 0.00133407 0.00140882 0.00141752 0.00143474 0.00141883 0.00137621 0.00137758 0.00138235 0.00137353 0.00131696 0.00130802
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.00633013 0.013947 0.0138875 0.0369006 0.0147027 0.00678045 0.00400573 0.0200978 0.00275397 0.0116137 0.0212331
----view 1: 0.00140882 0.00141752 0.00143474 0.00141883 0.00137621 0.00137758 0.00138235 0.00137353 0.00131696 0.00130802 0.00118566
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 15:15:00 CEST Closed output file "np04hd_raw_run029081_0757_dataflow5_datawriter_0_20240905T045432_reco_stage1_reco_stage2_20240926T131500_keepup.root"
26-Sep-2024 15:15:00 CEST Closed input file "np04hd_raw_run029081_0757_dataflow5_datawriter_0_20240905T045432_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 73.8313 103.488 127.423 105.401 14.6208 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000932804 0.00349003 0.00810563 0.00366282 0.0013696 30
produce:fembfilter:PDHDFEMBFilter 0.560695 0.658469 0.849394 0.609308 0.0982937 30
produce:wclsdatahd:WireCellToolkit 39.7111 44.0169 51.7082 43.9215 2.67046 30
produce:gaushit:GausHitFinder 0.393877 0.713504 1.19598 0.67734 0.177896 30
produce:nhitsfilter:NumberOfHitsFilter 0.000302774 0.000466509 0.000814552 0.000415876 0.000146119 30
produce:reco3d:SpacePointSolver 0.21591 1.22805 3.86084 0.898917 0.91872 30
produce:hitpdune:DisambigFromSpacePoints 0.260233 0.542038 1.09851 0.466551 0.228534 30
produce:pandora:StandardPandora 6.25091 13.9562 23.919 12.8535 4.36291 30
produce:pandoraWriter:StandardPandora 0.0905125 0.174879 0.246916 0.17659 0.0364552 30
produce:pandoraTrack:LArPandoraTrackCreation 0.52933 1.64358 4.20601 1.61786 0.743948 30
produce:pandoraShower:LArPandoraShowerCreation 0.42789 1.9718 4.86346 1.79508 1.05151 30
produce:pandoracalo:Calorimetry 0.279928 0.780395 2.25975 0.732149 0.357285 30
produce:pandoracalonosce:Calorimetry 0.242074 0.710113 2.07075 0.627972 0.343623 30
produce:pandorapid:Chi2ParticleID 0.00131228 0.00208275 0.00359072 0.0019276 0.00059379 30
produce:pandoraShowercalo:ShowerCalorimetry 0.414806 1.67408 3.42309 1.58802 0.793526 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.410373 1.57708 2.99754 1.61303 0.700106 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0728809 0.15739 0.253096 0.137753 0.0531198 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0260109 0.0536369 0.0884255 0.0495865 0.0165301 30
produce:emtrkmichelid:EmTrackMichelId 20.348 31.8241 42.0031 33.4139 5.92688 30
[art]:TriggerResults:TriggerResultInserter 2.576e-05 5.50967e-05 0.000112512 5.2226e-05 1.9116e-05 30
end_path:out1:RootOutput 7.8e-06 1.63143e-05 3.203e-05 1.4575e-05 6.20719e-06 30
end_path:michelremoving:michelremoving 0.0177404 0.0905678 0.385872 0.0493267 0.0908978 30
end_path:michelremovinggnocchi:michelremoving 0.0171461 0.0898149 0.340834 0.0412744 0.0882242 30
end_path:calibanagnocchi:CalibAnaTree 0.204615 0.57953 1.3204 0.512573 0.277128 30
end_path:out1:RootOutput(write) 0.526567 0.839412 1.46828 0.835964 0.210989 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4950.58 MB
Peak resident set size usage (VmHWM): 2374.39 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029081_0757_dataflow5_datawriter_0_20240905T045432_reco_stage1_reco_stage2_20240926T131500_keepup.root
\tHists: np04hd_raw_run029081_0757_dataflow5_datawriter_0_20240905T045432_reco_stage1_reco_stage2_20240926T131500_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
