Jobsub ID 79031.26@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 79031.26@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3449 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 14:02:34 |
| Site | UK_Sheffield |
| Entry | DUNE_UK_Sheffield_lcgce1 |
| Last heartbeat | 2024-09-26 14:51:44 |
| From worker node | Hostname | wn034.hep |
| cpuinfo | AMD EPYC 75F3 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 14:04:24 |
| Input files | hd-protodune:np04hd_raw_run029107_0726_dataflow5_datawriter_0_20240907T025747.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 14:51:44 |
| Saved logs | justin-logs:79031.26-justin-prod-sched02.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
41 0.000274241
----view 1: 0.0168209 0.0191326 0.0207672 0.00816154 0.00264359 0.0113373 0.0159683 0.0197439 0.0234556 0.0234737 0.0254364
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000274241 0.000274241 0.000274241 0.000274241 0.000274241 0.000274241 0.000274241 0.000274241 0.000274241 0.000274241 0.000274241
----view 1: 0.0191326 0.0207672 0.00816154 0.00264359 0.0113373 0.0159683 0.0197439 0.0234556 0.0234737 0.0254364 0.0423889
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 29th record. run: 29107 subRun: 1 event: 174493 at 26-Sep-2024 15:49:21 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 64986 traces, 64986 summary
Retagger: tagging trace set: gauss with 48383 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 48383 traces tagged "gauss"
FrameSaver: q=1.03036e+06 n=857981 tag=gauss
wclsFrameSaver: saving 64986 traces tagged "wiener"
FrameSaver: q=1.12152e+06 n=777913 tag=wiener
4195 hits in TPC 0
3488 hits in TPC 1
4663 hits in TPC 2
1403 hits in TPC 3
3823 hits in TPC 4
6776 hits in TPC 5
5610 hits in TPC 6
3637 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 19 XUs and 6 XVs -> 0 XUVs
C:0 T:1 20322 XUs and 8152 XVs -> 440 XUVs
C:0 T:2 18025 XUs and 8924 XVs -> 321 XUVs
C:0 T:3 29 XUs and 31 XVs -> 0 XUVs
C:0 T:4 182 XUs and 248 XVs -> 9 XUVs
C:0 T:5 21394 XUs and 40237 XVs -> 764 XUVs
C:0 T:6 14485 XUs and 24995 XVs -> 1685 XUVs
C:0 T:7 300 XUs and 442 XVs -> 9 XUVs
3228 XUVs total
1677 collection wire objects
3228 potential space points
Neighbour search...
68898 tests to find 41680 neighbours
Iterating with no regularization...
Begin: 1.12504e+07
0 1.0599e+07
1 1.05585e+07
2 1.05548e+07
Now with regularization...
Begin: 1.00548e+07
0 1.00538e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 30th record. run: 29107 subRun: 1 event: 174541 at 26-Sep-2024 15:50:17 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 83429 traces, 83429 summary
Retagger: tagging trace set: gauss with 59848 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 59848 traces tagged "gauss"
FrameSaver: q=1.34452e+06 n=1092981 tag=gauss
wclsFrameSaver: saving 83429 traces tagged "wiener"
FrameSaver: q=1.46253e+06 n=985474 tag=wiener
5103 hits in TPC 0
3826 hits in TPC 1
8200 hits in TPC 2
4080 hits in TPC 3
4450 hits in TPC 4
6628 hits in TPC 5
6544 hits in TPC 6
3706 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 903 XUs and 536 XVs -> 19 XUVs
C:0 T:2 23681 XUs and 52651 XVs -> 3190 XUVs
C:0 T:3 325 XUs and 420 XVs -> 17 XUVs
C:0 T:4 81 XUs and 100 XVs -> 0 XUVs
C:0 T:5 45640 XUs and 66237 XVs -> 2903 XUVs
C:0 T:6 16964 XUs and 34525 XVs -> 2480 XUVs
C:0 T:7 46 XUs and 30 XVs -> 4 XUVs
8613 XUVs total
2379 collection wire objects
8613 potential space points
Neighbour search...
695633 tests to find 386310 neighbours
Iterating with no regularization...
Begin: 1.04513e+07
0 9.28158e+06
1 9.18746e+06
2 9.16699e+06
3 9.15921e+06
Now with regularization...
Begin: 8.18272e+06
0 8.17744e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 15:51:24 BST Closed output file "np04hd_raw_run029107_0726_dataflow5_datawriter_0_20240907T025747_reco_stage1_reco_stage2_20240926T145124_keepup.root"
26-Sep-2024 15:51:24 BST Closed input file "np04hd_raw_run029107_0726_dataflow5_datawriter_0_20240907T025747_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 38.2368 55.6034 84.0191 55.4601 8.86033 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00025291 0.000810115 0.0012795 0.000929724 0.000325546 30
produce:fembfilter:PDHDFEMBFilter 0.36609 0.377934 0.416783 0.376174 0.00960946 30
produce:wclsdatahd:WireCellToolkit 23.5974 25.3989 26.7583 25.5288 0.692185 30
produce:gaushit:GausHitFinder 0.189511 0.348305 0.569462 0.343072 0.0744062 30
produce:nhitsfilter:NumberOfHitsFilter 9.7835e-05 0.000184647 0.000339935 0.000174646 4.52553e-05 30
produce:reco3d:SpacePointSolver 0.0739416 0.506266 1.18172 0.393521 0.332757 30
produce:hitpdune:DisambigFromSpacePoints 0.106515 0.263481 0.586855 0.218095 0.142394 30
produce:pandora:StandardPandora 2.84049 6.16284 15.4933 5.65686 2.59508 30
produce:pandoraWriter:StandardPandora 0.0332579 0.0639124 0.10384 0.0619931 0.0157639 30
produce:pandoraTrack:LArPandoraTrackCreation 0.184542 0.579765 1.63287 0.550009 0.254754 30
produce:pandoraShower:LArPandoraShowerCreation 0.23702 0.722673 1.65205 0.681357 0.297753 30
produce:pandoracalo:Calorimetry 0.112732 0.33736 0.906859 0.327781 0.136228 30
produce:pandoracalonosce:Calorimetry 0.10074 0.311968 0.866903 0.304811 0.131699 30
produce:pandorapid:Chi2ParticleID 0.00049507 0.000976539 0.00210209 0.000928217 0.000276456 30
produce:pandoraShowercalo:ShowerCalorimetry 0.207263 0.726265 1.79391 0.695433 0.314337 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.199025 0.706529 1.74958 0.676816 0.303935 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0308257 0.0684139 0.0963833 0.0665297 0.0147108 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0100808 0.0239878 0.0354446 0.0239057 0.00536261 30
produce:emtrkmichelid:EmTrackMichelId 8.50668 18.1849 28.4093 17.7976 4.13545 30
[art]:TriggerResults:TriggerResultInserter 1.0811e-05 1.50132e-05 5.9342e-05 1.25285e-05 8.6467e-06 30
end_path:out1:RootOutput 2.856e-06 4.18857e-06 1.8064e-05 3.527e-06 2.87351e-06 30
end_path:michelremoving:michelremoving 0.00959443 0.0432585 0.153253 0.016749 0.0453718 30
end_path:michelremovinggnocchi:michelremoving 0.00913025 0.0398495 0.137757 0.0161169 0.0408225 30
end_path:calibanagnocchi:CalibAnaTree 0.112792 0.257732 0.815831 0.242465 0.124473 30
end_path:out1:RootOutput(write) 0.229781 0.416529 0.646385 0.406272 0.091103 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4925.17 MB
Peak resident set size usage (VmHWM): 2311.5 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_0726_dataflow5_datawriter_0_20240907T025747_reco_stage1_reco_stage2_20240926T145124_keepup.root
\tHists: np04hd_raw_run029107_0726_dataflow5_datawriter_0_20240907T025747_reco_stage1_reco_stage2_20240926T145124_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
