Jobsub ID 263757.104@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 263757.104@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3448 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 13:23:33 |
| Site | UK_Durham |
| Entry | DUNE_UK_SGridDurham_ce3 |
| Last heartbeat | 2024-09-26 14:57:28 |
| From worker node | Hostname | n180.dur.scotgrid.ac.uk |
| cpuinfo | Intel(R) Xeon(R) Gold 5220 CPU @ 2.20GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 13:25:07 |
| Input files | hd-protodune:np04hd_raw_run029092_0922_dataflow0_datawriter_0_20240906T074556.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 14:57:28 |
| Saved logs | justin-logs:263757.104-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
XUs and 8140 XVs -> 340 XUVs
C:0 T:2 24765 XUs and 22386 XVs -> 930 XUVs
C:0 T:3 497 XUs and 422 XVs -> 16 XUVs
C:0 T:4 100 XUs and 144 XVs -> 4 XUVs
C:0 T:5 40233 XUs and 62691 XVs -> 1464 XUVs
C:0 T:6 20050 XUs and 20411 XVs -> 1766 XUVs
C:0 T:7 4 XUs and 30 XVs -> 0 XUVs
4520 XUVs total
1923 collection wire objects
4520 potential space points
Neighbour search...
145392 tests to find 82228 neighbours
Iterating with no regularization...
Begin: 9.73421e+06
0 8.85581e+06
1 8.79118e+06
2 8.78625e+06
Now with regularization...
Begin: 8.11649e+06
0 8.11497e+06
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.0151299 0.00481385 0.00403929 0.0100762 0.00551403 0.00292766 0.00289357 0.00370109 0.0026474 0.00163406 0.00155407 0.00150621 0.00504708
----view 1: 7.31945e-05 7.31349e-05 7.31945e-05 7.31945e-05 7.31945e-05 7.31945e-05 7.31945e-05 7.31349e-05 7.31945e-05 7.31945e-05 7.31945e-05 7.31945e-05 7.31945e-05
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.00481385 0.00403929 0.0100762 0.00551403 0.00292766 0.00289357 0.00370109 0.0026474 0.00163406 0.00155407 0.00150621 0.00504708 0.00461757
----view 1: 7.31349e-05 7.31945e-05 7.31945e-05 7.31945e-05 7.31945e-05 7.31945e-05 7.31349e-05 7.31945e-05 7.31945e-05 7.31945e-05 7.31945e-05 7.31945e-05 7.31349e-05
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.0151299 0.00481385 0.00403929 0.0100762 0.00551403 0.00292766 0.00289357 0.00370109 0.0026474 0.00163406 0.00155407 0.00150621 0.00504708
----view 1: 7.31945e-05 7.31349e-05 7.31945e-05 7.31945e-05 7.31945e-05 7.31945e-05 7.31945e-05 7.31349e-05 7.31945e-05 7.31945e-05 7.31945e-05 7.31945e-05 7.31945e-05
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.00481385 0.00403929 0.0100762 0.00551403 0.00292766 0.00289357 0.00370109 0.0026474 0.00163406 0.00155407 0.00150621 0.00504708 0.00461757
----view 1: 7.31349e-05 7.31945e-05 7.31945e-05 7.31945e-05 7.31945e-05 7.31945e-05 7.31349e-05 7.31945e-05 7.31945e-05 7.31945e-05 7.31945e-05 7.31945e-05 7.31349e-05
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 11 event 221512 TrkackID 7 startx, y, z -43.6555 591.395 202.733 wireno, peakt tpcno 52 975 6 dist 1.34979min T, max_T883.791 2077.8
no of hits closeby 11 event 221512 TrkackID 7 startx, y, z -43.6555 591.395 202.733 wireno, peakt tpcno 52 975 6 dist 1.34979min T, max_T883.791 2077.8
Begin processing the 30th record. run: 29092 subRun: 1 event: 221520 at 26-Sep-2024 15:55:36 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 64885 traces, 64885 summary
Retagger: tagging trace set: gauss with 45792 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 45792 traces tagged "gauss"
FrameSaver: q=1.0304e+06 n=791544 tag=gauss
wclsFrameSaver: saving 64885 traces tagged "wiener"
FrameSaver: q=1.12663e+06 n=702622 tag=wiener
2105 hits in TPC 0
4269 hits in TPC 1
5626 hits in TPC 2
3706 hits in TPC 3
2940 hits in TPC 4
4775 hits in TPC 5
4740 hits in TPC 6
3245 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 2127 XUs and 1176 XVs -> 195 XUVs
C:0 T:2 33420 XUs and 22562 XVs -> 847 XUVs
C:0 T:3 826 XUs and 363 XVs -> 8 XUVs
C:0 T:4 22 XUs and 36 XVs -> 0 XUVs
C:0 T:5 43168 XUs and 48438 XVs -> 1790 XUVs
C:0 T:6 15026 XUs and 13601 XVs -> 619 XUVs
C:0 T:7 34 XUs and 36 XVs -> 1 XUVs
3460 XUVs total
996 collection wire objects
3460 potential space points
Neighbour search...
559736 tests to find 249638 neighbours
Iterating with no regularization...
Begin: 7.57877e+06
0 7.28574e+06
1 7.26768e+06
2 7.26621e+06
Now with regularization...
Begin: 6.91677e+06
0 6.91618e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 15:56:59 BST Closed output file "np04hd_raw_run029092_0922_dataflow0_datawriter_0_20240906T074556_reco_stage1_reco_stage2_20240926T145659_keepup.root"
26-Sep-2024 15:56:59 BST Closed input file "np04hd_raw_run029092_0922_dataflow0_datawriter_0_20240906T074556_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 69.0201 90.4547 133.73 87.9104 15.9826 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00034312 0.00117793 0.00349446 0.000970126 0.000849502 30
produce:fembfilter:PDHDFEMBFilter 0.692458 0.719559 1.11743 0.705856 0.0742081 30
produce:wclsdatahd:WireCellToolkit 43.3591 45.0118 47.9921 44.766 0.873885 30
produce:gaushit:GausHitFinder 0.499847 0.774193 1.25138 0.779578 0.180157 30
produce:nhitsfilter:NumberOfHitsFilter 0.000270358 0.000370854 0.000547637 0.000360908 6.76374e-05 30
produce:reco3d:SpacePointSolver 0.205934 0.982773 2.92009 0.794243 0.710428 30
produce:hitpdune:DisambigFromSpacePoints 0.210641 0.5685 1.49886 0.491519 0.289437 30
produce:pandora:StandardPandora 5.29261 13.591 33.1365 11.8429 6.5953 30
produce:pandoraWriter:StandardPandora 0.103072 0.162381 0.246895 0.154343 0.0370508 30
produce:pandoraTrack:LArPandoraTrackCreation 0.672648 1.93467 4.43951 1.737 0.930139 30
produce:pandoraShower:LArPandoraShowerCreation 0.479494 2.02318 6.18297 1.81512 1.20329 30
produce:pandoracalo:Calorimetry 0.35832 0.804179 1.7827 0.765844 0.33778 30
produce:pandoracalonosce:Calorimetry 0.323897 0.741017 1.59952 0.718338 0.311588 30
produce:pandorapid:Chi2ParticleID 0.00136187 0.00189636 0.00306319 0.00186216 0.000377196 30
produce:pandoraShowercalo:ShowerCalorimetry 0.405672 1.71937 5.25887 1.64591 0.995568 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.392844 1.68577 5.24914 1.60631 0.982346 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0839458 0.131081 0.2205 0.125511 0.0322008 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.032817 0.050761 0.089056 0.0489497 0.0124566 30
produce:emtrkmichelid:EmTrackMichelId 12.363 17.8035 27.5524 17.7032 3.66102 30
[art]:TriggerResults:TriggerResultInserter 2.7236e-05 3.86435e-05 6.7249e-05 3.7399e-05 6.68644e-06 30
end_path:out1:RootOutput 8.51e-06 1.58802e-05 0.000170018 1.01015e-05 2.87036e-05 30
end_path:michelremoving:michelremoving 0.0238544 0.0872529 0.387576 0.0447033 0.0846602 30
end_path:michelremovinggnocchi:michelremoving 0.0232024 0.0842956 0.38379 0.0388108 0.0843539 30
end_path:calibanagnocchi:CalibAnaTree 0.252851 0.595837 1.41078 0.575825 0.24525 30
end_path:out1:RootOutput(write) 0.528967 0.802009 1.22934 0.78955 0.169955 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5841.16 MB
Peak resident set size usage (VmHWM): 2855.85 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029092_0922_dataflow0_datawriter_0_20240906T074556_reco_stage1_reco_stage2_20240926T145659_keepup.root
\tHists: np04hd_raw_run029092_0922_dataflow0_datawriter_0_20240906T074556_reco_stage1_reco_stage2_20240926T145659_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
