Jobsub ID 264031.0@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 264031.0@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3460 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 15:00:44 |
| Site | UK_Manchester |
| Entry | UBoone_T2_UK_Manchester_ce02 |
| Last heartbeat | 2024-09-26 16:22:25 |
| From worker node | Hostname | wn2207301.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7513 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 15:01:39 |
| Input files | hd-protodune:np04hd_raw_run029218_0085_dataflow6_datawriter_0_20240917T164432.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 16:22:25 |
| Saved logs | justin-logs:264031.0-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
to calculate correlation coefficient p-value for these numbers
----view 0: 0.000373065 0.000373125 0.000373065 0.000373125 0.000227153 0.000288367 0.00031364 0.00031358 0.00031358 0.000313699 0.00031358
----view 1: 0.00167978 0.00625587 0.0703379 0.0228269 0.00193548 0.00613296 0.00587881 0.0177732 0.0233946 0.0224628 0.00773931
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 30th record. run: 29218 subRun: 1 event: 21350 at 26-Sep-2024 17:19:35 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 49710 traces, 49710 summary
Retagger: tagging trace set: gauss with 37501 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 37501 traces tagged "gauss"
FrameSaver: q=843031 n=715901 tag=gauss
wclsFrameSaver: saving 49710 traces tagged "wiener"
FrameSaver: q=893730 n=647708 tag=wiener
815 hits in TPC 0
908 hits in TPC 1
7672 hits in TPC 2
3627 hits in TPC 3
2255 hits in TPC 4
3454 hits in TPC 5
5498 hits in TPC 6
2887 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 23 XUs and 26 XVs -> 0 XUVs
C:0 T:2 17821 XUs and 22098 XVs -> 798 XUVs
C:0 T:3 1125 XUs and 1403 XVs -> 109 XUVs
C:0 T:4 50 XUs and 37 XVs -> 1 XUVs
C:0 T:5 7853 XUs and 5250 XVs -> 219 XUVs
C:0 T:6 12625 XUs and 14522 XVs -> 399 XUVs
C:0 T:7 112 XUs and 122 XVs -> 9 XUVs
1535 XUVs total
1155 collection wire objects
1535 potential space points
Neighbour search...
18925 tests to find 8874 neighbours
Iterating with no regularization...
Begin: 5.4013e+06
0 5.03782e+06
1 5.01113e+06
2 5.01035e+06
Now with regularization...
Begin: 4.66706e+06
0 4.66657e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 5 event 21350 TrkackID 2 startx, y, z 268.687 607.719 9.27003 wireno, peakt tpcno 61 4323.09 5 dist 6.10967min T, max_T1459.1 4855
no of hits closeby 5 event 21350 TrkackID 2 startx, y, z 268.687 607.719 9.27003 wireno, peakt tpcno 61 4323.09 5 dist 6.10967min T, max_T1459.1 4855
Begin processing the 31st record. run: 29218 subRun: 1 event: 21358 at 26-Sep-2024 17:20:59 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 52245 traces, 52245 summary
Retagger: tagging trace set: gauss with 39478 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 39478 traces tagged "gauss"
FrameSaver: q=784250 n=744837 tag=gauss
wclsFrameSaver: saving 52245 traces tagged "wiener"
FrameSaver: q=847285 n=675966 tag=wiener
5061 hits in TPC 0
4353 hits in TPC 1
4031 hits in TPC 2
2312 hits in TPC 3
1466 hits in TPC 4
2810 hits in TPC 5
5156 hits in TPC 6
2242 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 10730 XUs and 8563 XVs -> 536 XUVs
C:0 T:2 15178 XUs and 11257 XVs -> 390 XUVs
C:0 T:3 4 XUs and 5 XVs -> 0 XUVs
C:0 T:4 140 XUs and 55 XVs -> 6 XUVs
C:0 T:5 5097 XUs and 5245 XVs -> 110 XUVs
C:0 T:6 11787 XUs and 11526 XVs -> 173 XUVs
C:0 T:7 219 XUs and 243 XVs -> 4 XUVs
1219 XUVs total
514 collection wire objects
1219 potential space points
Neighbour search...
40561 tests to find 25198 neighbours
Iterating with no regularization...
Begin: 1.47332e+06
0 1.37446e+06
1 1.36392e+06
2 1.36261e+06
Now with regularization...
Begin: 1.27716e+06
0 1.2768e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 21358 TrkackID 3 startx, y, z 107.351 597.163 394.621 wireno, peakt tpcno 331 5 5 dist 0min T, max_T5 2550
no of hits closeby 0 event 21358 TrkackID 3 startx, y, z 107.351 597.163 394.621 wireno, peakt tpcno 331 5 5 dist 0min T, max_T5 2550
26-Sep-2024 17:21:56 BST Closed output file "np04hd_raw_run029218_0085_dataflow6_datawriter_0_20240917T164432_reco_stage1_reco_stage2_20240926T162156_keepup.root"
26-Sep-2024 17:21:56 BST Closed input file "np04hd_raw_run029218_0085_dataflow6_datawriter_0_20240917T164432_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 57.1195 105.965 715.417 84.0864 111.948 31
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000844894 0.00248317 0.00487384 0.00258792 0.000901072 31
produce:fembfilter:PDHDFEMBFilter 0.52356 0.724507 0.878595 0.762576 0.0991722 31
produce:wclsdatahd:WireCellToolkit 28.6464 38.1935 46.2326 38.7162 3.27247 31
produce:gaushit:GausHitFinder 0.411152 0.671833 1.4463 0.584892 0.220185 31
produce:nhitsfilter:NumberOfHitsFilter 0.000245891 0.000349845 0.000591259 0.000336601 7.87901e-05 31
produce:reco3d:SpacePointSolver 0.164138 1.09408 16.5112 0.487296 2.83058 31
produce:hitpdune:DisambigFromSpacePoints 0.162693 0.567237 4.25278 0.434361 0.69546 31
produce:pandora:StandardPandora 4.10585 29.0166 585.883 10.1673 101.725 31
produce:pandoraWriter:StandardPandora 0.0988471 0.18198 0.412907 0.186265 0.0579004 31
produce:pandoraTrack:LArPandoraTrackCreation 0.485556 1.11663 4.21141 1.00518 0.638065 31
produce:pandoraShower:LArPandoraShowerCreation 0.405156 1.26944 3.20673 1.16331 0.535505 31
produce:pandoracalo:Calorimetry 0.284838 0.622929 1.89083 0.582028 0.282905 31
produce:pandoracalonosce:Calorimetry 0.243894 0.575436 1.8172 0.536132 0.279624 31
produce:pandorapid:Chi2ParticleID 0.0010847 0.0020446 0.00426913 0.00202356 0.000664048 31
produce:pandoraShowercalo:ShowerCalorimetry 0.36345 1.24815 3.03094 1.14957 0.525599 31
produce:pandoraShowercalonosce:ShowerCalorimetry 0.35351 1.16517 2.86896 1.12087 0.466788 31
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0683594 0.139444 0.249551 0.130491 0.0502988 31
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0238617 0.0481335 0.0804826 0.0489061 0.0149019 31
produce:emtrkmichelid:EmTrackMichelId 15.39 27.6275 44.3071 27.7813 6.41721 31
[art]:TriggerResults:TriggerResultInserter 2.674e-05 4.77421e-05 0.000148258 3.8192e-05 2.69679e-05 31
end_path:out1:RootOutput 8.506e-06 1.51844e-05 4.3141e-05 1.2654e-05 7.47015e-06 31
end_path:michelremoving:michelremoving 0.0172488 0.0927082 0.28491 0.0355811 0.0783977 31
end_path:michelremovinggnocchi:michelremoving 0.0151661 0.0898741 0.266818 0.0327715 0.0769277 31
end_path:calibanagnocchi:CalibAnaTree 0.166258 0.48046 1.36922 0.433531 0.220494 31
end_path:out1:RootOutput(write) 0.530446 0.908045 1.67569 0.911734 0.258754 31
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4925.58 MB
Peak resident set size usage (VmHWM): 2566.16 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029218_0085_dataflow6_datawriter_0_20240917T164432_reco_stage1_reco_stage2_20240926T162156_keepup.root
\tHists: np04hd_raw_run029218_0085_dataflow6_datawriter_0_20240917T164432_reco_stage1_reco_stage2_20240926T162156_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
