Jobsub ID 79221.0@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 79221.0@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3460 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 15:06:25 |
| Site | UK_Manchester |
| Entry | UBoone_T2_UK_Manchester_ce02 |
| Last heartbeat | 2024-09-26 16:59:03 |
| From worker node | Hostname | wn1903241.tier2.hep.manchester.ac.uk |
| cpuinfo | Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 15:08:25 |
| Input files | hd-protodune:np04hd_raw_run029218_0099_dataflow2_datawriter_0_20240917T165247.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 16:59:03 |
| Saved logs | justin-logs:79221.0-justin-prod-sched02.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
lo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 24778 TrkackID 1 startx, y, z 254.835 592.922 315.272 wireno, peakt tpcno 172 5 5 dist 0min T, max_T5 3243.04
no of hits closeby 0 event 24778 TrkackID 12 startx, y, z -72.5184 590.607 284.831 wireno, peakt tpcno 459 2501.07 6 dist 2.05275min T, max_T2123.82 3058.5
no of hits closeby 0 event 24778 TrkackID 24 startx, y, z 45.5737 592.402 130.384 wireno, peakt tpcno 291 1827.97 2 dist 270.353min T, max_T6.08308 1831.2
no of hits closeby 0 event 24778 TrkackID 1 startx, y, z 254.835 592.922 315.272 wireno, peakt tpcno 172 5 5 dist 0min T, max_T5 3243.04
no of hits closeby 0 event 24778 TrkackID 12 startx, y, z -72.5184 590.607 284.831 wireno, peakt tpcno 459 2501.07 6 dist 2.05275min T, max_T2123.82 3058.5
no of hits closeby 0 event 24778 TrkackID 24 startx, y, z 45.5737 592.402 130.384 wireno, peakt tpcno 291 1827.97 2 dist 270.353min T, max_T6.08308 1831.2
Begin processing the 30th record. run: 29218 subRun: 1 event: 24786 at 26-Sep-2024 17:53:42 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 51493 traces, 51493 summary
Retagger: tagging trace set: gauss with 38442 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 38442 traces tagged "gauss"
FrameSaver: q=786028 n=706295 tag=gauss
wclsFrameSaver: saving 51493 traces tagged "wiener"
FrameSaver: q=853053 n=642586 tag=wiener
1674 hits in TPC 0
2543 hits in TPC 1
7098 hits in TPC 2
3680 hits in TPC 3
2809 hits in TPC 4
4545 hits in TPC 5
2743 hits in TPC 6
2086 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 4680 XUs and 2009 XVs -> 132 XUVs
C:0 T:2 24984 XUs and 55056 XVs -> 1706 XUVs
C:0 T:3 278 XUs and 435 XVs -> 10 XUVs
C:0 T:4 331 XUs and 351 XVs -> 11 XUVs
C:0 T:5 9703 XUs and 8709 XVs -> 270 XUVs
C:0 T:6 15741 XUs and 72215 XVs -> 1615 XUVs
C:0 T:7 97 XUs and 57 XVs -> 1 XUVs
3745 XUVs total
1329 collection wire objects
3745 potential space points
Neighbour search...
421793 tests to find 202922 neighbours
Iterating with no regularization...
Begin: 6.43387e+06
0 5.8524e+06
1 5.8146e+06
2 5.8098e+06
Now with regularization...
Begin: 5.57815e+06
0 5.57612e+06
TestBeamParticleCreationAlgorithm::SetupTestBeamVertex - Test beam particle has no initial vertex
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 31st record. run: 29218 subRun: 1 event: 24794 at 26-Sep-2024 17:55:53 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 70580 traces, 70580 summary
Retagger: tagging trace set: gauss with 52072 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 52072 traces tagged "gauss"
FrameSaver: q=1.12203e+06 n=979469 tag=gauss
wclsFrameSaver: saving 70580 traces tagged "wiener"
FrameSaver: q=1.21125e+06 n=891490 tag=wiener
4909 hits in TPC 0
5121 hits in TPC 1
7627 hits in TPC 2
4043 hits in TPC 3
2050 hits in TPC 4
3011 hits in TPC 5
5138 hits in TPC 6
5998 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1666 XUs and 1183 XVs -> 30 XUVs
C:0 T:2 49238 XUs and 55135 XVs -> 1798 XUVs
C:0 T:3 1259 XUs and 1183 XVs -> 45 XUVs
C:0 T:4 145 XUs and 170 XVs -> 4 XUVs
C:0 T:5 5245 XUs and 6802 XVs -> 171 XUVs
C:0 T:6 25510 XUs and 39121 XVs -> 2235 XUVs
C:0 T:7 176 XUs and 167 XVs -> 12 XUVs
4295 XUVs total
1620 collection wire objects
4295 potential space points
Neighbour search...
175311 tests to find 106528 neighbours
Iterating with no regularization...
Begin: 1.20408e+07
0 1.08471e+07
1 1.07535e+07
2 1.07403e+07
3 1.07366e+07
Now with regularization...
Begin: 1.01069e+07
0 1.01046e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 17:58:32 BST Closed output file "np04hd_raw_run029218_0099_dataflow2_datawriter_0_20240917T165247_reco_stage1_reco_stage2_20240926T165832_keepup.root"
26-Sep-2024 17:58:32 BST Closed input file "np04hd_raw_run029218_0099_dataflow2_datawriter_0_20240917T165247_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 79.336 145.359 225.762 144.658 31.2365 31
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000797007 0.00308426 0.00544837 0.00316303 0.00122364 31
produce:fembfilter:PDHDFEMBFilter 0.763713 1.05597 1.17082 1.0582 0.070294 31
produce:wclsdatahd:WireCellToolkit 58.0149 67.6049 75.7698 66.6513 3.7788 31
produce:gaushit:GausHitFinder 0.569072 1.37161 5.08636 1.18645 0.830514 31
produce:nhitsfilter:NumberOfHitsFilter 0.000404484 0.00337742 0.0834079 0.000596382 0.0146172 31
produce:reco3d:SpacePointSolver 0.307604 1.21022 2.96077 0.874659 0.783309 29
produce:hitpdune:DisambigFromSpacePoints 0.342165 0.932835 2.47101 0.782075 0.445218 29
produce:pandora:StandardPandora 7.73386 20.2473 41.1586 19.4814 8.90991 29
produce:pandoraWriter:StandardPandora 0.166863 0.249998 0.353292 0.241758 0.0503434 29
produce:pandoraTrack:LArPandoraTrackCreation 1.19114 2.89204 5.5615 2.74326 1.07128 29
produce:pandoraShower:LArPandoraShowerCreation 1.15372 3.65568 10.3744 3.31423 2.02295 29
produce:pandoracalo:Calorimetry 0.530662 1.26466 2.41377 1.20234 0.48744 29
produce:pandoracalonosce:Calorimetry 0.340632 1.15795 2.2972 1.10745 0.480002 29
produce:pandorapid:Chi2ParticleID 0.00161399 0.00294126 0.00545149 0.00291873 0.000788888 29
produce:pandoraShowercalo:ShowerCalorimetry 0.509217 2.91734 8.26412 2.55296 1.67597 29
produce:pandoraShowercalonosce:ShowerCalorimetry 0.588205 2.82667 8.10196 2.51515 1.61518 29
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.100775 0.21414 0.371302 0.207085 0.0599423 29
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.046875 0.0858913 0.135222 0.0857253 0.0231482 29
produce:emtrkmichelid:EmTrackMichelId 23.409 40.0255 58.499 38.2297 9.30143 29
[art]:TriggerResults:TriggerResultInserter 4.6286e-05 7.77366e-05 0.000132964 7.1529e-05 1.78708e-05 31
end_path:out1:RootOutput 1.1747e-05 2.00177e-05 4.912e-05 1.7713e-05 8.4586e-06 31
end_path:michelremoving:michelremoving 6.089e-05 0.154233 1.02019 0.090619 0.188605 31
end_path:michelremovinggnocchi:michelremoving 4.1392e-05 0.1528 0.989046 0.0811746 0.187469 31
end_path:calibanagnocchi:CalibAnaTree 3.5135e-05 0.951125 2.00827 0.871554 0.491272 31
end_path:out1:RootOutput(write) 0.821122 1.20685 1.98939 1.1644 0.296483 31
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4971.29 MB
Peak resident set size usage (VmHWM): 2634.88 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029218_0099_dataflow2_datawriter_0_20240917T165247_reco_stage1_reco_stage2_20240926T165832_keepup.root
\tHists: np04hd_raw_run029218_0099_dataflow2_datawriter_0_20240917T165247_reco_stage1_reco_stage2_20240926T165832_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
