Jobsub ID 78460.42@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 78460.42@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3447 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 09:58:17 |
| Site | FR_CCIN2P3 |
| Entry | DUNE_FR_CCIN2P3_cccondorce01 |
| Last heartbeat | 2024-09-26 11:19:30 |
| From worker node | Hostname | ccwcondor0640 |
| cpuinfo | AMD EPYC 7453 28-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 106200 (29 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 10:10:45 |
| Input files | hd-protodune:np04hd_raw_run029081_0795_dataflow0_datawriter_0_20240905T052533.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 11:19:30 |
| Saved logs | justin-logs:78460.42-justin-prod-sched02.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
cts
4029 potential space points
Neighbour search...
318725 tests to find 163506 neighbours
Iterating with no regularization...
Begin: 5.2232e+06
0 4.73742e+06
1 4.68816e+06
2 4.67627e+06
3 4.67245e+06
Now with regularization...
Begin: 4.30104e+06
0 4.29906e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 2 event 191024 TrkackID 1 startx, y, z 72.6277 469.734 452.352 wireno, peakt tpcno 240 2828.61 6 dist 404.128min T, max_T212.344 2828.61
no of hits closeby 2 event 191024 TrkackID 1 startx, y, z 72.6277 469.734 452.352 wireno, peakt tpcno 240 2828.61 6 dist 404.128min T, max_T212.344 2828.61
Begin processing the 29th record. run: 29081 subRun: 1 event: 191048 at 26-Sep-2024 13:15:53 CEST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 37880 traces, 37880 summary
Retagger: tagging trace set: gauss with 29405 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 29405 traces tagged "gauss"
FrameSaver: q=653072 n=564380 tag=gauss
wclsFrameSaver: saving 37880 traces tagged "wiener"
FrameSaver: q=694220 n=514070 tag=wiener
1124 hits in TPC 0
2160 hits in TPC 1
3550 hits in TPC 2
2550 hits in TPC 3
2106 hits in TPC 4
4087 hits in TPC 5
2796 hits in TPC 6
1787 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 609 XUs and 325 XVs -> 24 XUVs
C:0 T:2 29381 XUs and 18686 XVs -> 484 XUVs
C:0 T:3 645 XUs and 403 XVs -> 11 XUVs
C:0 T:4 276 XUs and 292 XVs -> 13 XUVs
C:0 T:5 7667 XUs and 6519 XVs -> 277 XUVs
C:0 T:6 3560 XUs and 3701 XVs -> 223 XUVs
C:0 T:7 77 XUs and 88 XVs -> 2 XUVs
1034 XUVs total
713 collection wire objects
1034 potential space points
Neighbour search...
25930 tests to find 13448 neighbours
Iterating with no regularization...
Begin: 3.34051e+06
0 3.19397e+06
1 3.18313e+06
2 3.18215e+06
Now with regularization...
Begin: 2.96311e+06
0 2.96274e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 10 event 191048 TrkackID 2 startx, y, z 98.6252 594.976 364.482 wireno, peakt tpcno 117 3863.72 5 dist 16.4941min T, max_T3746.84 5027.69
no of hits closeby 10 event 191048 TrkackID 2 startx, y, z 98.6252 594.976 364.482 wireno, peakt tpcno 117 3863.72 5 dist 16.4941min T, max_T3746.84 5027.69
Begin processing the 30th record. run: 29081 subRun: 1 event: 191056 at 26-Sep-2024 13:16:50 CEST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 57633 traces, 57633 summary
Retagger: tagging trace set: gauss with 44672 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 44672 traces tagged "gauss"
FrameSaver: q=908871 n=885018 tag=gauss
wclsFrameSaver: saving 57633 traces tagged "wiener"
FrameSaver: q=970741 n=814571 tag=wiener
4244 hits in TPC 0
5790 hits in TPC 1
4786 hits in TPC 2
3514 hits in TPC 3
1671 hits in TPC 4
3909 hits in TPC 5
6163 hits in TPC 6
2576 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 2484 XUs and 2744 XVs -> 156 XUVs
C:0 T:2 14532 XUs and 11950 XVs -> 259 XUVs
C:0 T:3 418 XUs and 291 XVs -> 12 XUVs
C:0 T:4 24 XUs and 32 XVs -> 7 XUVs
C:0 T:5 5327 XUs and 22372 XVs -> 784 XUVs
C:0 T:6 16331 XUs and 12658 XVs -> 456 XUVs
C:0 T:7 340 XUs and 471 XVs -> 19 XUVs
1693 XUVs total
1019 collection wire objects
1693 potential space points
Neighbour search...
39463 tests to find 22034 neighbours
Iterating with no regularization...
Begin: 5.12147e+06
0 4.95072e+06
1 4.93917e+06
2 4.93719e+06
Now with regularization...
Begin: 4.66048e+06
0 4.65971e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 13:18:14 CEST Closed output file "np04hd_raw_run029081_0795_dataflow0_datawriter_0_20240905T052533_reco_stage1_reco_stage2_20240926T111814_keepup.root"
26-Sep-2024 13:18:14 CEST Closed input file "np04hd_raw_run029081_0795_dataflow0_datawriter_0_20240905T052533_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 57.7311 93.9726 172.207 86.761 23.5791 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000690143 0.00272821 0.00501801 0.00306908 0.00115492 30
produce:fembfilter:PDHDFEMBFilter 0.515223 0.662266 0.790782 0.676019 0.0929055 30
produce:wclsdatahd:WireCellToolkit 33.9171 38.1634 43.8063 37.2607 3.09507 30
produce:gaushit:GausHitFinder 0.256639 0.653138 1.28429 0.643326 0.213687 30
produce:nhitsfilter:NumberOfHitsFilter 0.000200215 0.000328273 0.000531476 0.000311144 7.49635e-05 30
produce:reco3d:SpacePointSolver 0.196185 0.995366 2.55965 1.00006 0.611013 30
produce:hitpdune:DisambigFromSpacePoints 0.104796 0.512507 1.62018 0.38804 0.321966 30
produce:pandora:StandardPandora 3.62375 11.5377 38.6573 9.2097 7.28958 30
produce:pandoraWriter:StandardPandora 0.0705447 0.148803 0.241059 0.143221 0.0463279 30
produce:pandoraTrack:LArPandoraTrackCreation 0.538482 1.74605 6.37866 1.4703 1.10707 30
produce:pandoraShower:LArPandoraShowerCreation 0.375213 2.23729 7.66914 1.80398 1.54453 30
produce:pandoracalo:Calorimetry 0.247343 0.843477 2.91504 0.774378 0.502656 30
produce:pandoracalonosce:Calorimetry 0.230272 0.831536 2.86773 0.776331 0.506216 30
produce:pandorapid:Chi2ParticleID 0.00105791 0.00217355 0.00423149 0.00212766 0.000722733 30
produce:pandoraShowercalo:ShowerCalorimetry 0.319562 1.81852 5.56443 1.73281 1.08845 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.308091 1.76314 5.27292 1.62602 1.06819 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.04718 0.143168 0.252568 0.141618 0.0513754 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0184823 0.0486067 0.0864866 0.0457962 0.0176228 30
produce:emtrkmichelid:EmTrackMichelId 15.8855 30.2097 50.5964 28.5084 8.01745 30
[art]:TriggerResults:TriggerResultInserter 2.8844e-05 6.05471e-05 0.000148058 5.77385e-05 2.11021e-05 30
end_path:out1:RootOutput 1.1632e-05 1.96657e-05 5.4201e-05 1.8675e-05 7.60166e-06 30
end_path:michelremoving:michelremoving 0.0234695 0.0886026 0.34348 0.0542659 0.0800476 30
end_path:michelremovinggnocchi:michelremoving 0.0207087 0.0859032 0.348997 0.0492968 0.0831853 30
end_path:calibanagnocchi:CalibAnaTree 0.228953 0.573156 2.17927 0.479048 0.362125 30
end_path:out1:RootOutput(write) 0.312882 0.697405 1.12403 0.707731 0.199548 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4912.45 MB
Peak resident set size usage (VmHWM): 2338.37 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029081_0795_dataflow0_datawriter_0_20240905T052533_reco_stage1_reco_stage2_20240926T111814_keepup.root
\tHists: np04hd_raw_run029081_0795_dataflow0_datawriter_0_20240905T052533_reco_stage1_reco_stage2_20240926T111814_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
