Jobsub ID 263982.6@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 263982.6@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3449 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 14:38:58 |
| Site | UK_Brunel |
| Entry | CMSHTPC_T2_UK_London_Brunel_dc2_22 |
| Last heartbeat | 2024-09-26 16:16:15 |
| From worker node | Hostname | wn-b8-29-00.brunel.ac.uk |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 14:39:40 |
| Input files | hd-protodune:np04hd_raw_run029107_0608_dataflow5_datawriter_0_20240907T012452.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 16:16:15 |
| Saved logs | justin-logs:263982.6-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
262 XUVs
C:0 T:3 11 XUs and 13 XVs -> 0 XUVs
C:0 T:4 364 XUs and 656 XVs -> 29 XUVs
C:0 T:5 33051 XUs and 38536 XVs -> 1580 XUVs
C:0 T:6 1794 XUs and 1867 XVs -> 88 XUVs
C:0 T:7 15 XUs and 37 XVs -> 2 XUVs
2056 XUVs total
1018 collection wire objects
2056 potential space points
Neighbour search...
53104 tests to find 32756 neighbours
Iterating with no regularization...
Begin: 9.13651e+06
0 8.86028e+06
1 8.84399e+06
2 8.84143e+06
Now with regularization...
Begin: 8.31757e+06
0 8.31675e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 29th record. run: 29107 subRun: 1 event: 146173 at 26-Sep-2024 17:12:31 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 51211 traces, 51211 summary
Retagger: tagging trace set: gauss with 38609 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 38609 traces tagged "gauss"
FrameSaver: q=775208 n=736754 tag=gauss
wclsFrameSaver: saving 51211 traces tagged "wiener"
FrameSaver: q=829390 n=668956 tag=wiener
3377 hits in TPC 0
3513 hits in TPC 1
3753 hits in TPC 2
2305 hits in TPC 3
3071 hits in TPC 4
4469 hits in TPC 5
3278 hits in TPC 6
2444 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 912 XUs and 1087 XVs -> 8 XUVs
C:0 T:2 5803 XUs and 8889 XVs -> 169 XUVs
C:0 T:3 39 XUs and 56 XVs -> 2 XUVs
C:0 T:4 200 XUs and 332 XVs -> 10 XUVs
C:0 T:5 12051 XUs and 12128 XVs -> 662 XUVs
C:0 T:6 5475 XUs and 14218 XVs -> 171 XUVs
C:0 T:7 51 XUs and 173 XVs -> 1 XUVs
1023 XUVs total
580 collection wire objects
1023 potential space points
Neighbour search...
14283 tests to find 8570 neighbours
Iterating with no regularization...
Begin: 1.65106e+06
0 1.51041e+06
1 1.50096e+06
2 1.50021e+06
Now with regularization...
Begin: 1.33572e+06
0 1.33552e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 1 event 146173 TrkackID 0 startx, y, z 208.017 511.302 0.804579 wireno, peakt tpcno 460 2070.67 5 dist 0min T, max_T1381.13 4060.82
no of hits closeby 1 event 146173 TrkackID 0 startx, y, z 208.017 511.302 0.804579 wireno, peakt tpcno 460 2070.67 5 dist 0min T, max_T1381.13 4060.82
Begin processing the 30th record. run: 29107 subRun: 1 event: 146205 at 26-Sep-2024 17:13:55 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 69614 traces, 69614 summary
Retagger: tagging trace set: gauss with 51566 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 51566 traces tagged "gauss"
FrameSaver: q=1.11681e+06 n=928069 tag=gauss
wclsFrameSaver: saving 69614 traces tagged "wiener"
FrameSaver: q=1.21344e+06 n=836792 tag=wiener
2072 hits in TPC 0
3407 hits in TPC 1
5015 hits in TPC 2
2097 hits in TPC 3
4633 hits in TPC 4
10246 hits in TPC 5
6023 hits in TPC 6
3767 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 139 XUs and 639 XVs -> 12 XUVs
C:0 T:2 77871 XUs and 69107 XVs -> 3326 XUVs
C:0 T:3 28 XUs and 34 XVs -> 1 XUVs
C:0 T:4 223 XUs and 317 XVs -> 14 XUVs
C:0 T:5 52889 XUs and 70875 XVs -> 1874 XUVs
C:0 T:6 37745 XUs and 41534 XVs -> 766 XUVs
C:0 T:7 208 XUs and 276 XVs -> 21 XUVs
6014 XUVs total
1966 collection wire objects
6014 potential space points
Neighbour search...
480418 tests to find 223042 neighbours
Iterating with no regularization...
Begin: 1.29015e+07
0 1.14677e+07
1 1.13583e+07
2 1.13417e+07
3 1.13363e+07
Now with regularization...
Begin: 1.0817e+07
0 1.08133e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 17:15:46 BST Closed output file "np04hd_raw_run029107_0608_dataflow5_datawriter_0_20240907T012452_reco_stage1_reco_stage2_20240926T161546_keepup.root"
26-Sep-2024 17:15:46 BST Closed input file "np04hd_raw_run029107_0608_dataflow5_datawriter_0_20240907T012452_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 79.1708 111.088 211.815 105.254 28.3699 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000414282 0.00184101 0.00360256 0.00174281 0.000844637 30
produce:fembfilter:PDHDFEMBFilter 0.673412 0.786766 1.10207 0.685539 0.169929 30
produce:wclsdatahd:WireCellToolkit 47.5504 53.119 75.2542 49.885 7.68151 30
produce:gaushit:GausHitFinder 0.515549 0.887882 1.54514 0.828938 0.268742 30
produce:nhitsfilter:NumberOfHitsFilter 0.000216824 0.000358438 0.000559789 0.000347381 8.05335e-05 30
produce:reco3d:SpacePointSolver 0.141397 0.9641 2.21443 0.775119 0.563944 30
produce:hitpdune:DisambigFromSpacePoints 0.172951 0.734729 2.56657 0.614749 0.490252 30
produce:pandora:StandardPandora 6.45423 17.2401 88.5971 14.019 14.2441 30
produce:pandoraWriter:StandardPandora 0.0879935 0.15669 0.269105 0.149091 0.0423943 30
produce:pandoraTrack:LArPandoraTrackCreation 0.438782 1.24598 2.30955 1.17934 0.435831 30
produce:pandoraShower:LArPandoraShowerCreation 0.466648 1.46672 3.18361 1.39684 0.627095 30
produce:pandoracalo:Calorimetry 0.26947 0.65265 1.19614 0.620542 0.213088 30
produce:pandoracalonosce:Calorimetry 0.232491 0.586452 1.08233 0.558464 0.191694 30
produce:pandorapid:Chi2ParticleID 0.00115866 0.00190013 0.00359038 0.00179248 0.000537417 30
produce:pandoraShowercalo:ShowerCalorimetry 0.427249 1.3888 3.15355 1.28088 0.603477 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.414597 1.35938 3.09926 1.2952 0.587208 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0936389 0.152665 0.304441 0.144986 0.0444218 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0304627 0.0526792 0.111712 0.0477648 0.0173845 30
produce:emtrkmichelid:EmTrackMichelId 15.3209 28.517 51.7947 26.4762 8.91291 30
[art]:TriggerResults:TriggerResultInserter 1.9578e-05 3.09668e-05 9.4356e-05 2.6333e-05 1.32596e-05 30
end_path:out1:RootOutput 8.305e-06 1.01924e-05 3.174e-05 9.1055e-06 4.14853e-06 30
end_path:michelremoving:michelremoving 0.0211918 0.107889 0.667361 0.0493878 0.129844 30
end_path:michelremovinggnocchi:michelremoving 0.0184813 0.103777 0.659249 0.0418513 0.129139 30
end_path:calibanagnocchi:CalibAnaTree 0.20562 0.530512 1.13754 0.481068 0.227168 30
end_path:out1:RootOutput(write) 0.496643 0.94735 1.6468 0.807167 0.327435 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4942.27 MB
Peak resident set size usage (VmHWM): 2601.75 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_0608_dataflow5_datawriter_0_20240907T012452_reco_stage1_reco_stage2_20240926T161546_keepup.root
\tHists: np04hd_raw_run029107_0608_dataflow5_datawriter_0_20240907T012452_reco_stage1_reco_stage2_20240926T161546_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
