Jobsub ID 263757.132@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 263757.132@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3448 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 13:23:33 |
| Site | UK_Durham |
| Entry | DUNE_UK_SGridDurham_ce4 |
| Last heartbeat | 2024-09-26 15:04:13 |
| From worker node | Hostname | n177.dur.scotgrid.ac.uk |
| cpuinfo | Intel(R) Xeon(R) Gold 5220 CPU @ 2.20GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 13:25:43 |
| Input files | hd-protodune:np04hd_raw_run029097_0078_dataflow0_datawriter_0_20240906T115613.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 15:04:13 |
| Saved logs | justin-logs:263757.132-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
s -> 12 XUVs
3180 XUVs total
1294 collection wire objects
3180 potential space points
Neighbour search...
136458 tests to find 81154 neighbours
Iterating with no regularization...
Begin: 6.23728e+06
0 5.59763e+06
1 5.54905e+06
2 5.5426e+06
3 5.5407e+06
Now with regularization...
Begin: 5.24601e+06
0 5.24487e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 28th record. run: 29097 subRun: 1 event: 18944 at 26-Sep-2024 15:58:26 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 108860 traces, 108860 summary
Retagger: tagging trace set: gauss with 110598 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 110598 traces tagged "gauss"
FrameSaver: q=3.2133e+07 n=4024108 tag=gauss
wclsFrameSaver: saving 108860 traces tagged "wiener"
FrameSaver: q=5.22219e+07 n=4533189 tag=wiener
33423 hits in TPC 0
Begin processing the 29th record. run: 29097 subRun: 1 event: 18968 at 26-Sep-2024 15:59:45 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 65279 traces, 65279 summary
Retagger: tagging trace set: gauss with 47492 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 47492 traces tagged "gauss"
FrameSaver: q=918042 n=834099 tag=gauss
wclsFrameSaver: saving 65279 traces tagged "wiener"
FrameSaver: q=1.00175e+06 n=750586 tag=wiener
2245 hits in TPC 0
2456 hits in TPC 1
5795 hits in TPC 2
1934 hits in TPC 3
2933 hits in TPC 4
8018 hits in TPC 5
6718 hits in TPC 6
2795 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 398 XUs and 138 XVs -> 9 XUVs
C:0 T:2 23363 XUs and 27286 XVs -> 691 XUVs
C:0 T:3 34 XUs and 33 XVs -> 0 XUVs
C:0 T:4 22 XUs and 103 XVs -> 1 XUVs
C:0 T:5 38331 XUs and 54612 XVs -> 2424 XUVs
C:0 T:6 27199 XUs and 34205 XVs -> 1300 XUVs
C:0 T:7 91 XUs and 79 XVs -> 7 XUVs
4432 XUVs total
1299 collection wire objects
4432 potential space points
Neighbour search...
556590 tests to find 258876 neighbours
Iterating with no regularization...
Begin: 6.98961e+06
0 6.54457e+06
1 6.51726e+06
2 6.51221e+06
Now with regularization...
Begin: 6.20281e+06
0 6.20089e+06
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 30th record. run: 29097 subRun: 1 event: 18976 at 26-Sep-2024 16:01:35 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 68795 traces, 68795 summary
Retagger: tagging trace set: gauss with 50367 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 50367 traces tagged "gauss"
FrameSaver: q=1.09866e+06 n=938779 tag=gauss
wclsFrameSaver: saving 68795 traces tagged "wiener"
FrameSaver: q=1.18622e+06 n=845461 tag=wiener
1890 hits in TPC 0
1895 hits in TPC 1
7678 hits in TPC 2
4947 hits in TPC 3
2186 hits in TPC 4
4041 hits in TPC 5
7322 hits in TPC 6
5814 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 5 XUs and 0 XVs -> 0 XUVs
C:0 T:2 25156 XUs and 40619 XVs -> 1350 XUVs
C:0 T:3 33 XUs and 98 XVs -> 3 XUVs
C:0 T:4 208 XUs and 263 XVs -> 14 XUVs
C:0 T:5 10885 XUs and 34938 XVs -> 905 XUVs
C:0 T:6 26486 XUs and 36646 XVs -> 1006 XUVs
C:0 T:7 125 XUs and 158 XVs -> 5 XUVs
3283 XUVs total
1410 collection wire objects
3283 potential space points
Neighbour search...
123865 tests to find 70768 neighbours
Iterating with no regularization...
Begin: 7.0014e+06
0 6.37721e+06
1 6.31968e+06
2 6.31394e+06
Now with regularization...
Begin: 5.95966e+06
0 5.95776e+06
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 16:03:45 BST Closed output file "np04hd_raw_run029097_0078_dataflow0_datawriter_0_20240906T115613_reco_stage1_reco_stage2_20240926T150345_keepup.root"
26-Sep-2024 16:03:45 BST Closed input file "np04hd_raw_run029097_0078_dataflow0_datawriter_0_20240906T115613_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 74.9744 100.81 148.451 95.4786 20.25 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000366784 0.00171104 0.00432877 0.00143962 0.00108997 30
produce:fembfilter:PDHDFEMBFilter 0.698302 0.832162 1.10491 0.714819 0.165512 30
produce:wclsdatahd:WireCellToolkit 43.6965 51.748 69.9849 48.8263 7.53577 30
produce:gaushit:GausHitFinder 0.50867 1.05771 6.31637 0.85745 1.00552 30
produce:nhitsfilter:NumberOfHitsFilter 0.000288082 0.000489708 0.00277707 0.000400273 0.000435716 30
produce:reco3d:SpacePointSolver 0.221933 1.21505 2.25417 1.31607 0.656569 29
produce:hitpdune:DisambigFromSpacePoints 0.244475 0.63771 1.19669 0.556896 0.275111 29
produce:pandora:StandardPandora 6.63663 13.803 27.1873 13.017 5.5219 29
produce:pandoraWriter:StandardPandora 0.0948422 0.18218 0.317777 0.181238 0.0501702 29
produce:pandoraTrack:LArPandoraTrackCreation 0.508191 2.2741 4.53337 2.17618 1.01003 29
produce:pandoraShower:LArPandoraShowerCreation 0.688179 2.65088 5.49196 1.93747 1.42788 29
produce:pandoracalo:Calorimetry 0.290391 0.939056 1.86928 0.838978 0.422119 29
produce:pandoracalonosce:Calorimetry 0.245237 0.871419 1.69562 0.779053 0.40154 29
produce:pandorapid:Chi2ParticleID 0.00127742 0.00217904 0.00352325 0.00204183 0.000591369 29
produce:pandoraShowercalo:ShowerCalorimetry 0.494175 2.07329 4.46099 1.52831 1.12444 29
produce:pandoraShowercalonosce:ShowerCalorimetry 0.479735 2.09776 4.38424 1.57247 1.13501 29
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0816214 0.160574 0.28012 0.141011 0.0556139 29
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0333293 0.0630781 0.110331 0.0569035 0.0232208 29
produce:emtrkmichelid:EmTrackMichelId 12.8383 19.74 35.0811 17.9593 5.07219 29
[art]:TriggerResults:TriggerResultInserter 2.858e-05 4.70146e-05 6.5676e-05 4.5067e-05 1.00288e-05 30
end_path:out1:RootOutput 8.351e-06 1.41009e-05 2.7775e-05 1.30135e-05 4.46924e-06 30
end_path:michelremoving:michelremoving 4.5856e-05 0.0917219 0.34703 0.0575253 0.0890307 30
end_path:michelremovinggnocchi:michelremoving 3.2213e-05 0.0849377 0.337167 0.0515423 0.0823317 30
end_path:calibanagnocchi:CalibAnaTree 2.6642e-05 0.653769 1.74426 0.528105 0.376591 30
end_path:out1:RootOutput(write) 0.563801 0.995057 2.00098 0.828814 0.387871 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5871.12 MB
Peak resident set size usage (VmHWM): 2848.03 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029097_0078_dataflow0_datawriter_0_20240906T115613_reco_stage1_reco_stage2_20240926T150345_keepup.root
\tHists: np04hd_raw_run029097_0078_dataflow0_datawriter_0_20240906T115613_reco_stage1_reco_stage2_20240926T150345_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
