Jobsub ID 263791.27@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 263791.27@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3451 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 13:28:40 |
| Site | UK_Sheffield |
| Entry | DUNE_UK_Sheffield_lcgce1 |
| Last heartbeat | 2024-09-26 14:57:08 |
| From worker node | Hostname | wn014.hep |
| cpuinfo | Intel(R) Core(TM) i7-5960X CPU @ 3.00GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 13:34:30 |
| Input files | hd-protodune:np04hd_raw_run029107_2138_dataflow4_datawriter_0_20240908T021726.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 14:57:08 |
| Saved logs | justin-logs:263791.27-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
s
Iterating with no regularization...
Begin: 4.09488e+06
0 3.83336e+06
1 3.82333e+06
2 3.82241e+06
Now with regularization...
Begin: 3.58667e+06
0 3.5861e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 29th record. run: 29107 subRun: 1 event: 513388 at 26-Sep-2024 15:53:31 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 73126 traces, 73126 summary
Retagger: tagging trace set: gauss with 56156 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 56156 traces tagged "gauss"
FrameSaver: q=1.21058e+06 n=1069143 tag=gauss
wclsFrameSaver: saving 73126 traces tagged "wiener"
FrameSaver: q=1.27891e+06 n=976164 tag=wiener
3343 hits in TPC 0
4437 hits in TPC 1
6685 hits in TPC 2
3895 hits in TPC 3
5902 hits in TPC 4
9578 hits in TPC 5
2285 hits in TPC 6
2139 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 241 XUs and 204 XVs -> 5 XUVs
C:0 T:2 12063 XUs and 16022 XVs -> 1513 XUVs
C:0 T:3 86 XUs and 133 XVs -> 3 XUVs
C:0 T:4 177 XUs and 205 XVs -> 12 XUVs
C:0 T:5 37109 XUs and 32744 XVs -> 668 XUVs
C:0 T:6 3990 XUs and 3868 XVs -> 162 XUVs
C:0 T:7 509 XUs and 467 XVs -> 26 XUVs
2389 XUVs total
1444 collection wire objects
2389 potential space points
Neighbour search...
28769 tests to find 16752 neighbours
Iterating with no regularization...
Begin: 6.63007e+06
0 6.32921e+06
1 6.30873e+06
2 6.30638e+06
Now with regularization...
Begin: 5.65763e+06
0 5.65696e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 513388 TrkackID 22 startx, y, z 53.2064 597.656 76.9619 wireno, peakt tpcno 172 1203.18 2 dist 141.838min T, max_T11.6694 1242.71
no of hits closeby 0 event 513388 TrkackID 22 startx, y, z 53.2064 597.656 76.9619 wireno, peakt tpcno 172 1203.18 2 dist 141.838min T, max_T11.6694 1242.71
Begin processing the 30th record. run: 29107 subRun: 1 event: 513396 at 26-Sep-2024 15:55:17 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 53437 traces, 53437 summary
Retagger: tagging trace set: gauss with 41243 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 41243 traces tagged "gauss"
FrameSaver: q=894790 n=804022 tag=gauss
wclsFrameSaver: saving 53437 traces tagged "wiener"
FrameSaver: q=945174 n=729354 tag=wiener
4175 hits in TPC 0
3955 hits in TPC 1
4426 hits in TPC 2
2186 hits in TPC 3
2443 hits in TPC 4
4965 hits in TPC 5
3815 hits in TPC 6
2902 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 38 XUs and 40 XVs -> 0 XUVs
C:0 T:1 514 XUs and 1337 XVs -> 64 XUVs
C:0 T:2 12861 XUs and 6684 XVs -> 189 XUVs
C:0 T:3 488 XUs and 338 XVs -> 25 XUVs
C:0 T:4 32 XUs and 26 XVs -> 0 XUVs
C:0 T:5 13409 XUs and 7220 XVs -> 303 XUVs
C:0 T:6 7160 XUs and 9132 XVs -> 500 XUVs
C:0 T:7 26 XUs and 38 XVs -> 1 XUVs
1082 XUVs total
799 collection wire objects
1082 potential space points
Neighbour search...
9724 tests to find 5624 neighbours
Iterating with no regularization...
Begin: 4.63203e+06
0 4.47093e+06
1 4.46852e+06
Now with regularization...
Begin: 4.15091e+06
0 4.15084e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 513396 TrkackID 19 startx, y, z 33.0123 263.225 42.0167 wireno, peakt tpcno 167 363.541 2 dist 47.0252min T, max_T4.25192 395.558
no of hits closeby 0 event 513396 TrkackID 19 startx, y, z 33.0123 263.225 42.0167 wireno, peakt tpcno 167 363.541 2 dist 47.0252min T, max_T4.25192 395.558
26-Sep-2024 15:56:47 BST Closed output file "np04hd_raw_run029107_2138_dataflow4_datawriter_0_20240908T021726_reco_stage1_reco_stage2_20240926T145647_keepup.root"
26-Sep-2024 15:56:47 BST Closed input file "np04hd_raw_run029107_2138_dataflow4_datawriter_0_20240908T021726_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 77.9209 101.294 137.393 98.5483 15.1064 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000300795 0.00159729 0.00287816 0.00175348 0.000687493 30
produce:fembfilter:PDHDFEMBFilter 0.495718 0.530233 0.670268 0.53604 0.0324592 30
produce:wclsdatahd:WireCellToolkit 49.6531 52.504 55.4663 52.6728 1.84273 30
produce:gaushit:GausHitFinder 0.35572 0.62464 0.993231 0.61287 0.148153 30
produce:nhitsfilter:NumberOfHitsFilter 0.000130283 0.000274084 0.000516224 0.000277874 9.2476e-05 30
produce:reco3d:SpacePointSolver 0.11729 0.735394 2.45702 0.54342 0.60551 30
produce:hitpdune:DisambigFromSpacePoints 0.197088 0.560265 2.02369 0.482116 0.368487 30
produce:pandora:StandardPandora 4.50232 12.0987 29.4204 10.7453 5.74179 30
produce:pandoraWriter:StandardPandora 0.0713383 0.11925 0.1763 0.119989 0.0287199 30
produce:pandoraTrack:LArPandoraTrackCreation 0.471673 1.19312 2.57255 1.10557 0.478973 30
produce:pandoraShower:LArPandoraShowerCreation 0.508715 1.41383 3.94975 1.32055 0.734172 30
produce:pandoracalo:Calorimetry 0.275814 0.633199 1.34024 0.601923 0.233139 30
produce:pandoracalonosce:Calorimetry 0.249401 0.590225 1.24058 0.560321 0.220921 30
produce:pandorapid:Chi2ParticleID 0.000834725 0.00145666 0.0028771 0.00136136 0.000393946 30
produce:pandoraShowercalo:ShowerCalorimetry 0.480826 1.4365 3.95123 1.37547 0.764939 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.472471 1.39718 3.7843 1.35327 0.745529 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0658104 0.108138 0.17155 0.108219 0.0246577 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0227619 0.0370628 0.0600717 0.0366894 0.00856742 30
produce:emtrkmichelid:EmTrackMichelId 17.7196 25.9085 37.4664 25.1157 5.13724 30
[art]:TriggerResults:TriggerResultInserter 1.6796e-05 2.66396e-05 7.1379e-05 2.401e-05 9.46711e-06 30
end_path:out1:RootOutput 3.435e-06 1.22575e-05 0.000218587 4.609e-06 3.84288e-05 30
end_path:michelremoving:michelremoving 0.0262874 0.0865297 0.288443 0.0397941 0.072767 30
end_path:michelremovinggnocchi:michelremoving 0.024319 0.0768576 0.235267 0.0362891 0.065229 30
end_path:calibanagnocchi:CalibAnaTree 0.19582 0.525313 1.10421 0.485293 0.191975 30
end_path:out1:RootOutput(write) 0.448837 0.628197 0.902596 0.61554 0.116048 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4913.42 MB
Peak resident set size usage (VmHWM): 2322.09 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_2138_dataflow4_datawriter_0_20240908T021726_reco_stage1_reco_stage2_20240926T145647_keepup.root
\tHists: np04hd_raw_run029107_2138_dataflow4_datawriter_0_20240908T021726_reco_stage1_reco_stage2_20240926T145647_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
