Jobsub ID 79065.0@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 79065.0@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3460 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 14:17:01 |
| Site | UK_Manchester |
| Entry | UBoone_T2_UK_Manchester_ce01 |
| Last heartbeat | 2024-09-26 16:15:29 |
| From worker node | Hostname | wn1906240.tier2.hep.manchester.ac.uk |
| cpuinfo | Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 14:19:39 |
| Input files | hd-protodune:np04hd_raw_run029218_0100_dataflow7_datawriter_0_20240917T165336.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 16:15:29 |
| Saved logs | justin-logs:79065.0-justin-prod-sched02.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 3 event 25031 TrkackID 12 startx, y, z 100.205 608.249 460.57 wireno, peakt tpcno 389 3737.05 5 dist 0min T, max_T2679 4063.49
no of hits closeby 3 event 25031 TrkackID 12 startx, y, z 100.205 608.249 460.57 wireno, peakt tpcno 389 3737.05 5 dist 0min T, max_T2679 4063.49
Begin processing the 30th record. run: 29218 subRun: 1 event: 25039 at 26-Sep-2024 17:11:04 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 54896 traces, 54896 summary
Retagger: tagging trace set: gauss with 42216 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 42216 traces tagged "gauss"
FrameSaver: q=920431 n=801529 tag=gauss
wclsFrameSaver: saving 54896 traces tagged "wiener"
FrameSaver: q=979571 n=727619 tag=wiener
1697 hits in TPC 0
2055 hits in TPC 1
3322 hits in TPC 2
2815 hits in TPC 3
3619 hits in TPC 4
7449 hits in TPC 5
5161 hits in TPC 6
2975 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 279 XUs and 59 XVs -> 3 XUVs
C:0 T:2 8191 XUs and 6607 XVs -> 432 XUVs
C:0 T:3 10 XUs and 11 XVs -> 1 XUVs
C:0 T:4 121 XUs and 133 XVs -> 5 XUVs
C:0 T:5 25815 XUs and 16356 XVs -> 471 XUVs
C:0 T:6 20146 XUs and 9427 XVs -> 406 XUVs
C:0 T:7 34 XUs and 20 XVs -> 0 XUVs
1318 XUVs total
841 collection wire objects
1318 potential space points
Neighbour search...
18490 tests to find 11188 neighbours
Iterating with no regularization...
Begin: 6.09221e+06
0 5.82001e+06
1 5.80695e+06
2 5.80495e+06
Now with regularization...
Begin: 5.44034e+06
0 5.43991e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 31st record. run: 29218 subRun: 1 event: 25047 at 26-Sep-2024 17:12:59 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 68142 traces, 68142 summary
Retagger: tagging trace set: gauss with 50951 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 50951 traces tagged "gauss"
FrameSaver: q=1.18004e+06 n=959914 tag=gauss
wclsFrameSaver: saving 68142 traces tagged "wiener"
FrameSaver: q=1.25453e+06 n=867053 tag=wiener
1940 hits in TPC 0
1604 hits in TPC 1
6212 hits in TPC 2
3831 hits in TPC 3
4080 hits in TPC 4
5424 hits in TPC 5
6649 hits in TPC 6
6416 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 35 XUs and 0 XVs -> 0 XUVs
C:0 T:1 600 XUs and 273 XVs -> 18 XUVs
C:0 T:2 20431 XUs and 31131 XVs -> 928 XUVs
C:0 T:3 59 XUs and 60 XVs -> 2 XUVs
C:0 T:4 129 XUs and 152 XVs -> 2 XUVs
C:0 T:5 12625 XUs and 9771 XVs -> 418 XUVs
C:0 T:6 21670 XUs and 45270 XVs -> 1725 XUVs
C:0 T:7 164 XUs and 209 XVs -> 9 XUVs
3102 XUVs total
1563 collection wire objects
3102 potential space points
Neighbour search...
113260 tests to find 60088 neighbours
Iterating with no regularization...
Begin: 8.86467e+06
0 8.04688e+06
1 7.99406e+06
2 7.9902e+06
Now with regularization...
Begin: 7.60807e+06
0 7.60685e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 5 event 25047 TrkackID 8 startx, y, z 15.2035 591.132 395.583 wireno, peakt tpcno 437 1526.46 5 dist 7.37667min T, max_T1468.28 2258.06
no of hits closeby 0 event 25047 TrkackID 20 startx, y, z 21.485 590.796 297.157 wireno, peakt tpcno 146 7 5 dist 0min T, max_T7 1330
no of hits closeby 5 event 25047 TrkackID 8 startx, y, z 15.2035 591.132 395.583 wireno, peakt tpcno 437 1526.46 5 dist 7.37667min T, max_T1468.28 2258.06
no of hits closeby 0 event 25047 TrkackID 20 startx, y, z 21.485 590.796 297.157 wireno, peakt tpcno 146 7 5 dist 0min T, max_T7 1330
26-Sep-2024 17:14:59 BST Closed output file "np04hd_raw_run029218_0100_dataflow7_datawriter_0_20240917T165336_reco_stage1_reco_stage2_20240926T161459_keepup.root"
26-Sep-2024 17:14:59 BST Closed input file "np04hd_raw_run029218_0100_dataflow7_datawriter_0_20240917T165336_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 99.1851 146.58 218.005 136.716 32.6544 31
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000727239 0.00290602 0.00477125 0.00313029 0.00112602 31
produce:fembfilter:PDHDFEMBFilter 0.70913 1.11896 1.60551 1.06894 0.190146 31
produce:wclsdatahd:WireCellToolkit 51.3134 64.7131 85.5581 64.8708 6.94579 31
produce:gaushit:GausHitFinder 0.550147 1.20609 2.22471 1.10833 0.38283 31
produce:nhitsfilter:NumberOfHitsFilter 0.000329252 0.00451072 0.109778 0.000502651 0.019362 31
produce:reco3d:SpacePointSolver 0.194288 1.28391 7.57077 0.905219 1.34101 31
produce:hitpdune:DisambigFromSpacePoints 0.266408 0.999248 2.15359 0.919899 0.484219 31
produce:pandora:StandardPandora 7.12767 18.6246 43.5598 15.2396 8.51271 31
produce:pandoraWriter:StandardPandora 0.121956 0.245005 0.451838 0.229067 0.0751623 31
produce:pandoraTrack:LArPandoraTrackCreation 0.892292 2.93874 5.7707 2.57534 1.33435 31
produce:pandoraShower:LArPandoraShowerCreation 1.10276 3.73897 8.66486 2.91238 2.18275 31
produce:pandoracalo:Calorimetry 0.396894 1.24212 2.55565 1.17165 0.54807 31
produce:pandoracalonosce:Calorimetry 0.270139 1.17098 2.47986 1.07721 0.557082 31
produce:pandorapid:Chi2ParticleID 0.00125321 0.00289065 0.00737334 0.00276455 0.00113441 31
produce:pandoraShowercalo:ShowerCalorimetry 0.606187 3.14752 7.62218 2.51379 1.89993 31
produce:pandoraShowercalonosce:ShowerCalorimetry 0.861583 3.01317 7.10032 2.3704 1.83269 31
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0990937 0.213853 0.35169 0.215273 0.0679825 31
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0358567 0.0828857 0.142179 0.0824838 0.0281975 31
produce:emtrkmichelid:EmTrackMichelId 24.9978 39.9305 60.7415 37.4557 10.1342 31
[art]:TriggerResults:TriggerResultInserter 4.6686e-05 6.7702e-05 0.000170309 6.3525e-05 2.03654e-05 31
end_path:out1:RootOutput 1.1924e-05 1.84421e-05 4.6385e-05 1.739e-05 6.30342e-06 31
end_path:michelremoving:michelremoving 0.0439697 0.196882 0.619699 0.105458 0.177553 31
end_path:michelremovinggnocchi:michelremoving 0.0344816 0.191732 0.604127 0.105539 0.176431 31
end_path:calibanagnocchi:CalibAnaTree 0.386149 1.052 1.95391 1.02351 0.446247 31
end_path:out1:RootOutput(write) 0.651067 1.27406 2.30765 1.19771 0.337516 31
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4925.94 MB
Peak resident set size usage (VmHWM): 2598.32 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029218_0100_dataflow7_datawriter_0_20240917T165336_reco_stage1_reco_stage2_20240926T161459_keepup.root
\tHists: np04hd_raw_run029218_0100_dataflow7_datawriter_0_20240917T165336_reco_stage1_reco_stage2_20240926T161459_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
