Jobsub ID 263940.72@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 263940.72@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3448 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 14:25:09 |
| Site | UK_Sheffield |
| Entry | DUNE_UK_Sheffield_lcgce1 |
| Last heartbeat | 2024-09-26 15:50:02 |
| From worker node | Hostname | wn093.hep |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2640 v4 @ 2.40GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 14:26:48 |
| Input files | hd-protodune:np04hd_raw_run029097_0007_dataflow4_datawriter_0_20240906T102425.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 15:50:02 |
| Saved logs | justin-logs:263940.72-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
Neighbour search...
12791 tests to find 7338 neighbours
Iterating with no regularization...
Begin: 6.77499e+06
0 6.55986e+06
1 6.55498e+06
Now with regularization...
Begin: 6.23281e+06
0 6.23222e+06
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 29th record. run: 29097 subRun: 1 event: 1908 at 26-Sep-2024 16:45:59 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 66669 traces, 66669 summary
Retagger: tagging trace set: gauss with 49633 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 49633 traces tagged "gauss"
FrameSaver: q=1.06428e+06 n=933396 tag=gauss
wclsFrameSaver: saving 66669 traces tagged "wiener"
FrameSaver: q=1.14672e+06 n=846757 tag=wiener
6184 hits in TPC 0
4448 hits in TPC 1
8672 hits in TPC 2
5302 hits in TPC 3
1482 hits in TPC 4
3768 hits in TPC 5
3355 hits in TPC 6
2794 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 6152 XUs and 8237 XVs -> 651 XUVs
C:0 T:2 34847 XUs and 38058 XVs -> 1162 XUVs
C:0 T:3 305 XUs and 378 XVs -> 18 XUVs
C:0 T:4 148 XUs and 249 XVs -> 11 XUVs
C:0 T:5 4804 XUs and 9633 XVs -> 429 XUVs
C:0 T:6 7496 XUs and 6192 XVs -> 183 XUVs
C:0 T:7 200 XUs and 393 XVs -> 6 XUVs
2460 XUVs total
1208 collection wire objects
2460 potential space points
Neighbour search...
119390 tests to find 67906 neighbours
Iterating with no regularization...
Begin: 5.79439e+06
0 5.2856e+06
1 5.25689e+06
2 5.2538e+06
Now with regularization...
Begin: 4.8956e+06
0 4.89457e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 1908 TrkackID 0 startx, y, z -307.506 256.84 70.1686 wireno, peakt tpcno 197 1070 2 dist 0min T, max_T9.69125 3890.5
no of hits closeby 0 event 1908 TrkackID 0 startx, y, z -307.506 256.84 70.1686 wireno, peakt tpcno 197 1070 2 dist 0min T, max_T9.69125 3890.5
Begin processing the 30th record. run: 29097 subRun: 1 event: 1916 at 26-Sep-2024 16:47:57 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 54624 traces, 54624 summary
Retagger: tagging trace set: gauss with 40343 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 40343 traces tagged "gauss"
FrameSaver: q=883742 n=752452 tag=gauss
wclsFrameSaver: saving 54624 traces tagged "wiener"
FrameSaver: q=945849 n=680730 tag=wiener
3265 hits in TPC 0
2548 hits in TPC 1
4225 hits in TPC 2
2659 hits in TPC 3
2444 hits in TPC 4
6327 hits in TPC 5
4637 hits in TPC 6
2629 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 15 XUs and 78 XVs -> 0 XUVs
C:0 T:1 1743 XUs and 1409 XVs -> 22 XUVs
C:0 T:2 8149 XUs and 11926 XVs -> 404 XUVs
C:0 T:3 79 XUs and 150 XVs -> 1 XUVs
C:0 T:4 884 XUs and 884 XVs -> 35 XUVs
C:0 T:5 17641 XUs and 13213 XVs -> 207 XUVs
C:0 T:6 11733 XUs and 14429 XVs -> 356 XUVs
C:0 T:7 193 XUs and 416 XVs -> 8 XUVs
1033 XUVs total
698 collection wire objects
1033 potential space points
Neighbour search...
12309 tests to find 7534 neighbours
Iterating with no regularization...
Begin: 4.09493e+06
0 3.84378e+06
1 3.82721e+06
2 3.82629e+06
Now with regularization...
Begin: 3.6355e+06
0 3.6353e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 16:49:40 BST Closed output file "np04hd_raw_run029097_0007_dataflow4_datawriter_0_20240906T102425_reco_stage1_reco_stage2_20240926T154940_keepup.root"
26-Sep-2024 16:49:40 BST Closed input file "np04hd_raw_run029097_0007_dataflow4_datawriter_0_20240906T102425_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 76.3034 108.505 137.525 109.976 12.8282 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000446404 0.00212057 0.00354426 0.0021929 0.000727841 30
produce:fembfilter:PDHDFEMBFilter 0.65193 0.727591 0.768683 0.753953 0.0388946 30
produce:wclsdatahd:WireCellToolkit 48.9628 53.9139 55.2583 54.1489 1.225 30
produce:gaushit:GausHitFinder 0.432669 0.738245 1.11444 0.730445 0.169336 30
produce:nhitsfilter:NumberOfHitsFilter 0.000166098 0.000320297 0.000510482 0.000329331 7.30204e-05 30
produce:reco3d:SpacePointSolver 0.159271 0.847329 2.29775 0.782186 0.502913 30
produce:hitpdune:DisambigFromSpacePoints 0.154065 0.538387 1.05753 0.527219 0.225122 30
produce:pandora:StandardPandora 4.60235 12.9338 21.808 12.9506 4.41484 30
produce:pandoraWriter:StandardPandora 0.0745085 0.146472 0.21817 0.149225 0.0300396 30
produce:pandoraTrack:LArPandoraTrackCreation 0.675206 1.25112 2.15515 1.29997 0.376721 30
produce:pandoraShower:LArPandoraShowerCreation 0.440364 1.50394 2.52458 1.57172 0.494504 30
produce:pandoracalo:Calorimetry 0.354228 0.682332 1.09698 0.693534 0.18844 30
produce:pandoracalonosce:Calorimetry 0.316469 0.621204 0.999347 0.641089 0.172066 30
produce:pandorapid:Chi2ParticleID 0.0014318 0.00194178 0.00296928 0.00196616 0.000338391 30
produce:pandoraShowercalo:ShowerCalorimetry 0.384577 1.48943 2.5218 1.56986 0.494015 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.388449 1.45867 2.41962 1.55327 0.479184 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0736976 0.1339 0.170991 0.132401 0.0223055 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0242092 0.0483116 0.0615277 0.0481066 0.00824947 30
produce:emtrkmichelid:EmTrackMichelId 13.4744 29.9296 43.4206 30.1581 6.12765 30
[art]:TriggerResults:TriggerResultInserter 2.1322e-05 3.06402e-05 9.1166e-05 2.695e-05 1.27878e-05 30
end_path:out1:RootOutput 8.438e-06 1.02353e-05 2.7962e-05 9.249e-06 3.48872e-06 30
end_path:michelremoving:michelremoving 0.0271506 0.0658739 0.18751 0.042424 0.0474272 30
end_path:michelremovinggnocchi:michelremoving 0.024579 0.0618221 0.187166 0.0375194 0.0477646 30
end_path:calibanagnocchi:CalibAnaTree 0.29761 0.535308 0.898151 0.576251 0.165484 30
end_path:out1:RootOutput(write) 0.425915 0.785889 1.12227 0.795391 0.151343 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4925 MB
Peak resident set size usage (VmHWM): 2335.51 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029097_0007_dataflow4_datawriter_0_20240906T102425_reco_stage1_reco_stage2_20240926T154940_keepup.root
\tHists: np04hd_raw_run029097_0007_dataflow4_datawriter_0_20240906T102425_reco_stage1_reco_stage2_20240926T154940_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
