Jobsub ID 263763.88@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 263763.88@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3448 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 13:24:49 |
| Site | UK_Sheffield |
| Entry | DUNE_UK_Sheffield_lcgce1 |
| Last heartbeat | 2024-09-26 14:25:32 |
| From worker node | Hostname | wn035.hep |
| cpuinfo | AMD EPYC 7352 24-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 13:26:12 |
| Input files | hd-protodune:np04hd_raw_run029094_0065_dataflow0_datawriter_0_20240906T090447.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 14:25:32 |
| Saved logs | justin-logs:263763.88-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
and 4898 XVs -> 344 XUVs
C:0 T:7 128 XUs and 73 XVs -> 13 XUVs
3590 XUVs total
1161 collection wire objects
3590 potential space points
Neighbour search...
142144 tests to find 83340 neighbours
Iterating with no regularization...
Begin: 1.76966e+07
0 1.67557e+07
1 1.66693e+07
2 1.66576e+07
Now with regularization...
Begin: 1.61929e+07
0 1.61882e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 29th record. run: 29094 subRun: 1 event: 15840 at 26-Sep-2024 15:23:04 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 73007 traces, 73007 summary
Retagger: tagging trace set: gauss with 52600 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 52600 traces tagged "gauss"
FrameSaver: q=1.11673e+06 n=982851 tag=gauss
wclsFrameSaver: saving 73007 traces tagged "wiener"
FrameSaver: q=1.19659e+06 n=878845 tag=wiener
4580 hits in TPC 0
4087 hits in TPC 1
8380 hits in TPC 2
4618 hits in TPC 3
2912 hits in TPC 4
6224 hits in TPC 5
3867 hits in TPC 6
2346 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 342 XUs and 525 XVs -> 19 XUVs
C:0 T:2 23529 XUs and 36746 XVs -> 2698 XUVs
C:0 T:3 631 XUs and 955 XVs -> 29 XUVs
C:0 T:4 45 XUs and 92 XVs -> 9 XUVs
C:0 T:5 13508 XUs and 21068 XVs -> 414 XUVs
C:0 T:6 11692 XUs and 22338 XVs -> 978 XUVs
C:0 T:7 51 XUs and 67 XVs -> 3 XUVs
4150 XUVs total
1503 collection wire objects
4150 potential space points
Neighbour search...
204778 tests to find 124476 neighbours
Iterating with no regularization...
Begin: 5.56787e+06
0 4.96719e+06
1 4.9156e+06
2 4.90691e+06
3 4.90419e+06
Now with regularization...
Begin: 4.37231e+06
0 4.37046e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 30th record. run: 29094 subRun: 1 event: 15848 at 26-Sep-2024 15:24:12 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 57206 traces, 57206 summary
Retagger: tagging trace set: gauss with 41878 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 41878 traces tagged "gauss"
FrameSaver: q=924877 n=796659 tag=gauss
wclsFrameSaver: saving 57206 traces tagged "wiener"
FrameSaver: q=987348 n=724689 tag=wiener
3632 hits in TPC 0
2945 hits in TPC 1
2994 hits in TPC 2
2503 hits in TPC 3
3624 hits in TPC 4
7091 hits in TPC 5
3669 hits in TPC 6
3386 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 745 XUs and 621 XVs -> 22 XUVs
C:0 T:2 8628 XUs and 10290 XVs -> 174 XUVs
C:0 T:3 27 XUs and 47 XVs -> 4 XUVs
C:0 T:4 165 XUs and 148 XVs -> 9 XUVs
C:0 T:5 29278 XUs and 25588 XVs -> 517 XUVs
C:0 T:6 6431 XUs and 5045 XVs -> 211 XUVs
C:0 T:7 223 XUs and 315 XVs -> 13 XUVs
950 XUVs total
650 collection wire objects
950 potential space points
Neighbour search...
8136 tests to find 5210 neighbours
Iterating with no regularization...
Begin: 4.39337e+06
0 4.26098e+06
1 4.25362e+06
2 4.25232e+06
Now with regularization...
Begin: 4.01443e+06
0 4.01429e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 15848 TrkackID 3 startx, y, z 176.511 239.951 459.485 wireno, peakt tpcno 205 1962.83 5 dist 0min T, max_T950.796 3173
no of hits closeby 2 event 15848 TrkackID 13 startx, y, z -56.0832 268.701 120.936 wireno, peakt tpcno 324 431.527 2 dist 1.7355min T, max_T5.95273 733.478
no of hits closeby 0 event 15848 TrkackID 3 startx, y, z 176.511 239.951 459.485 wireno, peakt tpcno 205 1962.83 5 dist 0min T, max_T950.796 3173
no of hits closeby 2 event 15848 TrkackID 13 startx, y, z -56.0832 268.701 120.936 wireno, peakt tpcno 324 431.527 2 dist 1.7355min T, max_T5.95273 733.478
26-Sep-2024 15:25:11 BST Closed output file "np04hd_raw_run029094_0065_dataflow0_datawriter_0_20240906T090447_reco_stage1_reco_stage2_20240926T142511_keepup.root"
26-Sep-2024 15:25:11 BST Closed input file "np04hd_raw_run029094_0065_dataflow0_datawriter_0_20240906T090447_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 47.6997 68.2559 88.7654 67.4461 10.0583 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000301085 0.00139732 0.00219362 0.00146108 0.000480432 30
produce:fembfilter:PDHDFEMBFilter 0.511592 0.520397 0.584693 0.517295 0.0132854 30
produce:wclsdatahd:WireCellToolkit 27.9236 34.1308 44.0253 34.8117 3.20168 30
produce:gaushit:GausHitFinder 0.279813 0.548456 2.30073 0.482613 0.345283 30
produce:nhitsfilter:NumberOfHitsFilter 0.000180173 0.000305172 0.00102908 0.000278851 0.000145945 30
produce:reco3d:SpacePointSolver 0.116943 0.401853 1.33425 0.361039 0.272807 29
produce:hitpdune:DisambigFromSpacePoints 0.109041 0.309473 0.600256 0.267004 0.141385 29
produce:pandora:StandardPandora 3.75912 8.05629 15.6873 7.4071 3.24979 29
produce:pandoraWriter:StandardPandora 0.0645732 0.110445 0.173919 0.107302 0.0236804 29
produce:pandoraTrack:LArPandoraTrackCreation 0.342473 0.736213 1.35092 0.70978 0.249313 29
produce:pandoraShower:LArPandoraShowerCreation 0.390451 0.888445 2.14073 0.815561 0.382226 29
produce:pandoracalo:Calorimetry 0.193232 0.394401 0.744204 0.398623 0.121553 29
produce:pandoracalonosce:Calorimetry 0.165715 0.354024 0.660826 0.347043 0.110949 29
produce:pandorapid:Chi2ParticleID 0.000949652 0.00133901 0.00261008 0.00130701 0.000306525 29
produce:pandoraShowercalo:ShowerCalorimetry 0.357611 0.835263 1.87322 0.778627 0.349482 29
produce:pandoraShowercalonosce:ShowerCalorimetry 0.34745 0.813773 1.85754 0.771593 0.344172 29
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0637171 0.102707 0.162741 0.0984618 0.0214826 29
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.022914 0.0359459 0.0543644 0.03557 0.00702512 29
produce:emtrkmichelid:EmTrackMichelId 13.6799 20.0387 27.3778 20.2525 4.00985 29
[art]:TriggerResults:TriggerResultInserter 1.3876e-05 2.15127e-05 5.7139e-05 1.7709e-05 9.57733e-06 30
end_path:out1:RootOutput 3.176e-06 4.83917e-06 1.6682e-05 3.912e-06 3.14164e-06 30
end_path:michelremoving:michelremoving 1.6331e-05 0.0510048 0.222643 0.020882 0.0541356 30
end_path:michelremovinggnocchi:michelremoving 4.648e-06 0.0494552 0.203038 0.0196632 0.0520832 30
end_path:calibanagnocchi:CalibAnaTree 4.699e-06 0.284731 0.589741 0.25914 0.118537 30
end_path:out1:RootOutput(write) 0.388628 0.599523 0.922475 0.576121 0.126693 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4971.34 MB
Peak resident set size usage (VmHWM): 2374.75 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029094_0065_dataflow0_datawriter_0_20240906T090447_reco_stage1_reco_stage2_20240926T142511_keepup.root
\tHists: np04hd_raw_run029094_0065_dataflow0_datawriter_0_20240906T090447_reco_stage1_reco_stage2_20240926T142511_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
