Jobsub ID 78692.145@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 78692.145@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3447 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 11:28:51 |
| Site | UK_Durham |
| Entry | DUNE_UK_SGridDurham_ce4 |
| Last heartbeat | 2024-09-26 14:14:08 |
| From worker node | Hostname | n173.dur.scotgrid.ac.uk |
| cpuinfo | Intel(R) Xeon(R) Gold 5220 CPU @ 2.20GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 12:18:11 |
| Input files | hd-protodune:np04hd_raw_run029081_0689_dataflow3_datawriter_0_20240905T035831.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 14:14:08 |
| Saved logs | justin-logs:78692.145-justin-prod-sched02.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
ization...
Begin: 1.61903e+07
0 1.61857e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 29th record. run: 29081 subRun: 1 event: 165587 at 26-Sep-2024 15:10:32 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 72587 traces, 72587 summary
Retagger: tagging trace set: gauss with 56643 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 56643 traces tagged "gauss"
FrameSaver: q=1.24756e+06 n=1115567 tag=gauss
wclsFrameSaver: saving 72587 traces tagged "wiener"
FrameSaver: q=1.32161e+06 n=1021478 tag=wiener
5521 hits in TPC 0
2845 hits in TPC 1
9477 hits in TPC 2
4311 hits in TPC 3
4877 hits in TPC 4
6085 hits in TPC 5
5531 hits in TPC 6
2147 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 68 XUs and 34 XVs -> 1 XUVs
C:0 T:2 37510 XUs and 36975 XVs -> 1267 XUVs
C:0 T:3 364 XUs and 353 XVs -> 4 XUVs
C:0 T:4 155 XUs and 123 XVs -> 3 XUVs
C:0 T:5 39911 XUs and 30052 XVs -> 1370 XUVs
C:0 T:6 19197 XUs and 15845 XVs -> 373 XUVs
C:0 T:7 841 XUs and 607 XVs -> 23 XUVs
3041 XUVs total
1659 collection wire objects
3041 potential space points
Neighbour search...
85023 tests to find 45674 neighbours
Iterating with no regularization...
Begin: 1.21832e+07
0 1.17823e+07
1 1.17553e+07
2 1.17492e+07
Now with regularization...
Begin: 1.11601e+07
0 1.11574e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 165587 TrkackID 21 startx, y, z 76.1141 593.386 308.523 wireno, peakt tpcno 176 5303.85 5 dist 0min T, max_T4456.69 5432.93
no of hits closeby 0 event 165587 TrkackID 21 startx, y, z 76.1141 593.386 308.523 wireno, peakt tpcno 176 5303.85 5 dist 0min T, max_T4456.69 5432.93
Begin processing the 30th record. run: 29081 subRun: 1 event: 165595 at 26-Sep-2024 15:12:12 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 53886 traces, 53886 summary
Retagger: tagging trace set: gauss with 42441 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 42441 traces tagged "gauss"
FrameSaver: q=947973 n=843161 tag=gauss
wclsFrameSaver: saving 53886 traces tagged "wiener"
FrameSaver: q=1.00178e+06 n=775301 tag=wiener
2974 hits in TPC 0
3417 hits in TPC 1
5244 hits in TPC 2
4150 hits in TPC 3
3720 hits in TPC 4
4725 hits in TPC 5
3576 hits in TPC 6
2612 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 3730 XUs and 3826 XVs -> 163 XUVs
C:0 T:2 11661 XUs and 16544 XVs -> 553 XUVs
C:0 T:3 944 XUs and 933 XVs -> 32 XUVs
C:0 T:4 15 XUs and 15 XVs -> 1 XUVs
C:0 T:5 10355 XUs and 10547 XVs -> 470 XUVs
C:0 T:6 7748 XUs and 7379 XVs -> 241 XUVs
C:0 T:7 104 XUs and 142 XVs -> 3 XUVs
1463 XUVs total
1064 collection wire objects
1463 potential space points
Neighbour search...
25575 tests to find 14558 neighbours
Iterating with no regularization...
Begin: 8.98267e+06
0 8.69984e+06
1 8.69338e+06
Now with regularization...
Begin: 8.20459e+06
0 8.20391e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 165595 TrkackID 8 startx, y, z -10.7805 525.066 12.5107 wireno, peakt tpcno 162 3.65419 2 dist 0min T, max_T3.65419 2514.54
no of hits closeby 0 event 165595 TrkackID 8 startx, y, z -10.7805 525.066 12.5107 wireno, peakt tpcno 162 3.65419 2 dist 0min T, max_T3.65419 2514.54
26-Sep-2024 15:13:32 BST Closed output file "np04hd_raw_run029081_0689_dataflow3_datawriter_0_20240905T035831_reco_stage1_reco_stage2_20240926T141332_keepup.root"
26-Sep-2024 15:13:32 BST Closed input file "np04hd_raw_run029081_0689_dataflow3_datawriter_0_20240905T035831_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 77.3591 115.884 166.78 114.028 26.7132 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000359919 0.00139694 0.00396997 0.000921818 0.00109413 30
produce:fembfilter:PDHDFEMBFilter 0.700501 0.99763 1.39268 1.07004 0.231662 30
produce:wclsdatahd:WireCellToolkit 43.4497 58.228 73.8566 63.5619 10.8605 30
produce:gaushit:GausHitFinder 0.601128 1.05873 1.77195 1.02752 0.317263 30
produce:nhitsfilter:NumberOfHitsFilter 0.000300019 0.000469605 0.00153907 0.000414231 0.000223714 30
produce:reco3d:SpacePointSolver 0.250062 1.20889 3.91901 0.893607 0.981551 30
produce:hitpdune:DisambigFromSpacePoints 0.305288 0.882015 1.68134 0.826299 0.419077 30
produce:pandora:StandardPandora 8.38673 16.7029 31.9 14.94 6.69128 30
produce:pandoraWriter:StandardPandora 0.116218 0.20807 0.320916 0.198054 0.0638388 30
produce:pandoraTrack:LArPandoraTrackCreation 0.934935 2.0399 3.99993 1.72949 0.903091 30
produce:pandoraShower:LArPandoraShowerCreation 1.01372 2.39496 5.15291 2.15205 1.11837 30
produce:pandoracalo:Calorimetry 0.454452 0.962051 2.00074 0.831386 0.422093 30
produce:pandoracalonosce:Calorimetry 0.411329 0.892306 1.93907 0.772279 0.409629 30
produce:pandorapid:Chi2ParticleID 0.00150183 0.00256454 0.00497598 0.00232575 0.000961683 30
produce:pandoraShowercalo:ShowerCalorimetry 0.90145 2.15507 4.27266 1.9414 0.969594 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.892896 2.13605 4.21327 1.84743 0.964419 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0926398 0.203876 0.393916 0.180551 0.0775735 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0373735 0.0770313 0.136366 0.0703806 0.0289851 30
produce:emtrkmichelid:EmTrackMichelId 14.5456 23.356 35.6786 22.5914 5.86854 30
[art]:TriggerResults:TriggerResultInserter 2.769e-05 4.21555e-05 9.268e-05 3.49565e-05 1.55875e-05 30
end_path:out1:RootOutput 6.775e-06 9.9133e-06 2.6717e-05 8.2445e-06 4.03143e-06 30
end_path:michelremoving:michelremoving 0.0249488 0.130525 0.601261 0.0556152 0.161453 30
end_path:michelremovinggnocchi:michelremoving 0.022226 0.128632 0.608191 0.0506863 0.169067 30
end_path:calibanagnocchi:CalibAnaTree 0.323235 0.776355 1.45929 0.700312 0.325906 30
end_path:out1:RootOutput(write) 0.63274 1.16203 1.9773 1.09272 0.37827 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5882.64 MB
Peak resident set size usage (VmHWM): 2995.71 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029081_0689_dataflow3_datawriter_0_20240905T035831_reco_stage1_reco_stage2_20240926T141332_keepup.root
\tHists: np04hd_raw_run029081_0689_dataflow3_datawriter_0_20240905T035831_reco_stage1_reco_stage2_20240926T141332_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
