Jobsub ID 263940.73@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 263940.73@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3448 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 14:25:09 |
| Site | UK_Sheffield |
| Entry | DUNE_UK_Sheffield_lcgce1 |
| Last heartbeat | 2024-09-26 15:58:21 |
| From worker node | Hostname | wn082.hep |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 14:26:48 |
| Input files | hd-protodune:np04hd_raw_run029094_0029_dataflow7_datawriter_0_20240906T084653.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 15:58:21 |
| Saved logs | justin-logs:263940.73-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
011 hits in TPC 3
3422 hits in TPC 4
5166 hits in TPC 5
4039 hits in TPC 6
3413 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 136 XUs and 39 XVs -> 0 XUVs
C:0 T:2 1370 XUs and 2376 XVs -> 551 XUVs
C:0 T:3 25 XUs and 31 XVs -> 1 XUVs
C:0 T:4 238 XUs and 431 XVs -> 10 XUVs
C:0 T:5 14334 XUs and 10198 XVs -> 282 XUVs
C:0 T:6 11612 XUs and 10955 XVs -> 512 XUVs
C:0 T:7 74 XUs and 86 XVs -> 5 XUVs
1361 XUVs total
805 collection wire objects
1361 potential space points
Neighbour search...
15683 tests to find 8960 neighbours
Iterating with no regularization...
Begin: 5.13695e+06
0 4.91795e+06
1 4.91125e+06
2 4.91075e+06
Now with regularization...
Begin: 4.54309e+06
0 4.54287e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 1 event 7207 TrkackID 1 startx, y, z 161.229 367.217 426.444 wireno, peakt tpcno 0 272.959 5 dist 31.4424min T, max_T5 2053
no of hits closeby 1 event 7207 TrkackID 1 startx, y, z 161.229 367.217 426.444 wireno, peakt tpcno 0 272.959 5 dist 31.4424min T, max_T5 2053
Begin processing the 29th record. run: 29094 subRun: 1 event: 7215 at 26-Sep-2024 16:54:38 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 54343 traces, 54343 summary
Retagger: tagging trace set: gauss with 38621 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 38621 traces tagged "gauss"
FrameSaver: q=854106 n=681907 tag=gauss
wclsFrameSaver: saving 54343 traces tagged "wiener"
FrameSaver: q=931048 n=615052 tag=wiener
1147 hits in TPC 0
1106 hits in TPC 1
5252 hits in TPC 2
3693 hits in TPC 3
4171 hits in TPC 4
5165 hits in TPC 5
4573 hits in TPC 6
2759 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:2 22836 XUs and 25091 XVs -> 1675 XUVs
C:0 T:3 89 XUs and 573 XVs -> 19 XUVs
C:0 T:4 307 XUs and 506 XVs -> 12 XUVs
C:0 T:5 11434 XUs and 12470 XVs -> 1532 XUVs
C:0 T:6 21689 XUs and 12269 XVs -> 774 XUVs
C:0 T:7 286 XUs and 152 XVs -> 8 XUVs
4020 XUVs total
1163 collection wire objects
4020 potential space points
Neighbour search...
161330 tests to find 102108 neighbours
Iterating with no regularization...
Begin: 3.99769e+06
0 3.36652e+06
1 3.28201e+06
2 3.26548e+06
3 3.26076e+06
4 3.25894e+06
Now with regularization...
Begin: 2.81305e+06
0 2.81164e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 30th record. run: 29094 subRun: 1 event: 7223 at 26-Sep-2024 16:56:24 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 50097 traces, 50097 summary
Retagger: tagging trace set: gauss with 36761 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 36761 traces tagged "gauss"
FrameSaver: q=746703 n=685482 tag=gauss
wclsFrameSaver: saving 50097 traces tagged "wiener"
FrameSaver: q=802094 n=616497 tag=wiener
1813 hits in TPC 0
2241 hits in TPC 1
5234 hits in TPC 2
2366 hits in TPC 3
2205 hits in TPC 4
3894 hits in TPC 5
5378 hits in TPC 6
2977 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 7376 XUs and 5282 XVs -> 93 XUVs
C:0 T:2 11808 XUs and 13569 XVs -> 174 XUVs
C:0 T:3 44 XUs and 56 XVs -> 4 XUVs
C:0 T:4 1794 XUs and 4694 XVs -> 219 XUVs
C:0 T:5 5676 XUs and 7296 XVs -> 404 XUVs
C:0 T:6 11859 XUs and 13290 XVs -> 341 XUVs
C:0 T:7 194 XUs and 161 XVs -> 3 XUVs
1238 XUVs total
822 collection wire objects
1238 potential space points
Neighbour search...
31880 tests to find 16982 neighbours
Iterating with no regularization...
Begin: 3.91587e+06
0 3.78082e+06
1 3.77747e+06
Now with regularization...
Begin: 3.56766e+06
0 3.56684e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 16:57:59 BST Closed output file "np04hd_raw_run029094_0029_dataflow7_datawriter_0_20240906T084653_reco_stage1_reco_stage2_20240926T155759_keepup.root"
26-Sep-2024 16:57:59 BST Closed input file "np04hd_raw_run029094_0029_dataflow7_datawriter_0_20240906T084653_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 93.2834 129.117 169.136 130.667 20.6887 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000410707 0.00206928 0.00364045 0.00211223 0.000894509 30
produce:fembfilter:PDHDFEMBFilter 0.628062 0.654418 0.678555 0.653764 0.0097624 30
produce:wclsdatahd:WireCellToolkit 41.7237 49.4716 62.9599 44.1732 8.17212 30
produce:gaushit:GausHitFinder 0.554826 0.824766 1.20827 0.826858 0.172189 30
produce:nhitsfilter:NumberOfHitsFilter 0.000226809 0.00036412 0.000504175 0.000356836 6.93047e-05 30
produce:reco3d:SpacePointSolver 0.0996691 0.817735 2.32652 0.628552 0.575876 30
produce:hitpdune:DisambigFromSpacePoints 0.164605 0.632492 1.63847 0.54407 0.327194 30
produce:pandora:StandardPandora 7.50032 15.5416 30.7955 15.8184 5.9401 30
produce:pandoraWriter:StandardPandora 0.110477 0.159008 0.253612 0.156322 0.0321158 30
produce:pandoraTrack:LArPandoraTrackCreation 0.648747 1.26099 2.61946 1.15487 0.448091 30
produce:pandoraShower:LArPandoraShowerCreation 0.585074 1.4458 3.43232 1.34185 0.628419 30
produce:pandoracalo:Calorimetry 0.319686 0.644834 1.23325 0.598196 0.202931 30
produce:pandoracalonosce:Calorimetry 0.288271 0.580307 1.17576 0.528793 0.189147 30
produce:pandorapid:Chi2ParticleID 0.00144789 0.00195897 0.00348998 0.0018728 0.000396488 30
produce:pandoraShowercalo:ShowerCalorimetry 0.528751 1.34994 3.79397 1.26182 0.623875 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.512577 1.34175 4.13118 1.27729 0.667509 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0830881 0.138615 0.207263 0.137103 0.0292846 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0295367 0.0467945 0.0674364 0.0454983 0.00989069 30
produce:emtrkmichelid:EmTrackMichelId 36.5811 52.5733 74.0165 52.743 10.0401 30
[art]:TriggerResults:TriggerResultInserter 2.2257e-05 2.74913e-05 7.5056e-05 2.4769e-05 9.72522e-06 30
end_path:out1:RootOutput 7.608e-06 9.26203e-06 2.8427e-05 8.1055e-06 3.84661e-06 30
end_path:michelremoving:michelremoving 0.017635 0.128038 0.413256 0.0408513 0.125112 30
end_path:michelremovinggnocchi:michelremoving 0.0163635 0.124574 0.411053 0.0370348 0.124415 30
end_path:calibanagnocchi:CalibAnaTree 0.222911 0.495357 0.979698 0.475808 0.171207 30
end_path:out1:RootOutput(write) 0.504769 0.798538 1.11311 0.767494 0.155123 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4975.18 MB
Peak resident set size usage (VmHWM): 2406.53 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029094_0029_dataflow7_datawriter_0_20240906T084653_reco_stage1_reco_stage2_20240926T155759_keepup.root
\tHists: np04hd_raw_run029094_0029_dataflow7_datawriter_0_20240906T084653_reco_stage1_reco_stage2_20240926T155759_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
