Jobsub ID 263319.30@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 263319.30@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3447 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 10:05:04 |
| Site | FR_CCIN2P3 |
| Entry | DUNE_FR_CCIN2P3_cccondorce02 |
| Last heartbeat | 2024-09-26 12:04:02 |
| From worker node | Hostname | ccwcondor0636 |
| cpuinfo | AMD EPYC 7453 28-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 106200 (29 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 10:29:21 |
| Input files | hd-protodune:np04hd_raw_run029081_1004_dataflow2_datawriter_0_20240905T084927.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 12:04:02 |
| Saved logs | justin-logs:263319.30-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
tures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 241178 TrkackID 0 startx, y, z 131.509 531.712 457.915 wireno, peakt tpcno 227 30.628 5 dist 1.17677min T, max_T10.8291 4430.02
no of hits closeby 0 event 241178 TrkackID 0 startx, y, z 131.509 531.712 457.915 wireno, peakt tpcno 227 30.628 5 dist 1.17677min T, max_T10.8291 4430.02
Begin processing the 29th record. run: 29081 subRun: 1 event: 241186 at 26-Sep-2024 13:26:45 CEST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 44082 traces, 44082 summary
Retagger: tagging trace set: gauss with 32774 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 32774 traces tagged "gauss"
FrameSaver: q=742283 n=635444 tag=gauss
wclsFrameSaver: saving 44082 traces tagged "wiener"
FrameSaver: q=821048 n=581614 tag=wiener
2108 hits in TPC 0
1424 hits in TPC 1
2136 hits in TPC 2
372 hits in TPC 3
4163 hits in TPC 4
4648 hits in TPC 5
4966 hits in TPC 6
3650 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 7 XUs and 13 XVs -> 0 XUVs
C:0 T:2 1640 XUs and 1263 XVs -> 104 XUVs
C:0 T:3 1 XUs and 1 XVs -> 0 XUVs
C:0 T:4 70 XUs and 134 XVs -> 3 XUVs
C:0 T:5 27323 XUs and 84437 XVs -> 2405 XUVs
C:0 T:6 14791 XUs and 22855 XVs -> 1647 XUVs
C:0 T:7 112 XUs and 142 XVs -> 2 XUVs
4161 XUVs total
1242 collection wire objects
4161 potential space points
Neighbour search...
245937 tests to find 120600 neighbours
Iterating with no regularization...
Begin: 9.61565e+06
0 6.6216e+06
1 6.39103e+06
2 6.356e+06
3 6.34526e+06
4 6.34088e+06
Now with regularization...
Begin: 5.91715e+06
0 5.91372e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 30th record. run: 29081 subRun: 1 event: 241194 at 26-Sep-2024 13:27:56 CEST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 90041 traces, 90041 summary
Retagger: tagging trace set: gauss with 63229 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 63229 traces tagged "gauss"
FrameSaver: q=1.34702e+06 n=1030946 tag=gauss
wclsFrameSaver: saving 90041 traces tagged "wiener"
FrameSaver: q=1.48441e+06 n=919687 tag=wiener
5833 hits in TPC 0
5815 hits in TPC 1
8644 hits in TPC 2
5160 hits in TPC 3
2866 hits in TPC 4
4799 hits in TPC 5
5480 hits in TPC 6
2802 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 35 XUs and 17 XVs -> 0 XUVs
C:0 T:1 4840 XUs and 4977 XVs -> 148 XUVs
C:0 T:2 81289 XUs and 94875 XVs -> 3117 XUVs
C:0 T:3 179 XUs and 195 XVs -> 3 XUVs
C:0 T:4 10 XUs and 5 XVs -> 0 XUVs
C:0 T:5 11027 XUs and 11454 XVs -> 963 XUVs
C:0 T:6 68735 XUs and 81527 XVs -> 1519 XUVs
C:0 T:7 356 XUs and 317 XVs -> 15 XUVs
5765 XUVs total
1889 collection wire objects
5765 potential space points
Neighbour search...
221889 tests to find 133102 neighbours
Iterating with no regularization...
Begin: 1.6109e+07
0 1.47736e+07
1 1.46981e+07
2 1.46858e+07
Now with regularization...
Begin: 1.39276e+07
0 1.39228e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 14 event 241194 TrkackID 13 startx, y, z 162.514 438.889 441.193 wireno, peakt tpcno 90 1663.8 5 dist 0min T, max_T4.80049 2072.97
no of hits closeby 14 event 241194 TrkackID 13 startx, y, z 162.514 438.889 441.193 wireno, peakt tpcno 90 1663.8 5 dist 0min T, max_T4.80049 2072.97
26-Sep-2024 13:29:37 CEST Closed output file "np04hd_raw_run029081_1004_dataflow2_datawriter_0_20240905T084927_reco_stage1_reco_stage2_20240926T112937_keepup.root"
26-Sep-2024 13:29:37 CEST Closed input file "np04hd_raw_run029081_1004_dataflow2_datawriter_0_20240905T084927_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 59.5281 82.6486 128.41 78.6636 14.4837 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000465571 0.00231746 0.00430549 0.00213794 0.00111788 30
produce:fembfilter:PDHDFEMBFilter 0.500673 0.592881 0.826133 0.558498 0.0996964 30
produce:wclsdatahd:WireCellToolkit 31.9754 35.8987 43.677 34.4331 3.55533 30
produce:gaushit:GausHitFinder 0.30925 0.550724 0.924469 0.491601 0.145934 30
produce:nhitsfilter:NumberOfHitsFilter 0.000233507 0.000316253 0.000528269 0.000304965 7.0016e-05 30
produce:reco3d:SpacePointSolver 0.178343 0.96185 3.76372 0.719649 0.885054 30
produce:hitpdune:DisambigFromSpacePoints 0.115105 0.415016 1.27767 0.320666 0.27989 30
produce:pandora:StandardPandora 3.97283 10.2094 20.8808 9.24902 4.52694 30
produce:pandoraWriter:StandardPandora 0.0770706 0.131278 0.206836 0.129972 0.0278349 30
produce:pandoraTrack:LArPandoraTrackCreation 0.637295 1.4824 3.03127 1.3209 0.563196 30
produce:pandoraShower:LArPandoraShowerCreation 0.347767 1.65235 5.24852 1.41172 0.949458 30
produce:pandoracalo:Calorimetry 0.291289 0.716294 1.77493 0.686791 0.311272 30
produce:pandoracalonosce:Calorimetry 0.277206 0.62889 1.62973 0.603127 0.289862 30
produce:pandorapid:Chi2ParticleID 0.00108515 0.00179027 0.00390983 0.00167253 0.000538961 30
produce:pandoraShowercalo:ShowerCalorimetry 0.261912 1.39922 4.62083 1.30603 0.811313 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.262263 1.38436 4.34592 1.23106 0.779605 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0696466 0.111465 0.176205 0.103463 0.030898 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0251812 0.0405192 0.0604767 0.0397238 0.00935526 30
produce:emtrkmichelid:EmTrackMichelId 17.055 25.0434 40.0289 24.1654 5.0746 30
[art]:TriggerResults:TriggerResultInserter 2.5317e-05 5.94249e-05 0.000146174 5.6351e-05 2.20551e-05 30
end_path:out1:RootOutput 8.916e-06 1.80404e-05 4.7569e-05 1.7788e-05 7.05456e-06 30
end_path:michelremoving:michelremoving 0.0205877 0.0780456 0.258822 0.0409342 0.0660208 30
end_path:michelremovinggnocchi:michelremoving 0.0169515 0.074531 0.240639 0.0410922 0.0614436 30
end_path:calibanagnocchi:CalibAnaTree 0.173416 0.48879 1.09585 0.490934 0.193814 30
end_path:out1:RootOutput(write) 0.420099 0.595314 0.842877 0.581398 0.123681 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4910.28 MB
Peak resident set size usage (VmHWM): 2333.45 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029081_1004_dataflow2_datawriter_0_20240905T084927_reco_stage1_reco_stage2_20240926T112937_keepup.root
\tHists: np04hd_raw_run029081_1004_dataflow2_datawriter_0_20240905T084927_reco_stage1_reco_stage2_20240926T112937_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
