Jobsub ID 263245.11@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 263245.11@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3451 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 09:32:00 |
| Site | FR_CCIN2P3 |
| Entry | DUNE_FR_CCIN2P3_cccondorce02 |
| Last heartbeat | 2024-09-26 10:46:08 |
| From worker node | Hostname | ccwcondor0567 |
| cpuinfo | AMD EPYC 7453 28-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 106200 (29 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 09:35:55 |
| Input files | hd-protodune:np04hd_raw_run029107_2222_dataflow5_datawriter_0_20240908T035512.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 10:46:08 |
| Saved logs | justin-logs:263245.11-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
6
Now with regularization...
Begin: 4.21487e+06
0 4.21463e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 29th record. run: 29107 subRun: 1 event: 533533 at 26-Sep-2024 12:33:23 CEST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 79843 traces, 79843 summary
Retagger: tagging trace set: gauss with 57529 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 57529 traces tagged "gauss"
FrameSaver: q=1.31997e+06 n=1040804 tag=gauss
wclsFrameSaver: saving 79843 traces tagged "wiener"
FrameSaver: q=1.43025e+06 n=934838 tag=wiener
2615 hits in TPC 0
2437 hits in TPC 1
10377 hits in TPC 2
5263 hits in TPC 3
4372 hits in TPC 4
5884 hits in TPC 5
7071 hits in TPC 6
3092 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 9 XUs and 29 XVs -> 2 XUVs
C:0 T:2 63226 XUs and 63752 XVs -> 5146 XUVs
C:0 T:3 148 XUs and 141 XVs -> 10 XUVs
C:0 T:4 2018 XUs and 5096 XVs -> 121 XUVs
C:0 T:5 31270 XUs and 32541 XVs -> 2014 XUVs
C:0 T:6 35829 XUs and 28115 XVs -> 1365 XUVs
C:0 T:7 88 XUs and 120 XVs -> 1 XUVs
8659 XUVs total
1939 collection wire objects
8659 potential space points
Neighbour search...
850517 tests to find 414836 neighbours
Iterating with no regularization...
Begin: 1.51101e+07
0 1.32381e+07
1 1.30856e+07
2 1.30637e+07
3 1.30571e+07
Now with regularization...
Begin: 1.22165e+07
0 1.22111e+07
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 30th record. run: 29107 subRun: 1 event: 533549 at 26-Sep-2024 12:34:56 CEST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 87549 traces, 87549 summary
Retagger: tagging trace set: gauss with 64910 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 64910 traces tagged "gauss"
FrameSaver: q=1.453e+06 n=1179132 tag=gauss
wclsFrameSaver: saving 87549 traces tagged "wiener"
FrameSaver: q=1.55147e+06 n=1055193 tag=wiener
4165 hits in TPC 0
3427 hits in TPC 1
8253 hits in TPC 2
5102 hits in TPC 3
4538 hits in TPC 4
7207 hits in TPC 5
7394 hits in TPC 6
4794 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 34 XUs and 27 XVs -> 1 XUVs
C:0 T:1 1022 XUs and 411 XVs -> 27 XUVs
C:0 T:2 33863 XUs and 41378 XVs -> 982 XUVs
C:0 T:3 203 XUs and 497 XVs -> 8 XUVs
C:0 T:4 831 XUs and 2070 XVs -> 75 XUVs
C:0 T:5 17474 XUs and 20746 XVs -> 724 XUVs
C:0 T:6 31428 XUs and 26674 XVs -> 1052 XUVs
C:0 T:7 586 XUs and 782 XVs -> 17 XUVs
2886 XUVs total
2009 collection wire objects
2886 potential space points
Neighbour search...
36716 tests to find 21288 neighbours
Iterating with no regularization...
Begin: 1.18728e+07
0 1.12937e+07
1 1.12707e+07
2 1.12685e+07
Now with regularization...
Begin: 1.06358e+07
0 1.06353e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 12:36:35 CEST Closed output file "np04hd_raw_run029107_2222_dataflow5_datawriter_0_20240908T035512_reco_stage1_reco_stage2_20240926T103635_keepup.root"
26-Sep-2024 12:36:35 CEST Closed input file "np04hd_raw_run029107_2222_dataflow5_datawriter_0_20240908T035512_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 60.9247 84.9326 131.847 82.0333 16.03 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000604592 0.00215479 0.00439479 0.00235283 0.000957696 30
produce:fembfilter:PDHDFEMBFilter 0.499253 0.562826 0.766507 0.530568 0.0793494 30
produce:wclsdatahd:WireCellToolkit 32.2761 35.565 39.2481 35.1138 1.97528 30
produce:gaushit:GausHitFinder 0.349123 0.53555 0.813261 0.520398 0.123347 30
produce:nhitsfilter:NumberOfHitsFilter 0.000206517 0.000297235 0.000471884 0.000280095 6.38441e-05 30
produce:reco3d:SpacePointSolver 0.195047 0.868415 3.23283 0.650489 0.736555 30
produce:hitpdune:DisambigFromSpacePoints 0.163136 0.407268 1.23047 0.337631 0.243943 30
produce:pandora:StandardPandora 4.23687 9.75125 21.2544 8.61348 3.99937 30
produce:pandoraWriter:StandardPandora 0.0786838 0.132894 0.212053 0.123434 0.0368444 30
produce:pandoraTrack:LArPandoraTrackCreation 0.819209 1.49799 3.30062 1.32392 0.5914 30
produce:pandoraShower:LArPandoraShowerCreation 0.611493 1.8768 4.71867 1.60965 1.06854 30
produce:pandoracalo:Calorimetry 0.391856 0.722538 1.46342 0.683462 0.255389 30
produce:pandoracalonosce:Calorimetry 0.353659 0.670507 1.37037 0.592332 0.237883 30
produce:pandorapid:Chi2ParticleID 0.00130892 0.00180985 0.00418266 0.00162538 0.000562687 30
produce:pandoraShowercalo:ShowerCalorimetry 0.459084 1.62092 3.99628 1.47982 0.895084 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.419891 1.59196 3.85813 1.36235 0.899564 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0603977 0.103021 0.17191 0.10271 0.0269241 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0239347 0.0395684 0.0580977 0.0383076 0.00971052 30
produce:emtrkmichelid:EmTrackMichelId 17.4585 27.5026 48.5363 26.7272 6.93514 30
[art]:TriggerResults:TriggerResultInserter 3.0127e-05 6.04181e-05 0.000124703 5.6631e-05 1.83167e-05 30
end_path:out1:RootOutput 6.993e-06 1.71567e-05 3.1799e-05 1.622e-05 5.7908e-06 30
end_path:michelremoving:michelremoving 0.0201077 0.0819628 0.383574 0.0447062 0.0785038 30
end_path:michelremovinggnocchi:michelremoving 0.01797 0.0734186 0.32286 0.0426316 0.0648999 30
end_path:calibanagnocchi:CalibAnaTree 0.219559 0.507129 0.945316 0.469958 0.181363 30
end_path:out1:RootOutput(write) 0.416614 0.633533 0.962981 0.62214 0.135522 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4914.52 MB
Peak resident set size usage (VmHWM): 2338.29 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_2222_dataflow5_datawriter_0_20240908T035512_reco_stage1_reco_stage2_20240926T103635_keepup.root
\tHists: np04hd_raw_run029107_2222_dataflow5_datawriter_0_20240908T035512_reco_stage1_reco_stage2_20240926T103635_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
