Jobsub ID 263295.14@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 263295.14@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3453 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 09:58:35 |
| Site | FR_CCIN2P3 |
| Entry | DUNE_FR_CCIN2P3_cccondorce01 |
| Last heartbeat | 2024-09-26 11:21:52 |
| From worker node | Hostname | ccwcondor0635 |
| cpuinfo | AMD EPYC 7453 28-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 106200 (29 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 10:03:25 |
| Input files | hd-protodune:np04hd_raw_run029107_3443_dataflow3_datawriter_0_20240909T011155.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 11:21:52 |
| Saved logs | justin-logs:263295.14-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
:0 T:7 35 XUs and 47 XVs -> 2 XUVs
2739 XUVs total
1439 collection wire objects
2739 potential space points
Neighbour search...
84421 tests to find 52124 neighbours
Iterating with no regularization...
Begin: 7.38699e+06
0 6.79376e+06
1 6.75425e+06
2 6.74865e+06
Now with regularization...
Begin: 6.47097e+06
0 6.46907e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 29th record. run: 29107 subRun: 1 event: 826579 at 26-Sep-2024 13:06:52 CEST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 55258 traces, 55258 summary
Retagger: tagging trace set: gauss with 40497 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 40497 traces tagged "gauss"
FrameSaver: q=878818 n=728940 tag=gauss
wclsFrameSaver: saving 55258 traces tagged "wiener"
FrameSaver: q=961254 n=668232 tag=wiener
2841 hits in TPC 0
3664 hits in TPC 1
2687 hits in TPC 2
1342 hits in TPC 3
3787 hits in TPC 4
6982 hits in TPC 5
4314 hits in TPC 6
2740 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 173 XUs and 86 XVs -> 4 XUVs
C:0 T:2 1954 XUs and 3966 XVs -> 298 XUVs
C:0 T:3 166 XUs and 460 XVs -> 42 XUVs
C:0 T:4 75 XUs and 126 XVs -> 0 XUVs
C:0 T:5 25793 XUs and 42487 XVs -> 2025 XUVs
C:0 T:6 23311 XUs and 16435 XVs -> 1285 XUVs
C:0 T:7 27 XUs and 17 XVs -> 1 XUVs
3655 XUVs total
1193 collection wire objects
3655 potential space points
Neighbour search...
129911 tests to find 71110 neighbours
Iterating with no regularization...
Begin: 2.14024e+07
0 1.77499e+07
1 1.75517e+07
2 1.75226e+07
3 1.75164e+07
Now with regularization...
Begin: 1.65135e+07
0 1.6507e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 30th record. run: 29107 subRun: 1 event: 826587 at 26-Sep-2024 13:08:16 CEST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 71460 traces, 71460 summary
Retagger: tagging trace set: gauss with 52827 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 52827 traces tagged "gauss"
FrameSaver: q=1.1565e+06 n=1028953 tag=gauss
wclsFrameSaver: saving 71460 traces tagged "wiener"
FrameSaver: q=1.23003e+06 n=926842 tag=wiener
5382 hits in TPC 0
4711 hits in TPC 1
10086 hits in TPC 2
4501 hits in TPC 3
2704 hits in TPC 4
3957 hits in TPC 5
4860 hits in TPC 6
3157 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 254 XUs and 410 XVs -> 12 XUVs
C:0 T:2 39611 XUs and 42191 XVs -> 695 XUVs
C:0 T:3 299 XUs and 377 XVs -> 16 XUVs
C:0 T:4 127 XUs and 134 XVs -> 6 XUVs
C:0 T:5 15317 XUs and 15612 XVs -> 357 XUVs
C:0 T:6 13311 XUs and 15992 XVs -> 1274 XUVs
C:0 T:7 91 XUs and 76 XVs -> 3 XUVs
2363 XUVs total
1058 collection wire objects
2363 potential space points
Neighbour search...
86997 tests to find 54400 neighbours
Iterating with no regularization...
Begin: 4.65217e+06
0 4.26008e+06
1 4.23226e+06
2 4.22662e+06
3 4.22439e+06
Now with regularization...
Begin: 4.01056e+06
0 4.00929e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 5 event 826587 TrkackID 0 startx, y, z 43.6437 505.139 7.62389 wireno, peakt tpcno 466 1111.2 5 dist 0min T, max_T1108.72 2364.27
no of hits closeby 5 event 826587 TrkackID 0 startx, y, z 43.6437 505.139 7.62389 wireno, peakt tpcno 466 1111.2 5 dist 0min T, max_T1108.72 2364.27
26-Sep-2024 13:10:03 CEST Closed output file "np04hd_raw_run029107_3443_dataflow3_datawriter_0_20240909T011155_reco_stage1_reco_stage2_20240926T111003_keepup.root"
26-Sep-2024 13:10:03 CEST Closed input file "np04hd_raw_run029107_3443_dataflow3_datawriter_0_20240909T011155_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 68.1782 93.3612 141.288 89.8172 17.7581 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000632471 0.00316094 0.0052188 0.00319299 0.00117601 30
produce:fembfilter:PDHDFEMBFilter 0.496308 0.637533 0.891755 0.629867 0.112013 30
produce:wclsdatahd:WireCellToolkit 31.419 37.2669 47.714 37.4387 4.5955 30
produce:gaushit:GausHitFinder 0.381501 0.665087 1.23175 0.620721 0.203026 30
produce:nhitsfilter:NumberOfHitsFilter 0.000265466 0.00037706 0.00100647 0.000340701 0.000145698 30
produce:reco3d:SpacePointSolver 0.2309 1.07408 3.28377 0.906845 0.690821 30
produce:hitpdune:DisambigFromSpacePoints 0.241155 0.538921 1.02644 0.508886 0.194265 30
produce:pandora:StandardPandora 6.69019 12.2787 28.523 11.0555 5.03816 30
produce:pandoraWriter:StandardPandora 0.10739 0.161075 0.270744 0.15854 0.0393459 30
produce:pandoraTrack:LArPandoraTrackCreation 0.886721 2.01301 3.94277 1.9184 0.695531 30
produce:pandoraShower:LArPandoraShowerCreation 1.0553 2.72846 6.50456 2.58651 1.22493 30
produce:pandoracalo:Calorimetry 0.436745 0.960497 2.35723 0.926672 0.357563 30
produce:pandoracalonosce:Calorimetry 0.427517 0.907672 2.04413 0.823769 0.351631 30
produce:pandorapid:Chi2ParticleID 0.00114629 0.00213586 0.00498527 0.00199886 0.000747585 30
produce:pandoraShowercalo:ShowerCalorimetry 0.931591 2.30609 6.27956 1.97737 1.15825 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.899303 2.17144 5.64156 2.06251 0.978077 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0822569 0.147347 0.295233 0.131217 0.0514577 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0303624 0.0521474 0.0903595 0.0475891 0.0162187 30
produce:emtrkmichelid:EmTrackMichelId 19.2779 27.6204 46.2876 27.0439 5.64579 30
[art]:TriggerResults:TriggerResultInserter 3.7991e-05 6.36596e-05 0.000129191 6.46655e-05 1.9537e-05 30
end_path:out1:RootOutput 1.2414e-05 2.1235e-05 5.2708e-05 1.92715e-05 8.63947e-06 30
end_path:michelremoving:michelremoving 0.0258816 0.0967705 0.301761 0.057625 0.0762578 30
end_path:michelremovinggnocchi:michelremoving 0.0246458 0.091839 0.290088 0.0564921 0.0738646 30
end_path:calibanagnocchi:CalibAnaTree 0.33657 0.670725 1.34298 0.708921 0.219498 30
end_path:out1:RootOutput(write) 0.483509 0.728989 1.17951 0.69443 0.182549 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4928.48 MB
Peak resident set size usage (VmHWM): 2354.18 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_3443_dataflow3_datawriter_0_20240909T011155_reco_stage1_reco_stage2_20240926T111003_keepup.root
\tHists: np04hd_raw_run029107_3443_dataflow3_datawriter_0_20240909T011155_reco_stage1_reco_stage2_20240926T111003_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
