Jobsub ID 263757.116@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 263757.116@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3448 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 13:23:33 |
| Site | UK_Durham |
| Entry | DUNE_UK_SGridDurham_ce4 |
| Last heartbeat | 2024-09-26 14:53:17 |
| From worker node | Hostname | n247.dur.scotgrid.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 13:24:51 |
| Input files | hd-protodune:np04hd_raw_run029094_0142_dataflow0_datawriter_0_20240906T094246.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 14:53:17 |
| Saved logs | justin-logs:263757.116-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
s and 23 XVs -> 0 XUVs
C:0 T:5 6772 XUs and 8587 XVs -> 832 XUVs
C:0 T:6 17211 XUs and 30826 XVs -> 1192 XUVs
C:0 T:7 389 XUs and 434 XVs -> 19 XUVs
2609 XUVs total
1225 collection wire objects
2609 potential space points
Neighbour search...
76509 tests to find 43936 neighbours
Iterating with no regularization...
Begin: 7.39855e+06
0 6.56757e+06
1 6.51623e+06
2 6.50775e+06
3 6.50512e+06
Now with regularization...
Begin: 5.94934e+06
0 5.94788e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 29th record. run: 29094 subRun: 1 event: 34312 at 26-Sep-2024 15:50:18 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 48582 traces, 48582 summary
Retagger: tagging trace set: gauss with 37002 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 37002 traces tagged "gauss"
FrameSaver: q=791022 n=695821 tag=gauss
wclsFrameSaver: saving 48582 traces tagged "wiener"
FrameSaver: q=842709 n=629881 tag=wiener
2951 hits in TPC 0
4168 hits in TPC 1
4171 hits in TPC 2
2528 hits in TPC 3
1820 hits in TPC 4
2235 hits in TPC 5
4511 hits in TPC 6
2535 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 74 XUs and 76 XVs -> 1 XUVs
C:0 T:2 9272 XUs and 13445 XVs -> 1231 XUVs
C:0 T:3 79 XUs and 91 XVs -> 7 XUVs
C:0 T:4 25 XUs and 46 XVs -> 3 XUVs
C:0 T:5 3484 XUs and 2670 XVs -> 111 XUVs
C:0 T:6 11119 XUs and 13968 XVs -> 897 XUVs
C:0 T:7 45 XUs and 58 XVs -> 3 XUVs
2253 XUVs total
960 collection wire objects
2253 potential space points
Neighbour search...
73187 tests to find 42332 neighbours
Iterating with no regularization...
Begin: 3.43421e+06
0 3.06837e+06
1 3.02259e+06
2 3.01472e+06
3 3.0125e+06
Now with regularization...
Begin: 2.71331e+06
0 2.71208e+06
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 30th record. run: 29094 subRun: 1 event: 34320 at 26-Sep-2024 15:51:20 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 72764 traces, 72764 summary
Retagger: tagging trace set: gauss with 54087 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 54087 traces tagged "gauss"
FrameSaver: q=1.22846e+06 n=989049 tag=gauss
wclsFrameSaver: saving 72764 traces tagged "wiener"
FrameSaver: q=1.32069e+06 n=895645 tag=wiener
5918 hits in TPC 0
4982 hits in TPC 1
4192 hits in TPC 2
3952 hits in TPC 3
4208 hits in TPC 4
6651 hits in TPC 5
4525 hits in TPC 6
2896 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 832 XUs and 425 XVs -> 9 XUVs
C:0 T:2 14219 XUs and 14209 XVs -> 739 XUVs
C:0 T:3 175 XUs and 125 XVs -> 3 XUVs
C:0 T:4 202 XUs and 218 XVs -> 8 XUVs
C:0 T:5 25436 XUs and 24762 XVs -> 2461 XUVs
C:0 T:6 15661 XUs and 12925 XVs -> 534 XUVs
C:0 T:7 21 XUs and 54 XVs -> 2 XUVs
3756 XUVs total
1395 collection wire objects
3756 potential space points
Neighbour search...
126026 tests to find 70906 neighbours
Iterating with no regularization...
Begin: 8.01221e+06
0 6.90194e+06
1 6.76028e+06
2 6.74054e+06
3 6.73502e+06
Now with regularization...
Begin: 6.05515e+06
0 6.04929e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 1 event 34320 TrkackID 6 startx, y, z -90.7758 594.944 162.461 wireno, peakt tpcno 299 8.09518 6 dist 0min T, max_T2.05904 1542.19
no of hits closeby 1 event 34320 TrkackID 6 startx, y, z -90.7758 594.944 162.461 wireno, peakt tpcno 299 8.09518 6 dist 0min T, max_T2.05904 1542.19
26-Sep-2024 15:52:48 BST Closed output file "np04hd_raw_run029094_0142_dataflow0_datawriter_0_20240906T094246_reco_stage1_reco_stage2_20240926T145248_keepup.root"
26-Sep-2024 15:52:48 BST Closed input file "np04hd_raw_run029094_0142_dataflow0_datawriter_0_20240906T094246_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 54.0001 78.6166 137.387 73.0089 16.4796 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000389508 0.00181575 0.00366966 0.0017522 0.000963 30
produce:fembfilter:PDHDFEMBFilter 0.449587 0.654322 0.700115 0.662468 0.0575355 30
produce:wclsdatahd:WireCellToolkit 28.5044 34.9533 36.8466 34.9413 1.4864 30
produce:gaushit:GausHitFinder 0.351715 0.700801 1.04558 0.703134 0.187083 30
produce:nhitsfilter:NumberOfHitsFilter 0.000218363 0.000317667 0.000569349 0.000315232 7.0942e-05 30
produce:reco3d:SpacePointSolver 0.0795181 0.537315 1.69264 0.43513 0.388465 30
produce:hitpdune:DisambigFromSpacePoints 0.127428 0.518171 1.04482 0.458449 0.265298 30
produce:pandora:StandardPandora 4.10964 11.0648 35.6556 8.94338 6.60141 30
produce:pandoraWriter:StandardPandora 0.0680359 0.144806 0.259707 0.140549 0.0428703 30
produce:pandoraTrack:LArPandoraTrackCreation 0.337034 0.947942 2.73143 0.809862 0.443824 30
produce:pandoraShower:LArPandoraShowerCreation 0.245074 1.19155 3.44308 0.997536 0.739255 30
produce:pandoracalo:Calorimetry 0.207942 0.53589 1.37033 0.494247 0.219225 30
produce:pandoracalonosce:Calorimetry 0.172485 0.46998 1.21542 0.424198 0.195819 30
produce:pandorapid:Chi2ParticleID 0.00104432 0.00182319 0.00351361 0.0017959 0.000464813 30
produce:pandoraShowercalo:ShowerCalorimetry 0.210992 1.12187 3.29419 0.952909 0.651824 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.212935 1.08286 3.10121 0.934633 0.595411 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0717754 0.148213 0.239115 0.153236 0.0366362 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0245956 0.0488485 0.07862 0.0490108 0.0120634 30
produce:emtrkmichelid:EmTrackMichelId 12.4209 23.0781 42.7222 22.4511 6.08538 30
[art]:TriggerResults:TriggerResultInserter 2.1421e-05 3.51145e-05 7.3589e-05 3.3619e-05 1.13673e-05 30
end_path:out1:RootOutput 7.334e-06 1.19256e-05 2.599e-05 1.11765e-05 3.41016e-06 30
end_path:michelremoving:michelremoving 0.0120652 0.0715921 0.264917 0.027739 0.0659122 30
end_path:michelremovinggnocchi:michelremoving 0.0113067 0.0692709 0.25763 0.0257824 0.0653575 30
end_path:calibanagnocchi:CalibAnaTree 0.131541 0.398936 1.0841 0.362752 0.170229 30
end_path:out1:RootOutput(write) 0.374155 0.766102 1.28355 0.73688 0.191533 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4923.58 MB
Peak resident set size usage (VmHWM): 2572.93 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029094_0142_dataflow0_datawriter_0_20240906T094246_reco_stage1_reco_stage2_20240926T145248_keepup.root
\tHists: np04hd_raw_run029094_0142_dataflow0_datawriter_0_20240906T094246_reco_stage1_reco_stage2_20240926T145248_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
