Jobsub ID 263940.68@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 263940.68@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3448 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 14:25:09 |
| Site | UK_Brunel |
| Entry | CMSHTPC_T2_UK_London_Brunel_dc2_22 |
| Last heartbeat | 2024-09-26 17:10:26 |
| From worker node | Hostname | wn-b7-04-00.brunel.ac.uk |
| cpuinfo | Intel(R) Xeon(R) CPU E5645 @ 2.40GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 14:27:27 |
| Input files | hd-protodune:np04hd_raw_run029092_0926_dataflow6_datawriter_0_20240906T075019.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 17:10:26 |
| Saved logs | justin-logs:263940.68-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
o calculate correlation coefficient p-value for these numbers
----view 0: 0.0254998 0.020339 0.0189803 0.0212226 0.0177534 0.0218382 0.0222437 0.0209337 0.0187774 0.0239586 0.0196226
----view 1: 0.000287175 0.000287175 0.000287175 0.000287116 0.000287175 0.000287175 0.000287175 0.000287175 0.000287175 0.000287175 0.000287116
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 29th record. run: 29092 subRun: 1 event: 222470 at 26-Sep-2024 18:01:23 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 55315 traces, 55315 summary
Retagger: tagging trace set: gauss with 40465 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 40465 traces tagged "gauss"
FrameSaver: q=863073 n=774444 tag=gauss
wclsFrameSaver: saving 55315 traces tagged "wiener"
FrameSaver: q=931526 n=705338 tag=wiener
4932 hits in TPC 0
3070 hits in TPC 1
7527 hits in TPC 2
5703 hits in TPC 3
2623 hits in TPC 4
3600 hits in TPC 5
2450 hits in TPC 6
1184 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 9 XUs and 2 XVs -> 0 XUVs
C:0 T:1 1689 XUs and 1237 XVs -> 20 XUVs
C:0 T:2 22722 XUs and 39458 XVs -> 1713 XUVs
C:0 T:3 234 XUs and 523 XVs -> 12 XUVs
C:0 T:4 109 XUs and 74 XVs -> 1 XUVs
C:0 T:5 14727 XUs and 14254 XVs -> 595 XUVs
C:0 T:6 1793 XUs and 3065 XVs -> 115 XUVs
C:0 T:7 18 XUs and 27 XVs -> 1 XUVs
2457 XUVs total
1268 collection wire objects
2457 potential space points
Neighbour search...
60593 tests to find 36770 neighbours
Iterating with no regularization...
Begin: 6.44001e+06
0 5.79874e+06
1 5.75847e+06
2 5.75173e+06
3 5.75008e+06
Now with regularization...
Begin: 5.29152e+06
0 5.29057e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 30th record. run: 29092 subRun: 1 event: 222478 at 26-Sep-2024 18:05:17 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 52532 traces, 52532 summary
Retagger: tagging trace set: gauss with 40346 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 40346 traces tagged "gauss"
FrameSaver: q=900855 n=815675 tag=gauss
wclsFrameSaver: saving 52532 traces tagged "wiener"
FrameSaver: q=947672 n=743198 tag=wiener
2216 hits in TPC 0
1744 hits in TPC 1
6807 hits in TPC 2
5505 hits in TPC 3
1396 hits in TPC 4
3445 hits in TPC 5
5248 hits in TPC 6
3524 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 52 XUs and 61 XVs -> 0 XUVs
C:0 T:2 24360 XUs and 24841 XVs -> 642 XUVs
C:0 T:3 926 XUs and 854 XVs -> 30 XUVs
C:0 T:4 17 XUs and 16 XVs -> 1 XUVs
C:0 T:5 8166 XUs and 5092 XVs -> 128 XUVs
C:0 T:6 14428 XUs and 13644 XVs -> 383 XUVs
C:0 T:7 306 XUs and 391 XVs -> 6 XUVs
1190 XUVs total
873 collection wire objects
1190 potential space points
Neighbour search...
15178 tests to find 7986 neighbours
Iterating with no regularization...
Begin: 6.06777e+06
0 5.85081e+06
1 5.84457e+06
2 5.84422e+06
Now with regularization...
Begin: 5.53478e+06
0 5.53458e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 4 event 222478 TrkackID 0 startx, y, z 71.3841 600.844 41.8833 wireno, peakt tpcno 458 5239.63 5 dist 0min T, max_T4934.21 5855.52
no of hits closeby 0 event 222478 TrkackID 2 startx, y, z -218.131 503.838 220.647 wireno, peakt tpcno 27 2454.78 2 dist 0min T, max_T5.47683 2794.89
no of hits closeby 4 event 222478 TrkackID 0 startx, y, z 71.3841 600.844 41.8833 wireno, peakt tpcno 458 5239.63 5 dist 0min T, max_T4934.21 5855.52
no of hits closeby 0 event 222478 TrkackID 2 startx, y, z -218.131 503.838 220.647 wireno, peakt tpcno 27 2454.78 2 dist 0min T, max_T5.47683 2794.89
26-Sep-2024 18:09:36 BST Closed output file "np04hd_raw_run029092_0926_dataflow6_datawriter_0_20240906T075019_reco_stage1_reco_stage2_20240926T170936_keepup.root"
26-Sep-2024 18:09:36 BST Closed input file "np04hd_raw_run029092_0926_dataflow6_datawriter_0_20240906T075019_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 148.419 225.843 398.519 222.978 51.3322 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000484787 0.00334572 0.0282043 0.00266568 0.00473419 30
produce:fembfilter:PDHDFEMBFilter 0.855724 1.07269 1.85654 0.901024 0.291108 30
produce:wclsdatahd:WireCellToolkit 66.7667 76.3371 101.518 74.4149 9.06465 30
produce:gaushit:GausHitFinder 0.875695 1.35994 2.32094 1.28417 0.351081 30
produce:nhitsfilter:NumberOfHitsFilter 0.000437746 0.000603649 0.000870084 0.000591995 0.000119202 30
produce:reco3d:SpacePointSolver 0.231658 1.37933 3.72675 1.2606 0.881648 30
produce:hitpdune:DisambigFromSpacePoints 0.315171 1.16683 3.53286 1.04406 0.657946 30
produce:pandora:StandardPandora 10.7926 24.7233 82.8344 20.9906 14.1018 30
produce:pandoraWriter:StandardPandora 0.130276 0.217044 0.486153 0.207977 0.0669902 30
produce:pandoraTrack:LArPandoraTrackCreation 0.757256 2.28282 6.18306 2.03095 1.16886 30
produce:pandoraShower:LArPandoraShowerCreation 0.89055 2.56081 7.19878 2.25144 1.52301 30
produce:pandoracalo:Calorimetry 0.424784 1.11763 2.84925 1.04997 0.512764 30
produce:pandoracalonosce:Calorimetry 0.373523 1.0163 2.62918 0.928229 0.478888 30
produce:pandorapid:Chi2ParticleID 0.00185067 0.0051534 0.0672781 0.00276604 0.0115742 30
produce:pandoraShowercalo:ShowerCalorimetry 0.743801 2.2541 6.43657 2.00989 1.34736 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.72855 2.21111 6.19329 2.00709 1.28864 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.109832 0.226717 0.576246 0.216439 0.0829153 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.039057 0.0799556 0.211607 0.0745414 0.0302327 30
produce:emtrkmichelid:EmTrackMichelId 61.0188 104.783 207.006 99.8769 30.1077 30
[art]:TriggerResults:TriggerResultInserter 2.5853e-05 4.01693e-05 9.3876e-05 3.70835e-05 1.30803e-05 30
end_path:out1:RootOutput 8.881e-06 0.000154632 0.0043133 1.0596e-05 0.000772252 30
end_path:michelremoving:michelremoving 0.0269175 0.34955 1.48128 0.0758757 0.39666 30
end_path:michelremovinggnocchi:michelremoving 0.0245774 0.333311 1.47548 0.0525363 0.395104 30
end_path:calibanagnocchi:CalibAnaTree 0.34045 0.836131 1.94456 0.760109 0.324847 30
end_path:out1:RootOutput(write) 0.763271 1.23075 1.88357 1.20709 0.266161 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4941.99 MB
Peak resident set size usage (VmHWM): 2596.7 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029092_0926_dataflow6_datawriter_0_20240906T075019_reco_stage1_reco_stage2_20240926T170936_keepup.root
\tHists: np04hd_raw_run029092_0926_dataflow6_datawriter_0_20240906T075019_reco_stage1_reco_stage2_20240926T170936_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
