Jobsub ID 79114.2@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 79114.2@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3449 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 14:31:11 |
| Site | UK_Brunel |
| Entry | CMSHTPC_T2_UK_London_Brunel_dc2_22 |
| Last heartbeat | 2024-09-26 15:50:22 |
| From worker node | Hostname | wn-b8-27-00.brunel.ac.uk |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 14:31:43 |
| Input files | hd-protodune:np04hd_raw_run029107_0860_dataflow2_datawriter_0_20240907T044430.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 15:50:22 |
| Saved logs | justin-logs:79114.2-justin-prod-sched02.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
ts - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 12 event 206642 TrkackID 24 startx, y, z 12.8061 107.869 451.294 wireno, peakt tpcno 440 5649.23 5 dist 7.57624min T, max_T5549.62 5721.53
no of hits closeby 12 event 206642 TrkackID 24 startx, y, z 12.8061 107.869 451.294 wireno, peakt tpcno 440 5649.23 5 dist 7.57624min T, max_T5549.62 5721.53
Begin processing the 29th record. run: 29107 subRun: 1 event: 206650 at 26-Sep-2024 16:46:46 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 86929 traces, 86929 summary
Retagger: tagging trace set: gauss with 63868 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 63868 traces tagged "gauss"
FrameSaver: q=1.34622e+06 n=1175787 tag=gauss
wclsFrameSaver: saving 86929 traces tagged "wiener"
FrameSaver: q=1.45537e+06 n=1065585 tag=wiener
3794 hits in TPC 0
2976 hits in TPC 1
9031 hits in TPC 2
4674 hits in TPC 3
3412 hits in TPC 4
7060 hits in TPC 5
9848 hits in TPC 6
4950 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 163 XUs and 224 XVs -> 39 XUVs
C:0 T:2 36175 XUs and 65404 XVs -> 1346 XUVs
C:0 T:3 432 XUs and 730 XVs -> 8 XUVs
C:0 T:4 298 XUs and 248 XVs -> 4 XUVs
C:0 T:5 23502 XUs and 21378 XVs -> 370 XUVs
C:0 T:6 39494 XUs and 62306 XVs -> 1532 XUVs
C:0 T:7 176 XUs and 132 XVs -> 8 XUVs
3307 XUVs total
1633 collection wire objects
3307 potential space points
Neighbour search...
70035 tests to find 40474 neighbours
Iterating with no regularization...
Begin: 9.64453e+06
0 9.16845e+06
1 9.1385e+06
2 9.13625e+06
Now with regularization...
Begin: 8.54989e+06
0 8.54914e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 1 event 206650 TrkackID 4 startx, y, z 164.222 586.567 235.386 wireno, peakt tpcno 457 2028.18 2 dist 196.705min T, max_T5 2041
no of hits closeby 2 event 206650 TrkackID 18 startx, y, z 146.343 259.3 354.073 wireno, peakt tpcno 393 1774.1 5 dist 0min T, max_T4.66938 1858.05
no of hits closeby 1 event 206650 TrkackID 4 startx, y, z 164.222 586.567 235.386 wireno, peakt tpcno 457 2028.18 2 dist 196.705min T, max_T5 2041
no of hits closeby 2 event 206650 TrkackID 18 startx, y, z 146.343 259.3 354.073 wireno, peakt tpcno 393 1774.1 5 dist 0min T, max_T4.66938 1858.05
Begin processing the 30th record. run: 29107 subRun: 1 event: 206666 at 26-Sep-2024 16:48:40 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 49307 traces, 49307 summary
Retagger: tagging trace set: gauss with 36390 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 36390 traces tagged "gauss"
FrameSaver: q=740746 n=670384 tag=gauss
wclsFrameSaver: saving 49307 traces tagged "wiener"
FrameSaver: q=799220 n=603436 tag=wiener
784 hits in TPC 0
1408 hits in TPC 1
6448 hits in TPC 2
4134 hits in TPC 3
1217 hits in TPC 4
2645 hits in TPC 5
6532 hits in TPC 6
4033 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 192 XUs and 270 XVs -> 15 XUVs
C:0 T:2 40600 XUs and 54401 XVs -> 1541 XUVs
C:0 T:3 83 XUs and 73 XVs -> 2 XUVs
C:0 T:4 86 XUs and 119 XVs -> 13 XUVs
C:0 T:5 2079 XUs and 1758 XVs -> 61 XUVs
C:0 T:6 35104 XUs and 69028 XVs -> 1450 XUVs
C:0 T:7 1869 XUs and 1487 XVs -> 521 XUVs
3603 XUVs total
975 collection wire objects
3603 potential space points
Neighbour search...
326275 tests to find 168648 neighbours
Iterating with no regularization...
Begin: 3.95231e+06
0 3.45037e+06
1 3.41166e+06
2 3.40368e+06
3 3.40091e+06
Now with regularization...
Begin: 3.21364e+06
0 3.21201e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 16:49:58 BST Closed output file "np04hd_raw_run029107_0860_dataflow2_datawriter_0_20240907T044430_reco_stage1_reco_stage2_20240926T154958_keepup.root"
26-Sep-2024 16:49:58 BST Closed input file "np04hd_raw_run029107_0860_dataflow2_datawriter_0_20240907T044430_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 72.1054 91.9679 116.91 89.8028 11.6539 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000341106 0.00120865 0.0022021 0.00130101 0.000606747 30
produce:fembfilter:PDHDFEMBFilter 0.626994 0.639756 0.700632 0.634792 0.0160022 30
produce:wclsdatahd:WireCellToolkit 42.6706 45.7141 49.9775 45.1909 1.73383 30
produce:gaushit:GausHitFinder 0.475335 0.750528 1.06734 0.733787 0.162344 30
produce:nhitsfilter:NumberOfHitsFilter 0.000166807 0.000291462 0.000416168 0.00029353 7.53591e-05 30
produce:reco3d:SpacePointSolver 0.148615 0.772991 2.79159 0.694368 0.628954 30
produce:hitpdune:DisambigFromSpacePoints 0.183359 0.546798 1.03399 0.489489 0.263361 30
produce:pandora:StandardPandora 5.85557 12.5245 24.6383 11.9499 4.4278 30
produce:pandoraWriter:StandardPandora 0.0897878 0.129005 0.169747 0.129951 0.0253665 30
produce:pandoraTrack:LArPandoraTrackCreation 0.494395 1.05625 1.61417 1.05057 0.313339 30
produce:pandoraShower:LArPandoraShowerCreation 0.463262 1.22916 2.12792 1.22356 0.450504 30
produce:pandoracalo:Calorimetry 0.283766 0.550993 0.814897 0.556081 0.144459 30
produce:pandoracalonosce:Calorimetry 0.251471 0.500934 0.747743 0.508737 0.133312 30
produce:pandorapid:Chi2ParticleID 0.00119199 0.0017385 0.00289915 0.00171787 0.00034714 30
produce:pandoraShowercalo:ShowerCalorimetry 0.403979 1.13584 1.99247 1.14485 0.419249 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.395323 1.111 1.9175 1.11583 0.408598 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0838056 0.128871 0.176993 0.126032 0.0254972 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0290665 0.0447442 0.0598455 0.0445326 0.00832303 30
produce:emtrkmichelid:EmTrackMichelId 16.871 23.6205 31.0631 23.7086 4.3484 30
[art]:TriggerResults:TriggerResultInserter 1.621e-05 2.17737e-05 6.1677e-05 1.9167e-05 8.23205e-06 30
end_path:out1:RootOutput 3.182e-06 7.62427e-06 2.188e-05 7.0415e-06 2.99186e-06 30
end_path:michelremoving:michelremoving 0.0177773 0.108166 0.358393 0.102158 0.0903445 30
end_path:michelremovinggnocchi:michelremoving 0.0168523 0.105884 0.354585 0.100706 0.0899011 30
end_path:calibanagnocchi:CalibAnaTree 0.264417 0.452937 0.730035 0.432339 0.113152 30
end_path:out1:RootOutput(write) 0.516199 0.776306 1.21195 0.77786 0.171124 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4945.87 MB
Peak resident set size usage (VmHWM): 2591.88 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_0860_dataflow2_datawriter_0_20240907T044430_reco_stage1_reco_stage2_20240926T154958_keepup.root
\tHists: np04hd_raw_run029107_0860_dataflow2_datawriter_0_20240907T044430_reco_stage1_reco_stage2_20240926T154958_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
