Jobsub ID 263765.80@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 263765.80@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3451 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 13:24:52 |
| Site | UK_Sheffield |
| Entry | DUNE_UK_Sheffield_lcgce1 |
| Last heartbeat | 2024-09-26 14:41:14 |
| From worker node | Hostname | wn032.hep |
| cpuinfo | Intel(R) Xeon(R) Gold 6226 CPU @ 2.70GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 13:26:16 |
| Input files | hd-protodune:np04hd_raw_run029107_2220_dataflow7_datawriter_0_20240908T035331.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 14:41:14 |
| Saved logs | justin-logs:263765.80-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
y calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 533039 TrkackID 2 startx, y, z 234.843 468.664 402.098 wireno, peakt tpcno 464 2998.35 2 dist 319.558min T, max_T6.4546 3004.41
no of hits closeby 0 event 533039 TrkackID 2 startx, y, z 234.843 468.664 402.098 wireno, peakt tpcno 464 2998.35 2 dist 319.558min T, max_T6.4546 3004.41
Begin processing the 29th record. run: 29107 subRun: 1 event: 533047 at 26-Sep-2024 15:35:22 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 64913 traces, 64913 summary
Retagger: tagging trace set: gauss with 49182 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 49182 traces tagged "gauss"
FrameSaver: q=1.06045e+06 n=893756 tag=gauss
wclsFrameSaver: saving 64913 traces tagged "wiener"
FrameSaver: q=1.1401e+06 n=805857 tag=wiener
3760 hits in TPC 0
3318 hits in TPC 1
6654 hits in TPC 2
3800 hits in TPC 3
3986 hits in TPC 4
5720 hits in TPC 5
4816 hits in TPC 6
2243 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 637 XUs and 652 XVs -> 48 XUVs
C:0 T:2 26262 XUs and 34422 XVs -> 1262 XUVs
C:0 T:3 216 XUs and 307 XVs -> 11 XUVs
C:0 T:4 520 XUs and 1044 XVs -> 48 XUVs
C:0 T:5 11791 XUs and 14810 XVs -> 1520 XUVs
C:0 T:6 25318 XUs and 20852 XVs -> 417 XUVs
C:0 T:7 38 XUs and 18 XVs -> 0 XUVs
3306 XUVs total
1472 collection wire objects
3306 potential space points
Neighbour search...
152886 tests to find 90806 neighbours
Iterating with no regularization...
Begin: 8.8958e+06
0 8.39152e+06
1 8.35296e+06
2 8.34728e+06
Now with regularization...
Begin: 7.73708e+06
0 7.73471e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 6 event 533047 TrkackID 10 startx, y, z 58.4697 295.316 11.9927 wireno, peakt tpcno 132 858.811 2 dist 167.515min T, max_T6.17098 930.5
no of hits closeby 6 event 533047 TrkackID 10 startx, y, z 58.4697 295.316 11.9927 wireno, peakt tpcno 132 858.811 2 dist 167.515min T, max_T6.17098 930.5
Begin processing the 30th record. run: 29107 subRun: 1 event: 533055 at 26-Sep-2024 15:36:42 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 51128 traces, 51128 summary
Retagger: tagging trace set: gauss with 37725 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 37725 traces tagged "gauss"
FrameSaver: q=765744 n=694192 tag=gauss
wclsFrameSaver: saving 51128 traces tagged "wiener"
FrameSaver: q=826908 n=619157 tag=wiener
2371 hits in TPC 0
2912 hits in TPC 1
6470 hits in TPC 2
2394 hits in TPC 3
1815 hits in TPC 4
2604 hits in TPC 5
5689 hits in TPC 6
3100 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 49 XUs and 50 XVs -> 3 XUVs
C:0 T:2 32224 XUs and 39655 XVs -> 1762 XUVs
C:0 T:3 0 XUs and 2 XVs -> 0 XUVs
C:0 T:4 64 XUs and 82 XVs -> 5 XUVs
C:0 T:5 3830 XUs and 2542 XVs -> 142 XUVs
C:0 T:6 21468 XUs and 37661 XVs -> 1469 XUVs
C:0 T:7 405 XUs and 329 XVs -> 22 XUVs
3403 XUVs total
1203 collection wire objects
3403 potential space points
Neighbour search...
167963 tests to find 93430 neighbours
Iterating with no regularization...
Begin: 6.52558e+06
0 5.44993e+06
1 5.39633e+06
2 5.38815e+06
3 5.38599e+06
Now with regularization...
Begin: 5.11663e+06
0 5.11547e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 1 event 533055 TrkackID 11 startx, y, z -44.1318 75.5942 232.493 wireno, peakt tpcno 289 3222.21 6 dist 0min T, max_T3222.21 3805.13
no of hits closeby 1 event 533055 TrkackID 11 startx, y, z -44.1318 75.5942 232.493 wireno, peakt tpcno 289 3222.21 6 dist 0min T, max_T3222.21 3805.13
26-Sep-2024 15:37:51 BST Closed output file "np04hd_raw_run029107_2220_dataflow7_datawriter_0_20240908T035331_reco_stage1_reco_stage2_20240926T143751_keepup.root"
26-Sep-2024 15:37:51 BST Closed input file "np04hd_raw_run029107_2220_dataflow7_datawriter_0_20240908T035331_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 52.2945 86.9597 138.749 82.7251 17.4406 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000402339 0.00145648 0.00383849 0.00113715 0.00101728 30
produce:fembfilter:PDHDFEMBFilter 0.603163 0.627118 0.753627 0.615362 0.0330032 30
produce:wclsdatahd:WireCellToolkit 43.7627 47.6784 50.1638 48.0458 1.48555 30
produce:gaushit:GausHitFinder 0.343017 0.691064 1.08899 0.662221 0.166262 30
produce:nhitsfilter:NumberOfHitsFilter 0.000272478 0.000437558 0.000611736 0.000418362 8.32868e-05 30
produce:reco3d:SpacePointSolver 0.23129 0.898658 2.07578 0.612609 0.564373 29
produce:hitpdune:DisambigFromSpacePoints 0.163776 0.510072 1.22583 0.491448 0.197595 29
produce:pandora:StandardPandora 4.59354 11.6417 27.6872 9.37131 5.79421 29
produce:pandoraWriter:StandardPandora 0.0771528 0.159812 0.263263 0.15125 0.0375119 29
produce:pandoraTrack:LArPandoraTrackCreation 0.458876 2.42672 6.68679 2.21094 1.23245 29
produce:pandoraShower:LArPandoraShowerCreation 0.424612 2.74792 9.28763 2.24366 1.74634 29
produce:pandoracalo:Calorimetry 0.214404 0.959935 2.68076 0.87317 0.463247 29
produce:pandoracalonosce:Calorimetry 0.189992 0.892003 2.49676 0.853049 0.431126 29
produce:pandorapid:Chi2ParticleID 0.00111677 0.00180206 0.00279359 0.00179143 0.000339114 29
produce:pandoraShowercalo:ShowerCalorimetry 0.342333 2.30476 7.36189 1.92005 1.44261 29
produce:pandoraShowercalonosce:ShowerCalorimetry 0.340774 2.23048 6.36187 1.81515 1.35303 29
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0576707 0.117817 0.171163 0.119281 0.0231078 29
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.022378 0.0484623 0.0806988 0.0461611 0.0108813 29
produce:emtrkmichelid:EmTrackMichelId 7.02113 12.4944 19.9679 12.1658 2.56922 29
[art]:TriggerResults:TriggerResultInserter 3.0881e-05 4.68629e-05 9.3241e-05 4.4547e-05 1.24937e-05 30
end_path:out1:RootOutput 8.081e-06 1.25925e-05 2.909e-05 1.14305e-05 5.04176e-06 30
end_path:michelremoving:michelremoving 3.2332e-05 0.103049 0.312794 0.0980764 0.0750542 30
end_path:michelremovinggnocchi:michelremoving 2.6064e-05 0.0989559 0.313487 0.0931312 0.0745591 30
end_path:calibanagnocchi:CalibAnaTree 2.4264e-05 0.67276 1.84926 0.62186 0.366088 30
end_path:out1:RootOutput(write) 0.338827 0.67675 1.09843 0.669587 0.157301 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5882.99 MB
Peak resident set size usage (VmHWM): 2667.03 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_2220_dataflow7_datawriter_0_20240908T035331_reco_stage1_reco_stage2_20240926T143751_keepup.root
\tHists: np04hd_raw_run029107_2220_dataflow7_datawriter_0_20240908T035331_reco_stage1_reco_stage2_20240926T143751_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
