Jobsub ID 263283.112@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 263283.112@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3447 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 09:56:54 |
| Site | FR_CCIN2P3 |
| Entry | DUNE_FR_CCIN2P3_cccondorce01 |
| Last heartbeat | 2024-09-26 11:19:02 |
| From worker node | Hostname | ccwcondor0640 |
| cpuinfo | AMD EPYC 7453 28-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 106200 (29 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 09:59:00 |
| Input files | hd-protodune:np04hd_raw_run029081_1067_dataflow5_datawriter_0_20240905T100300.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 11:18:59 |
| Saved logs | justin-logs:263283.112-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
- empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 3 event 256301 TrkackID 9 startx, y, z 11.5709 592.939 217.554 wireno, peakt tpcno 63 5152.58 5 dist 0min T, max_T5144.3 5722.22
no of hits closeby 3 event 256301 TrkackID 9 startx, y, z 11.5709 592.939 217.554 wireno, peakt tpcno 63 5152.58 5 dist 0min T, max_T5144.3 5722.22
Begin processing the 29th record. run: 29081 subRun: 1 event: 256309 at 26-Sep-2024 13:05:26 CEST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 65343 traces, 65343 summary
Retagger: tagging trace set: gauss with 47717 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 47717 traces tagged "gauss"
FrameSaver: q=1.06405e+06 n=863764 tag=gauss
wclsFrameSaver: saving 65343 traces tagged "wiener"
FrameSaver: q=1.15585e+06 n=773288 tag=wiener
3567 hits in TPC 0
3242 hits in TPC 1
4452 hits in TPC 2
2267 hits in TPC 3
4654 hits in TPC 4
5293 hits in TPC 5
5563 hits in TPC 6
3625 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1518 XUs and 819 XVs -> 40 XUVs
C:0 T:2 12370 XUs and 7781 XVs -> 403 XUVs
C:0 T:3 28 XUs and 28 XVs -> 4 XUVs
C:0 T:4 53 XUs and 14 XVs -> 2 XUVs
C:0 T:5 42062 XUs and 38460 XVs -> 1157 XUVs
C:0 T:6 15487 XUs and 15664 XVs -> 909 XUVs
C:0 T:7 847 XUs and 843 XVs -> 38 XUVs
2553 XUVs total
1010 collection wire objects
2553 potential space points
Neighbour search...
50263 tests to find 30106 neighbours
Iterating with no regularization...
Begin: 8.07579e+06
0 7.3427e+06
1 7.28628e+06
2 7.27995e+06
Now with regularization...
Begin: 6.73199e+06
0 6.72973e+06
TestBeamParticleCreationAlgorithm::SetupTestBeamVertex - Test beam particle has no initial vertex
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 30th record. run: 29081 subRun: 1 event: 256317 at 26-Sep-2024 13:06:59 CEST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 69867 traces, 69867 summary
Retagger: tagging trace set: gauss with 53352 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 53352 traces tagged "gauss"
FrameSaver: q=1.21154e+06 n=1017666 tag=gauss
wclsFrameSaver: saving 69867 traces tagged "wiener"
FrameSaver: q=1.31238e+06 n=927280 tag=wiener
1279 hits in TPC 0
2486 hits in TPC 1
9062 hits in TPC 2
4411 hits in TPC 3
2823 hits in TPC 4
4430 hits in TPC 5
8726 hits in TPC 6
4379 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 0 XUs and 0 XVs -> 0 XUVs
C:0 T:2 59069 XUs and 69990 XVs -> 3550 XUVs
C:0 T:3 729 XUs and 667 XVs -> 25 XUVs
C:0 T:4 70 XUs and 96 XVs -> 0 XUVs
C:0 T:5 11711 XUs and 16737 XVs -> 1124 XUVs
C:0 T:6 34768 XUs and 28045 XVs -> 1130 XUVs
C:0 T:7 428 XUs and 501 XVs -> 32 XUVs
5861 XUVs total
1977 collection wire objects
5861 potential space points
Neighbour search...
388993 tests to find 164914 neighbours
Iterating with no regularization...
Begin: 2.00272e+07
0 1.57042e+07
1 1.52372e+07
2 1.51918e+07
3 1.51806e+07
Now with regularization...
Begin: 1.43688e+07
0 1.43615e+07
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 256317 TrkackID 2 startx, y, z 165.784 119.218 460.527 wireno, peakt tpcno 133 5513.51 6 dist 343.113min T, max_T2586.26 5520.05
no of hits closeby 0 event 256317 TrkackID 2 startx, y, z 165.784 119.218 460.527 wireno, peakt tpcno 133 5513.51 6 dist 343.113min T, max_T2586.26 5520.05
26-Sep-2024 13:09:03 CEST Closed output file "np04hd_raw_run029081_1067_dataflow5_datawriter_0_20240905T100300_reco_stage1_reco_stage2_20240926T110903_keepup.root"
26-Sep-2024 13:09:03 CEST Closed input file "np04hd_raw_run029081_1067_dataflow5_datawriter_0_20240905T100300_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 72.2651 101.247 143.87 97.5139 18.5251 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000576651 0.00299595 0.00656622 0.00307326 0.00132691 30
produce:fembfilter:PDHDFEMBFilter 0.648766 0.843936 1.44192 0.774905 0.177741 30
produce:wclsdatahd:WireCellToolkit 35.4556 40.1487 45.8782 40.4298 2.58911 30
produce:gaushit:GausHitFinder 0.450498 0.699868 1.14001 0.667887 0.188763 30
produce:nhitsfilter:NumberOfHitsFilter 0.000232426 0.000346776 0.000719528 0.000345974 8.81394e-05 30
produce:reco3d:SpacePointSolver 0.252907 0.949252 3.06398 0.809042 0.669582 30
produce:hitpdune:DisambigFromSpacePoints 0.219929 0.552544 1.2084 0.482881 0.27049 30
produce:pandora:StandardPandora 5.20918 13.414 28.9427 11.5669 5.51321 30
produce:pandoraWriter:StandardPandora 0.0947755 0.15624 0.2252 0.156468 0.0341915 30
produce:pandoraTrack:LArPandoraTrackCreation 0.405728 1.85169 3.69112 1.65718 0.806224 30
produce:pandoraShower:LArPandoraShowerCreation 0.510988 2.42546 5.23722 2.29841 1.3128 30
produce:pandoracalo:Calorimetry 0.2731 0.884726 1.74034 0.846941 0.371593 30
produce:pandoracalonosce:Calorimetry 0.21219 0.836991 1.71175 0.753873 0.349891 30
produce:pandorapid:Chi2ParticleID 0.00101993 0.00222791 0.00531741 0.00215712 0.000846633 30
produce:pandoraShowercalo:ShowerCalorimetry 0.45325 2.05885 4.33379 1.9215 1.0283 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.442244 2.00989 5.90211 1.69692 1.145 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.075157 0.149363 0.240315 0.154011 0.0465122 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0279128 0.0542925 0.0959271 0.0526974 0.0161769 30
produce:emtrkmichelid:EmTrackMichelId 21.7707 32.3884 47.1826 30.7203 6.75541 30
[art]:TriggerResults:TriggerResultInserter 2.8824e-05 6.32706e-05 0.000159809 6.3614e-05 2.32648e-05 30
end_path:out1:RootOutput 1.0018e-05 1.8277e-05 4.8411e-05 1.8234e-05 6.51752e-06 30
end_path:michelremoving:michelremoving 0.02289 0.114499 0.431964 0.0571175 0.10394 30
end_path:michelremovinggnocchi:michelremoving 0.0231958 0.112247 0.469627 0.0561782 0.106783 30
end_path:calibanagnocchi:CalibAnaTree 0.200336 0.603178 1.03883 0.534003 0.234341 30
end_path:out1:RootOutput(write) 0.589443 0.768836 1.32946 0.741254 0.18335 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4926.33 MB
Peak resident set size usage (VmHWM): 2354.91 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029081_1067_dataflow5_datawriter_0_20240905T100300_reco_stage1_reco_stage2_20240926T110903_keepup.root
\tHists: np04hd_raw_run029081_1067_dataflow5_datawriter_0_20240905T100300_reco_stage1_reco_stage2_20240926T110903_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
