Jobsub ID 78424.10@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 78424.10@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3450 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 09:30:34 |
| Site | FR_CCIN2P3 |
| Entry | DUNE_FR_CCIN2P3_cccondorce02 |
| Last heartbeat | 2024-09-26 11:00:35 |
| From worker node | Hostname | ccwcondor0701.in2p3.fr |
| cpuinfo | AMD EPYC 7302 16-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 106200 (29 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 09:48:15 |
| Input files | hd-protodune:np04hd_raw_run029107_1510_dataflow4_datawriter_0_20240907T164722.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 11:00:35 |
| Saved logs | justin-logs:78424.10-justin-prod-sched02.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
ts in TPC 4
4492 hits in TPC 5
5668 hits in TPC 6
2649 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 301 XUs and 291 XVs -> 31 XUVs
C:0 T:2 15748 XUs and 19079 XVs -> 764 XUVs
C:0 T:3 4 XUs and 6 XVs -> 0 XUVs
C:0 T:4 128 XUs and 236 XVs -> 14 XUVs
C:0 T:5 10942 XUs and 12228 XVs -> 506 XUVs
C:0 T:6 32717 XUs and 22266 XVs -> 1435 XUVs
C:0 T:7 72 XUs and 169 XVs -> 3 XUVs
2753 XUVs total
1497 collection wire objects
2753 potential space points
Neighbour search...
159175 tests to find 48608 neighbours
Iterating with no regularization...
Begin: 7.39699e+06
0 6.26105e+06
1 6.18095e+06
2 6.17394e+06
3 6.17257e+06
Now with regularization...
Begin: 5.79651e+06
0 5.79523e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 29th record. run: 29107 subRun: 1 event: 362652 at 26-Sep-2024 12:47:51 CEST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 75970 traces, 75970 summary
Retagger: tagging trace set: gauss with 54431 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 54431 traces tagged "gauss"
FrameSaver: q=1.14677e+06 n=960334 tag=gauss
wclsFrameSaver: saving 75970 traces tagged "wiener"
FrameSaver: q=1.24798e+06 n=858218 tag=wiener
3282 hits in TPC 0
3316 hits in TPC 1
7154 hits in TPC 2
3406 hits in TPC 3
4423 hits in TPC 4
7258 hits in TPC 5
4954 hits in TPC 6
2484 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 168 XUs and 175 XVs -> 3 XUVs
C:0 T:2 68734 XUs and 25007 XVs -> 671 XUVs
C:0 T:3 375 XUs and 466 XVs -> 11 XUVs
C:0 T:4 4 XUs and 1 XVs -> 0 XUVs
C:0 T:5 23527 XUs and 26119 XVs -> 657 XUVs
C:0 T:6 21417 XUs and 20967 XVs -> 447 XUVs
C:0 T:7 9 XUs and 18 XVs -> 0 XUVs
1789 XUVs total
1180 collection wire objects
1789 potential space points
Neighbour search...
23903 tests to find 13974 neighbours
Iterating with no regularization...
Begin: 1.62905e+07
0 1.5312e+07
1 1.52631e+07
2 1.52591e+07
Now with regularization...
Begin: 1.48608e+07
0 1.48591e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 30th record. run: 29107 subRun: 1 event: 362660 at 26-Sep-2024 12:49:17 CEST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 38069 traces, 38069 summary
Retagger: tagging trace set: gauss with 27937 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 27937 traces tagged "gauss"
FrameSaver: q=634946 n=533119 tag=gauss
wclsFrameSaver: saving 38069 traces tagged "wiener"
FrameSaver: q=671519 n=476973 tag=wiener
1080 hits in TPC 0
2299 hits in TPC 1
2001 hits in TPC 2
1026 hits in TPC 3
1585 hits in TPC 4
3248 hits in TPC 5
5099 hits in TPC 6
3301 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 41 XUs and 35 XVs -> 3 XUVs
C:0 T:2 3215 XUs and 2282 XVs -> 106 XUVs
C:0 T:3 92 XUs and 215 XVs -> 7 XUVs
C:0 T:4 102 XUs and 135 XVs -> 7 XUVs
C:0 T:5 8158 XUs and 5588 XVs -> 222 XUVs
C:0 T:6 14181 XUs and 15345 XVs -> 783 XUVs
C:0 T:7 500 XUs and 334 XVs -> 6 XUVs
1134 XUVs total
723 collection wire objects
1134 potential space points
Neighbour search...
15086 tests to find 9008 neighbours
Iterating with no regularization...
Begin: 3.23759e+06
0 3.10377e+06
1 3.09857e+06
2 3.09791e+06
Now with regularization...
Begin: 2.83302e+06
0 2.83279e+06
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 12:50:21 CEST Closed output file "np04hd_raw_run029107_1510_dataflow4_datawriter_0_20240907T164722_reco_stage1_reco_stage2_20240926T105021_keepup.root"
26-Sep-2024 12:50:21 CEST Closed input file "np04hd_raw_run029107_1510_dataflow4_datawriter_0_20240907T164722_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 60.3747 85.9355 111.739 85.5726 12.6428 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000451879 0.00239901 0.00480478 0.00219289 0.00119087 30
produce:fembfilter:PDHDFEMBFilter 0.539669 0.658048 1.81545 0.604479 0.222175 30
produce:wclsdatahd:WireCellToolkit 36.3061 40.2004 46.1101 39.9559 1.93258 30
produce:gaushit:GausHitFinder 0.294046 0.580212 0.898267 0.566022 0.141755 30
produce:nhitsfilter:NumberOfHitsFilter 0.0002551 0.000420048 0.00109427 0.000390745 0.000151269 30
produce:reco3d:SpacePointSolver 0.122268 0.633995 1.91377 0.576213 0.372005 30
produce:hitpdune:DisambigFromSpacePoints 0.100883 0.377177 0.65209 0.362382 0.137967 30
produce:pandora:StandardPandora 3.39297 10.3584 20.0507 10.3736 3.66612 30
produce:pandoraWriter:StandardPandora 0.0631401 0.129416 0.20704 0.11859 0.0382655 30
produce:pandoraTrack:LArPandoraTrackCreation 0.325411 0.961402 1.81729 0.910084 0.365919 30
produce:pandoraShower:LArPandoraShowerCreation 0.25902 1.11044 2.19458 1.04397 0.498348 30
produce:pandoracalo:Calorimetry 0.189009 0.505383 0.916055 0.506294 0.170715 30
produce:pandoracalonosce:Calorimetry 0.159427 0.465714 0.833645 0.445283 0.164887 30
produce:pandorapid:Chi2ParticleID 0.000955586 0.00173922 0.00430595 0.00158721 0.000652028 30
produce:pandoraShowercalo:ShowerCalorimetry 0.246097 1.03483 2.01214 0.973081 0.434718 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.246041 1.00272 2.17395 0.892207 0.439001 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0769457 0.122336 0.233978 0.107624 0.0389731 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0181715 0.0404985 0.068952 0.0383161 0.0128422 30
produce:emtrkmichelid:EmTrackMichelId 12.6565 26.371 38.3764 26.608 6.09986 30
[art]:TriggerResults:TriggerResultInserter 1.8856e-05 4.00476e-05 8.1864e-05 3.48605e-05 1.78845e-05 30
end_path:out1:RootOutput 6.813e-06 1.06875e-05 2.6209e-05 8.9215e-06 4.8105e-06 30
end_path:michelremoving:michelremoving 0.0154095 0.0748702 0.383308 0.0318603 0.0867439 30
end_path:michelremovinggnocchi:michelremoving 0.0140417 0.0705683 0.417009 0.0309954 0.0863907 30
end_path:calibanagnocchi:CalibAnaTree 0.11259 0.370816 0.616344 0.375992 0.129993 30
end_path:out1:RootOutput(write) 0.41267 0.740421 1.063 0.720821 0.182048 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4895.66 MB
Peak resident set size usage (VmHWM): 2318 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_1510_dataflow4_datawriter_0_20240907T164722_reco_stage1_reco_stage2_20240926T105021_keepup.root
\tHists: np04hd_raw_run029107_1510_dataflow4_datawriter_0_20240907T164722_reco_stage1_reco_stage2_20240926T105021_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
