Jobsub ID 263872.0@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 263872.0@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3448 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 13:58:59 |
| Site | IT_CNAF |
| Entry | CMSHTPC_T1_IT_CNAF_condor_ce02 |
| Last heartbeat | 2024-09-26 16:00:45 |
| From worker node | Hostname | cn-316-01-02.cr.cnaf.infn.it |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2697 v4 @ 2.30GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 14:00:01 |
| Input files | hd-protodune:np04hd_raw_run029097_0198_dataflow1_datawriter_0_20240906T143430.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 16:00:45 |
| Saved logs | justin-logs:263872.0-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
944138 0.00117683
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000120878 0.000120759 0.000120759 0.000120878 0.000120878 0.000120759 0.000120878 0.000120759 0.000120759 0.000120878 0.000120759
----view 1: 0.0131221 0.000470161 0.000470161 0.00665331 0.00639725 0.00437737 0.000987053 0.000945091 0.000944138 0.00117683 0.00100946
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000120759 0.000120759 0.000120878 0.000120878 0.000120759 0.000120878 0.000120759 0.000120759 0.000120878 0.000120759 0.000120878
----view 1: 0.000470161 0.000470161 0.00665331 0.00639725 0.00437737 0.000987053 0.000945091 0.000944138 0.00117683 0.00100946 0.000600815
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 29th record. run: 29097 subRun: 1 event: 47769 at 26-Sep-2024 17:52:03 CEST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 97002 traces, 97002 summary
Retagger: tagging trace set: gauss with 70727 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 70727 traces tagged "gauss"
FrameSaver: q=1.48493e+06 n=1282766 tag=gauss
wclsFrameSaver: saving 97002 traces tagged "wiener"
FrameSaver: q=1.58534e+06 n=1148413 tag=wiener
4208 hits in TPC 0
5935 hits in TPC 1
6034 hits in TPC 2
3742 hits in TPC 3
6661 hits in TPC 4
12394 hits in TPC 5
6241 hits in TPC 6
3903 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 134 XUs and 112 XVs -> 1 XUVs
C:0 T:2 17149 XUs and 22108 XVs -> 375 XUVs
C:0 T:3 43 XUs and 67 XVs -> 1 XUVs
C:0 T:4 222 XUs and 190 XVs -> 6 XUVs
C:0 T:5 76237 XUs and 61794 XVs -> 1449 XUVs
C:0 T:6 22036 XUs and 24860 XVs -> 359 XUVs
C:0 T:7 205 XUs and 234 XVs -> 20 XUVs
2211 XUVs total
1439 collection wire objects
2211 potential space points
Neighbour search...
37603 tests to find 21744 neighbours
Iterating with no regularization...
Begin: 6.23259e+06
0 5.74895e+06
1 5.72754e+06
2 5.72481e+06
Now with regularization...
Begin: 5.35109e+06
0 5.34994e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 30th record. run: 29097 subRun: 1 event: 47777 at 26-Sep-2024 17:56:20 CEST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 93046 traces, 93046 summary
Retagger: tagging trace set: gauss with 65933 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 65933 traces tagged "gauss"
FrameSaver: q=1.3801e+06 n=1153609 tag=gauss
wclsFrameSaver: saving 93046 traces tagged "wiener"
FrameSaver: q=1.50257e+06 n=1032003 tag=wiener
4253 hits in TPC 0
4974 hits in TPC 1
8385 hits in TPC 2
3228 hits in TPC 3
5142 hits in TPC 4
7161 hits in TPC 5
8524 hits in TPC 6
4484 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 4787 XUs and 3619 XVs -> 125 XUVs
C:0 T:2 46438 XUs and 64315 XVs -> 2296 XUVs
C:0 T:3 316 XUs and 352 XVs -> 12 XUVs
C:0 T:4 75 XUs and 98 XVs -> 2 XUVs
C:0 T:5 29343 XUs and 61269 XVs -> 1504 XUVs
C:0 T:6 59472 XUs and 100158 XVs -> 2141 XUVs
C:0 T:7 207 XUs and 393 XVs -> 6 XUVs
6086 XUVs total
2330 collection wire objects
6086 potential space points
Neighbour search...
308910 tests to find 168936 neighbours
Iterating with no regularization...
Begin: 1.52355e+07
0 1.3895e+07
1 1.38221e+07
2 1.38119e+07
Now with regularization...
Begin: 1.28988e+07
0 1.28945e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 18:00:15 CEST Closed output file "np04hd_raw_run029097_0198_dataflow1_datawriter_0_20240906T143430_reco_stage1_reco_stage2_20240926T160015_keepup.root"
26-Sep-2024 18:00:15 CEST Closed input file "np04hd_raw_run029097_0198_dataflow1_datawriter_0_20240906T143430_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 93.3586 178.91 256.569 168.069 33.6241 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000783675 0.00311053 0.00578207 0.00294775 0.00125244 30
produce:fembfilter:PDHDFEMBFilter 0.716722 1.03495 1.14499 1.04749 0.0948292 30
produce:wclsdatahd:WireCellToolkit 70.9496 76.8904 84.3502 76.3392 2.78541 30
produce:gaushit:GausHitFinder 0.801607 1.38868 5.90168 1.22575 0.875534 30
produce:nhitsfilter:NumberOfHitsFilter 0.000383862 0.000636295 0.00273147 0.000524656 0.000405037 30
produce:reco3d:SpacePointSolver 0.560028 1.93243 6.79118 1.43949 1.36726 29
produce:hitpdune:DisambigFromSpacePoints 0.426122 1.25931 2.81144 1.05228 0.585318 29
produce:pandora:StandardPandora 11.9604 24.4473 60.4308 21.246 11.0246 29
produce:pandoraWriter:StandardPandora 0.175225 0.264744 0.362169 0.250439 0.0531761 29
produce:pandoraTrack:LArPandoraTrackCreation 1.81789 3.23819 6.11412 2.73717 1.19391 29
produce:pandoraShower:LArPandoraShowerCreation 1.83494 4.0716 7.93189 3.31543 1.92871 29
produce:pandoracalo:Calorimetry 0.851986 1.55917 2.61882 1.43027 0.5321 29
produce:pandoracalonosce:Calorimetry 0.766797 1.46188 2.51297 1.33516 0.492068 29
produce:pandorapid:Chi2ParticleID 0.00230999 0.00349598 0.00522786 0.00348322 0.000663202 29
produce:pandoraShowercalo:ShowerCalorimetry 1.46996 3.65259 6.97412 3.06775 1.59108 29
produce:pandoraShowercalonosce:ShowerCalorimetry 1.49058 3.51593 6.92229 3.02046 1.49937 29
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.155559 0.258344 0.404662 0.250491 0.0618645 29
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0655492 0.0975264 0.15044 0.0910222 0.0227327 29
produce:emtrkmichelid:EmTrackMichelId 36.9065 54.3923 76.8386 51.3298 11.2942 29
[art]:TriggerResults:TriggerResultInserter 2.74e-05 6.9639e-05 0.000179003 6.55085e-05 2.46288e-05 30
end_path:out1:RootOutput 8.893e-06 1.45788e-05 5.5501e-05 1.19445e-05 9.44729e-06 30
end_path:michelremoving:michelremoving 5.9727e-05 0.119771 0.443601 0.0819315 0.0961073 30
end_path:michelremovinggnocchi:michelremoving 4.0835e-05 0.114085 0.431944 0.0774256 0.0929048 30
end_path:calibanagnocchi:CalibAnaTree 4.6232e-05 1.05353 1.8373 0.983618 0.440487 30
end_path:out1:RootOutput(write) 0.646023 1.33313 2.02883 1.33527 0.322347 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4992.9 MB
Peak resident set size usage (VmHWM): 2188.5 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029097_0198_dataflow1_datawriter_0_20240906T143430_reco_stage1_reco_stage2_20240926T160015_keepup.root
\tHists: np04hd_raw_run029097_0198_dataflow1_datawriter_0_20240906T143430_reco_stage1_reco_stage2_20240926T160015_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
