Jobsub ID 263262.74@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 263262.74@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3449 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 09:48:34 |
| Site | FR_CCIN2P3 |
| Entry | DUNE_FR_CCIN2P3_cccondorce02 |
| Last heartbeat | 2024-09-26 11:07:42 |
| From worker node | Hostname | ccwcondor0779 |
| cpuinfo | AMD EPYC 7302 16-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 106200 (29 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 09:50:22 |
| Input files | hd-protodune:np04hd_raw_run029107_0685_dataflow6_datawriter_0_20240907T022507.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 11:07:42 |
| Saved logs | justin-logs:263262.74-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
e points
Neighbour search...
1864742 tests to find 796956 neighbours
Iterating with no regularization...
Begin: 7.07203e+06
0 5.53828e+06
1 5.4299e+06
2 5.4106e+06
3 5.40358e+06
4 5.40019e+06
Now with regularization...
Begin: 5.1537e+06
0 5.15037e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 164694 TrkackID 3 startx, y, z 38.611 215.634 446.895 wireno, peakt tpcno 335 3098.52 6 dist 420.295min T, max_T583.287 3112.73
no of hits closeby 5 event 164694 TrkackID 5 startx, y, z -70.0515 592.247 359.869 wireno, peakt tpcno 306 117.572 6 dist 5.3006min T, max_T11.9703 914
no of hits closeby 0 event 164694 TrkackID 3 startx, y, z 38.611 215.634 446.895 wireno, peakt tpcno 335 3098.52 6 dist 420.295min T, max_T583.287 3112.73
no of hits closeby 5 event 164694 TrkackID 5 startx, y, z -70.0515 592.247 359.869 wireno, peakt tpcno 306 117.572 6 dist 5.3006min T, max_T11.9703 914
Begin processing the 29th record. run: 29107 subRun: 1 event: 164702 at 26-Sep-2024 12:54:50 CEST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 69892 traces, 69892 summary
Retagger: tagging trace set: gauss with 51124 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 51124 traces tagged "gauss"
FrameSaver: q=1.07159e+06 n=941276 tag=gauss
wclsFrameSaver: saving 69892 traces tagged "wiener"
FrameSaver: q=1.14916e+06 n=849389 tag=wiener
2195 hits in TPC 0
1772 hits in TPC 1
9591 hits in TPC 2
4560 hits in TPC 3
1902 hits in TPC 4
4255 hits in TPC 5
8120 hits in TPC 6
4033 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 188 XUs and 67 XVs -> 11 XUVs
C:0 T:2 27097 XUs and 74895 XVs -> 1091 XUVs
C:0 T:3 367 XUs and 551 XVs -> 12 XUVs
C:0 T:4 761 XUs and 2295 XVs -> 112 XUVs
C:0 T:5 9697 XUs and 7017 XVs -> 248 XUVs
C:0 T:6 20893 XUs and 53705 XVs -> 746 XUVs
C:0 T:7 78 XUs and 103 XVs -> 1 XUVs
2221 XUVs total
1366 collection wire objects
2221 potential space points
Neighbour search...
48315 tests to find 27904 neighbours
Iterating with no regularization...
Begin: 7.3902e+06
0 7.04996e+06
1 7.03354e+06
2 7.0317e+06
Now with regularization...
Begin: 6.74742e+06
0 6.7467e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 30th record. run: 29107 subRun: 1 event: 164710 at 26-Sep-2024 12:56:22 CEST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 82235 traces, 82235 summary
Retagger: tagging trace set: gauss with 61121 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 61121 traces tagged "gauss"
FrameSaver: q=1.30682e+06 n=1106585 tag=gauss
wclsFrameSaver: saving 82235 traces tagged "wiener"
FrameSaver: q=1.40834e+06 n=987385 tag=wiener
4465 hits in TPC 0
2745 hits in TPC 1
7084 hits in TPC 2
2675 hits in TPC 3
7016 hits in TPC 4
10728 hits in TPC 5
4603 hits in TPC 6
2534 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 218 XUs and 206 XVs -> 14 XUVs
C:0 T:2 56295 XUs and 29786 XVs -> 743 XUVs
C:0 T:3 11 XUs and 6 XVs -> 2 XUVs
C:0 T:4 366 XUs and 381 XVs -> 15 XUVs
C:0 T:5 57879 XUs and 50637 XVs -> 1995 XUVs
C:0 T:6 63966 XUs and 17389 XVs -> 606 XUVs
C:0 T:7 160 XUs and 116 XVs -> 2 XUVs
3377 XUVs total
1692 collection wire objects
3377 potential space points
Neighbour search...
133307 tests to find 73774 neighbours
Iterating with no regularization...
Begin: 8.19081e+06
0 7.69763e+06
1 7.65513e+06
2 7.64959e+06
Now with regularization...
Begin: 7.30345e+06
0 7.30155e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 12:58:04 CEST Closed output file "np04hd_raw_run029107_0685_dataflow6_datawriter_0_20240907T022507_reco_stage1_reco_stage2_20240926T105804_keepup.root"
26-Sep-2024 12:58:04 CEST Closed input file "np04hd_raw_run029107_0685_dataflow6_datawriter_0_20240907T022507_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 71.4381 98.9704 138.94 99.9026 14.1268 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000588477 0.00339923 0.00651012 0.00357475 0.00147486 30
produce:fembfilter:PDHDFEMBFilter 0.616382 0.835058 3.0616 0.761587 0.419354 30
produce:wclsdatahd:WireCellToolkit 40 45.2586 48.4654 46.4117 2.79691 30
produce:gaushit:GausHitFinder 0.458795 0.673308 1.08009 0.691166 0.142727 30
produce:nhitsfilter:NumberOfHitsFilter 0.000293071 0.000500578 0.000936201 0.000444857 0.000153787 30
produce:reco3d:SpacePointSolver 0.206872 0.965731 3.27454 0.787159 0.735167 30
produce:hitpdune:DisambigFromSpacePoints 0.213667 0.522894 0.993462 0.54543 0.232949 30
produce:pandora:StandardPandora 5.43099 12.1909 23.572 11.4827 4.53566 30
produce:pandoraWriter:StandardPandora 0.0946912 0.167057 0.238245 0.16708 0.039471 30
produce:pandoraTrack:LArPandoraTrackCreation 0.391233 1.21349 2.30874 1.26714 0.438524 30
produce:pandoraShower:LArPandoraShowerCreation 0.346213 1.44141 4.34672 1.38647 0.732069 30
produce:pandoracalo:Calorimetry 0.236601 0.611038 1.24738 0.640068 0.22305 30
produce:pandoracalonosce:Calorimetry 0.225799 0.526389 0.976958 0.544262 0.176378 30
produce:pandorapid:Chi2ParticleID 0.00110623 0.00219703 0.0072277 0.00199425 0.00116897 30
produce:pandoraShowercalo:ShowerCalorimetry 0.442379 1.25328 3.42324 1.1899 0.588733 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.358949 1.22821 3.08963 1.23946 0.540018 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0823771 0.153345 0.239803 0.14444 0.0372224 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0329674 0.0510279 0.0816507 0.0463957 0.0122418 30
produce:emtrkmichelid:EmTrackMichelId 18.4664 30.2872 45.8738 30.654 6.03961 30
[art]:TriggerResults:TriggerResultInserter 1.7143e-05 0.000206399 0.00491275 4.4013e-05 0.000874142 30
end_path:out1:RootOutput 7.234e-06 1.04346e-05 3.2942e-05 9.157e-06 4.76138e-06 30
end_path:michelremoving:michelremoving 0.0159159 0.0902469 0.319389 0.042406 0.0795685 30
end_path:michelremovinggnocchi:michelremoving 0.0143035 0.0869968 0.309699 0.0389468 0.0804188 30
end_path:calibanagnocchi:CalibAnaTree 0.13042 0.413493 0.880627 0.425617 0.156776 30
end_path:out1:RootOutput(write) 0.546476 0.824602 1.23429 0.819055 0.161063 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4903.6 MB
Peak resident set size usage (VmHWM): 2327.03 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_0685_dataflow6_datawriter_0_20240907T022507_reco_stage1_reco_stage2_20240926T105804_keepup.root
\tHists: np04hd_raw_run029107_0685_dataflow6_datawriter_0_20240907T022507_reco_stage1_reco_stage2_20240926T105804_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
