Jobsub ID 78443.11@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 78443.11@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3451 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 09:48:38 |
| Site | FR_CCIN2P3 |
| Entry | DUNE_FR_CCIN2P3_cccondorce02 |
| Last heartbeat | 2024-09-26 11:16:25 |
| From worker node | Hostname | ccwcondor0779 |
| cpuinfo | AMD EPYC 7302 16-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 106200 (29 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 10:01:17 |
| Input files | hd-protodune:np04hd_raw_run029107_2139_dataflow7_datawriter_0_20240908T021803.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 11:16:25 |
| Saved logs | justin-logs:78443.11-justin-prod-sched02.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
s in TPC 3
4995 hits in TPC 4
6620 hits in TPC 5
5462 hits in TPC 6
2419 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 524 XUs and 278 XVs -> 3 XUVs
C:0 T:2 13428 XUs and 6403 XVs -> 151 XUVs
C:0 T:3 646 XUs and 389 XVs -> 7 XUVs
C:0 T:4 112 XUs and 145 XVs -> 2 XUVs
C:0 T:5 20578 XUs and 33407 XVs -> 1072 XUVs
C:0 T:6 28405 XUs and 14887 XVs -> 369 XUVs
C:0 T:7 105 XUs and 39 XVs -> 0 XUVs
1604 XUVs total
948 collection wire objects
1604 potential space points
Neighbour search...
26904 tests to find 17310 neighbours
Iterating with no regularization...
Begin: 5.26277e+06
0 5.03391e+06
1 5.01865e+06
2 5.01673e+06
Now with regularization...
Begin: 4.7396e+06
0 4.73903e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 513607 TrkackID 1 startx, y, z 210.449 603.483 379.338 wireno, peakt tpcno 174 7.21267 5 dist 0min T, max_T7.21267 4215.07
no of hits closeby 3 event 513607 TrkackID 2 startx, y, z 41.8749 429.507 11.8276 wireno, peakt tpcno 475 103.314 5 dist 0min T, max_T97.0131 2473.75
no of hits closeby 6 event 513607 TrkackID 7 startx, y, z -30.5145 382.775 364.615 wireno, peakt tpcno 377 32.9125 2 dist 0min T, max_T3.2227 397.038
no of hits closeby 0 event 513607 TrkackID 10 startx, y, z 128.019 419.556 36.2396 wireno, peakt tpcno 147 1585.21 2 dist 158.725min T, max_T8.66291 1625.5
no of hits closeby 4 event 513607 TrkackID 23 startx, y, z -54.5656 69.8649 85.7676 wireno, peakt tpcno 97 488.305 2 dist 2.46623min T, max_T13.9227 714.5
no of hits closeby 0 event 513607 TrkackID 1 startx, y, z 210.449 603.483 379.338 wireno, peakt tpcno 174 7.21267 5 dist 0min T, max_T7.21267 4215.07
no of hits closeby 3 event 513607 TrkackID 2 startx, y, z 41.8749 429.507 11.8276 wireno, peakt tpcno 475 103.314 5 dist 0min T, max_T97.0131 2473.75
no of hits closeby 6 event 513607 TrkackID 7 startx, y, z -30.5145 382.775 364.615 wireno, peakt tpcno 377 32.9125 2 dist 0min T, max_T3.2227 397.038
no of hits closeby 0 event 513607 TrkackID 10 startx, y, z 128.019 419.556 36.2396 wireno, peakt tpcno 147 1585.21 2 dist 158.725min T, max_T8.66291 1625.5
no of hits closeby 4 event 513607 TrkackID 23 startx, y, z -54.5656 69.8649 85.7676 wireno, peakt tpcno 97 488.305 2 dist 2.46623min T, max_T13.9227 714.5
Begin processing the 30th record. run: 29107 subRun: 1 event: 513615 at 26-Sep-2024 13:05:22 CEST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 58143 traces, 58143 summary
Retagger: tagging trace set: gauss with 43822 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 43822 traces tagged "gauss"
FrameSaver: q=989433 n=844492 tag=gauss
wclsFrameSaver: saving 58143 traces tagged "wiener"
FrameSaver: q=1.04837e+06 n=763514 tag=wiener
3780 hits in TPC 0
3348 hits in TPC 1
5490 hits in TPC 2
5110 hits in TPC 3
4381 hits in TPC 4
5777 hits in TPC 5
1907 hits in TPC 6
1672 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 809 XUs and 694 XVs -> 55 XUVs
C:0 T:2 19298 XUs and 18152 XVs -> 697 XUVs
C:0 T:3 295 XUs and 331 XVs -> 30 XUVs
C:0 T:4 202 XUs and 204 XVs -> 10 XUVs
C:0 T:5 23393 XUs and 17463 XVs -> 448 XUVs
C:0 T:6 2938 XUs and 2805 XVs -> 52 XUVs
C:0 T:7 10 XUs and 3 XVs -> 0 XUVs
1292 XUVs total
810 collection wire objects
1292 potential space points
Neighbour search...
33530 tests to find 14804 neighbours
Iterating with no regularization...
Begin: 5.28557e+06
0 5.02333e+06
1 5.01682e+06
2 5.01654e+06
Now with regularization...
Begin: 4.68405e+06
0 4.68343e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 9 event 513615 TrkackID 0 startx, y, z 236.498 534.295 1.0913 wireno, peakt tpcno 395 4704.05 5 dist 4.02302min T, max_T1830.13 4852.19
no of hits closeby 9 event 513615 TrkackID 0 startx, y, z 236.498 534.295 1.0913 wireno, peakt tpcno 395 4704.05 5 dist 4.02302min T, max_T1830.13 4852.19
26-Sep-2024 13:06:35 CEST Closed output file "np04hd_raw_run029107_2139_dataflow7_datawriter_0_20240908T021803_reco_stage1_reco_stage2_20240926T110635_keepup.root"
26-Sep-2024 13:06:35 CEST Closed input file "np04hd_raw_run029107_2139_dataflow7_datawriter_0_20240908T021803_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 43.3104 93.7595 165.227 94.8694 22.7818 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000344599 0.0029118 0.00516813 0.00299013 0.00145536 30
produce:fembfilter:PDHDFEMBFilter 0.533904 0.68189 0.852097 0.70125 0.08588 30
produce:wclsdatahd:WireCellToolkit 34.8818 43.6855 49.1708 45.9422 4.6699 30
produce:gaushit:GausHitFinder 0.0993154 0.623058 1.03236 0.663976 0.193354 30
produce:nhitsfilter:NumberOfHitsFilter 0.000116629 0.000426891 0.000863785 0.000419394 0.000155834 30
produce:reco3d:SpacePointSolver 0.0303859 0.953223 5.15392 0.571275 1.06665 30
produce:hitpdune:DisambigFromSpacePoints 0.0249198 0.461652 1.21925 0.43621 0.240951 30
produce:pandora:StandardPandora 1.09779 12.4867 75.6421 9.94079 12.6186 30
produce:pandoraWriter:StandardPandora 0.0287068 0.143382 0.216577 0.152552 0.0419657 30
produce:pandoraTrack:LArPandoraTrackCreation 0.0537835 1.06326 2.06208 1.03083 0.438473 30
produce:pandoraShower:LArPandoraShowerCreation 0.0564763 1.22253 2.42669 1.20306 0.560165 30
produce:pandoracalo:Calorimetry 0.0359964 0.563725 0.948747 0.538126 0.204555 30
produce:pandoracalonosce:Calorimetry 0.0286835 0.499651 0.864679 0.493545 0.190083 30
produce:pandorapid:Chi2ParticleID 0.000367692 0.0018294 0.00505984 0.00164659 0.000829078 30
produce:pandoraShowercalo:ShowerCalorimetry 0.0472847 1.09488 1.93974 1.11242 0.448692 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.0442748 1.04417 1.8853 1.07603 0.421913 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0194643 0.138442 0.219743 0.147936 0.0433886 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.00645809 0.0469948 0.0808415 0.045928 0.0157902 30
produce:emtrkmichelid:EmTrackMichelId 6.01188 27.5491 40.3171 28.9166 7.17704 30
[art]:TriggerResults:TriggerResultInserter 1.7032e-05 4.43865e-05 9.1342e-05 4.04855e-05 1.96384e-05 30
end_path:out1:RootOutput 8.276e-06 1.25677e-05 3.7831e-05 1.066e-05 5.87905e-06 30
end_path:michelremoving:michelremoving 0.0169674 0.103562 0.63269 0.0362817 0.137094 30
end_path:michelremovinggnocchi:michelremoving 0.0156893 0.0901211 0.523929 0.0289394 0.126208 30
end_path:calibanagnocchi:CalibAnaTree 0.0568706 0.397421 0.706166 0.395568 0.137979 30
end_path:out1:RootOutput(write) 0.147541 0.756868 1.12125 0.792298 0.198497 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4921.63 MB
Peak resident set size usage (VmHWM): 2344.1 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_2139_dataflow7_datawriter_0_20240908T021803_reco_stage1_reco_stage2_20240926T110635_keepup.root
\tHists: np04hd_raw_run029107_2139_dataflow7_datawriter_0_20240908T021803_reco_stage1_reco_stage2_20240926T110635_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
