Jobsub ID 78840.120@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 78840.120@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3453 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 13:08:46 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce14-multicore |
| Last heartbeat | 2024-09-26 14:21:15 |
| From worker node | Hostname | tds214.pic.es |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2640 v3 @ 2.60GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 13:10:05 |
| Input files | hd-protodune:np04hd_raw_run029107_3426_dataflow7_datawriter_0_20240909T005656.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 14:21:15 |
| Saved logs | justin-logs:78840.120-justin-prod-sched02.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
+06
Now with regularization...
Begin: 4.46057e+06
0 4.45995e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 822479 TrkackID 3 startx, y, z 292.058 262.73 415.497 wireno, peakt tpcno 328 2940 5 dist 0min T, max_T5 3707
no of hits closeby 0 event 822479 TrkackID 3 startx, y, z 292.058 262.73 415.497 wireno, peakt tpcno 328 2940 5 dist 0min T, max_T5 3707
Begin processing the 29th record. run: 29107 subRun: 1 event: 822487 at 26-Sep-2024 16:18:15 CEST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 80453 traces, 80453 summary
Retagger: tagging trace set: gauss with 58055 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 58055 traces tagged "gauss"
FrameSaver: q=1.18401e+06 n=1061740 tag=gauss
wclsFrameSaver: saving 80453 traces tagged "wiener"
FrameSaver: q=1.26562e+06 n=949057 tag=wiener
4651 hits in TPC 0
4432 hits in TPC 1
6517 hits in TPC 2
4246 hits in TPC 3
3459 hits in TPC 4
6894 hits in TPC 5
6515 hits in TPC 6
3006 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 445 XUs and 360 XVs -> 10 XUVs
C:0 T:2 22092 XUs and 38358 XVs -> 1135 XUVs
C:0 T:3 190 XUs and 247 XVs -> 7 XUVs
C:0 T:4 43 XUs and 38 XVs -> 1 XUVs
C:0 T:5 27190 XUs and 34173 XVs -> 729 XUVs
C:0 T:6 14429 XUs and 34513 XVs -> 1187 XUVs
C:0 T:7 963 XUs and 1069 XVs -> 18 XUVs
3087 XUVs total
1406 collection wire objects
3087 potential space points
Neighbour search...
114931 tests to find 66600 neighbours
Iterating with no regularization...
Begin: 5.73966e+06
0 5.38768e+06
1 5.36182e+06
2 5.35795e+06
Now with regularization...
Begin: 4.86755e+06
0 4.86608e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 30th record. run: 29107 subRun: 1 event: 822495 at 26-Sep-2024 16:19:38 CEST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 69685 traces, 69685 summary
Retagger: tagging trace set: gauss with 51783 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 51783 traces tagged "gauss"
FrameSaver: q=1.09445e+06 n=951741 tag=gauss
wclsFrameSaver: saving 69685 traces tagged "wiener"
FrameSaver: q=1.16826e+06 n=858321 tag=wiener
4886 hits in TPC 0
3951 hits in TPC 1
5456 hits in TPC 2
2328 hits in TPC 3
4202 hits in TPC 4
6802 hits in TPC 5
5252 hits in TPC 6
2083 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 431 XUs and 634 XVs -> 4 XUVs
C:0 T:2 22541 XUs and 9101 XVs -> 296 XUVs
C:0 T:3 640 XUs and 268 XVs -> 6 XUVs
C:0 T:4 70 XUs and 91 XVs -> 6 XUVs
C:0 T:5 19186 XUs and 28504 XVs -> 1566 XUVs
C:0 T:6 12636 XUs and 8557 XVs -> 233 XUVs
C:0 T:7 95 XUs and 60 XVs -> 2 XUVs
2113 XUVs total
815 collection wire objects
2113 potential space points
Neighbour search...
60357 tests to find 36738 neighbours
Iterating with no regularization...
Begin: 5.0244e+06
0 4.71705e+06
1 4.68216e+06
2 4.67573e+06
3 4.67409e+06
Now with regularization...
Begin: 4.29424e+06
0 4.29324e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 822495 TrkackID 5 startx, y, z -215.066 388.444 170.24 wireno, peakt tpcno 202 1682.61 2 dist 0min T, max_T7.67422 2738
no of hits closeby 0 event 822495 TrkackID 11 startx, y, z 77.1789 580.62 55.4871 wireno, peakt tpcno 124 955.5 2 dist 168.052min T, max_T5 977.07
no of hits closeby 0 event 822495 TrkackID 5 startx, y, z -215.066 388.444 170.24 wireno, peakt tpcno 202 1682.61 2 dist 0min T, max_T7.67422 2738
no of hits closeby 0 event 822495 TrkackID 11 startx, y, z 77.1789 580.62 55.4871 wireno, peakt tpcno 124 955.5 2 dist 168.052min T, max_T5 977.07
26-Sep-2024 16:20:55 CEST Closed output file "np04hd_raw_run029107_3426_dataflow7_datawriter_0_20240909T005656_reco_stage1_reco_stage2_20240926T142055_keepup.root"
26-Sep-2024 16:20:55 CEST Closed input file "np04hd_raw_run029107_3426_dataflow7_datawriter_0_20240909T005656_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 58.9008 77.9581 164.249 75.3337 19.6949 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000276111 0.00122815 0.00286634 0.00108 0.000675392 30
produce:fembfilter:PDHDFEMBFilter 0.516609 0.538125 0.657958 0.527337 0.0270559 30
produce:wclsdatahd:WireCellToolkit 34.3465 37.5151 40.1535 38.2943 1.91323 30
produce:gaushit:GausHitFinder 0.365647 0.623075 1.00107 0.627956 0.148893 30
produce:nhitsfilter:NumberOfHitsFilter 0.000146057 0.000261945 0.000383972 0.000254161 7.20995e-05 30
produce:reco3d:SpacePointSolver 0.0716289 0.628427 1.76414 0.500907 0.459479 30
produce:hitpdune:DisambigFromSpacePoints 0.0946681 0.462176 1.59306 0.409556 0.334012 30
produce:pandora:StandardPandora 4.04844 12.147 75.6166 9.7934 12.523 30
produce:pandoraWriter:StandardPandora 0.0610921 0.109059 0.185793 0.108208 0.0287254 30
produce:pandoraTrack:LArPandoraTrackCreation 0.322068 0.934083 2.35844 0.873888 0.444193 30
produce:pandoraShower:LArPandoraShowerCreation 0.370204 1.20289 3.94192 1.07239 0.731325 30
produce:pandoracalo:Calorimetry 0.178527 0.483934 1.19969 0.459428 0.221446 30
produce:pandoracalonosce:Calorimetry 0.15175 0.440881 1.13538 0.416704 0.213525 30
produce:pandorapid:Chi2ParticleID 0.000974471 0.0014182 0.00246423 0.00134741 0.000318908 30
produce:pandoraShowercalo:ShowerCalorimetry 0.308978 1.00211 3.68013 0.919218 0.671322 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.303333 0.986856 3.58494 0.912792 0.654204 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0629932 0.106508 0.191578 0.104619 0.0270416 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0223809 0.037024 0.0614522 0.0382721 0.00873635 30
produce:emtrkmichelid:EmTrackMichelId 12.0638 19.5497 30.9727 19.1002 4.56428 30
[art]:TriggerResults:TriggerResultInserter 1.6437e-05 1.99415e-05 5.2355e-05 1.7837e-05 6.51496e-06 30
end_path:out1:RootOutput 6.028e-06 8.07867e-06 1.8684e-05 7.688e-06 2.06282e-06 30
end_path:michelremoving:michelremoving 0.0145101 0.0701075 0.28163 0.0284193 0.0744158 30
end_path:michelremovinggnocchi:michelremoving 0.0134214 0.0686086 0.283271 0.0263198 0.0754178 30
end_path:calibanagnocchi:CalibAnaTree 0.166905 0.3938 1.06275 0.361024 0.190474 30
end_path:out1:RootOutput(write) 0.384247 0.602854 0.996844 0.604447 0.145982 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4950.61 MB
Peak resident set size usage (VmHWM): 2598.3 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_3426_dataflow7_datawriter_0_20240909T005656_reco_stage1_reco_stage2_20240926T142055_keepup.root
\tHists: np04hd_raw_run029107_3426_dataflow7_datawriter_0_20240909T005656_reco_stage1_reco_stage2_20240926T142055_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
