Jobsub ID 263290.3@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 263290.3@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3461 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 09:57:08 |
| Site | UK_Brunel |
| Entry | CMSHTPC_T2_UK_London_Brunel_dc2_22 |
| Last heartbeat | 2024-09-26 11:22:28 |
| From worker node | Hostname | wn-b1-15-01.brunel.ac.uk |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 09:59:50 |
| Input files | hd-protodune:np04hd_raw_run027298_0212_dataflow3_datawriter_0_20240619T150230.hdf5
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-26 11:22:28 |
| Saved logs | justin-logs:263290.3-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
4 traces tagged "gauss"
FrameSaver: q=1.81247e+06 n=879503 tag=gauss
wclsFrameSaver: saving 60160 traces tagged "wiener"
FrameSaver: q=1.93547e+06 n=799653 tag=wiener
2533 hits in TPC 0
2727 hits in TPC 1
5155 hits in TPC 2
2895 hits in TPC 3
3533 hits in TPC 4
7140 hits in TPC 5
6076 hits in TPC 6
4515 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1129 XUs and 676 XVs -> 21 XUVs
C:0 T:2 11621 XUs and 18515 XVs -> 443 XUVs
C:0 T:3 185 XUs and 321 XVs -> 7 XUVs
C:0 T:4 384 XUs and 416 XVs -> 51 XUVs
C:0 T:5 17787 XUs and 15779 XVs -> 709 XUVs
C:0 T:6 16609 XUs and 17050 XVs -> 1262 XUVs
C:0 T:7 1072 XUs and 472 XVs -> 23 XUVs
2516 XUVs total
1206 collection wire objects
2516 potential space points
Neighbour search...
66086 tests to find 39398 neighbours
Iterating with no regularization...
Begin: 2.52296e+07
0 2.37377e+07
1 2.35661e+07
2 2.35463e+07
Now with regularization...
Begin: 2.18636e+07
0 2.18564e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 34th record. run: 27298 subRun: 1 event: 29815 at 26-Sep-2024 12:18:17 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 59070 traces, 59070 summary
Retagger: tagging trace set: gauss with 43559 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 43559 traces tagged "gauss"
FrameSaver: q=1.46032e+06 n=730879 tag=gauss
wclsFrameSaver: saving 59070 traces tagged "wiener"
FrameSaver: q=1.60719e+06 n=656920 tag=wiener
2953 hits in TPC 0
4205 hits in TPC 1
2400 hits in TPC 2
1588 hits in TPC 3
3378 hits in TPC 4
7096 hits in TPC 5
5388 hits in TPC 6
4276 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 9404 XUs and 7457 XVs -> 365 XUVs
C:0 T:2 8308 XUs and 4850 XVs -> 490 XUVs
C:0 T:3 266 XUs and 593 XVs -> 14 XUVs
C:0 T:4 74 XUs and 74 XVs -> 3 XUVs
C:0 T:5 22920 XUs and 22358 XVs -> 432 XUVs
C:0 T:6 17382 XUs and 21533 XVs -> 707 XUVs
C:0 T:7 831 XUs and 941 XVs -> 35 XUVs
2046 XUVs total
952 collection wire objects
2046 potential space points
Neighbour search...
51436 tests to find 27764 neighbours
Iterating with no regularization...
Begin: 1.86406e+07
0 1.75441e+07
1 1.74386e+07
2 1.74256e+07
Now with regularization...
Begin: 1.65873e+07
0 1.65831e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Begin processing the 35th record. run: 27298 subRun: 1 event: 29819 at 26-Sep-2024 12:19:36 BST
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 56637 traces, 56637 summary
Retagger: tagging trace set: gauss with 41519 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 41519 traces tagged "gauss"
FrameSaver: q=1.44301e+06 n=679170 tag=gauss
wclsFrameSaver: saving 56637 traces tagged "wiener"
FrameSaver: q=1.58858e+06 n=602844 tag=wiener
1812 hits in TPC 0
3047 hits in TPC 1
2790 hits in TPC 2
2037 hits in TPC 3
4104 hits in TPC 4
5862 hits in TPC 5
5775 hits in TPC 6
4051 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 11017 XUs and 4292 XVs -> 101 XUVs
C:0 T:2 4475 XUs and 3731 XVs -> 196 XUVs
C:0 T:3 64 XUs and 68 XVs -> 2 XUVs
C:0 T:4 189 XUs and 239 XVs -> 6 XUVs
C:0 T:5 24501 XUs and 17352 XVs -> 359 XUVs
C:0 T:6 41944 XUs and 23852 XVs -> 1000 XUVs
C:0 T:7 699 XUs and 429 XVs -> 9 XUVs
1673 XUVs total
771 collection wire objects
1673 potential space points
Neighbour search...
55179 tests to find 24836 neighbours
Iterating with no regularization...
Begin: 1.86473e+07
0 1.66278e+07
1 1.65008e+07
2 1.64796e+07
3 1.64725e+07
Now with regularization...
Begin: 1.57717e+07
0 1.57671e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 12:20:50 BST Closed output file "np04hd_raw_run027298_0212_dataflow3_datawriter_0_20240619T150230_reco_stage1_reco_stage2_20240926T112050_keepup.root"
26-Sep-2024 12:20:50 BST Closed input file "np04hd_raw_run027298_0212_dataflow3_datawriter_0_20240619T150230_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 63.616 97.4386 156.04 95.7702 19.5015 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000344694 0.00227122 0.0267103 0.00144711 0.00425965 35
produce:fembfilter:PDHDFEMBFilter 1.38025 1.65333 2.31439 1.63761 0.176247 35
produce:wclsdatahd:WireCellToolkit 37.4567 41.9562 44.1346 42.8035 1.89754 35
produce:gaushit:GausHitFinder 0.417305 0.82385 1.20174 0.830449 0.211252 35
produce:nhitsfilter:NumberOfHitsFilter 0.000165029 0.000327688 0.000502896 0.000334756 9.79301e-05 35
produce:reco3d:SpacePointSolver 0.115429 0.876486 4.021 0.660768 0.687113 35
produce:hitpdune:DisambigFromSpacePoints 0.145265 0.701388 2.09082 0.627253 0.403679 35
produce:pandora:StandardPandora 4.8466 17.6853 45.9899 14.4705 9.18615 35
produce:pandoraWriter:StandardPandora 0.0643238 0.142123 0.285267 0.139028 0.0420471 35
produce:pandoraTrack:LArPandoraTrackCreation 0.506402 1.3914 2.86135 1.26014 0.526801 35
produce:pandoraShower:LArPandoraShowerCreation 0.388707 1.7299 4.81732 1.579 0.881159 35
produce:pandoracalo:Calorimetry 0.267286 0.695693 1.34385 0.652398 0.236497 35
produce:pandoracalonosce:Calorimetry 0.238342 0.643035 1.25068 0.604417 0.218624 35
produce:pandorapid:Chi2ParticleID 0.00119074 0.00181625 0.003081 0.00179182 0.000321311 35
produce:pandoraShowercalo:ShowerCalorimetry 0.335776 1.64402 4.665 1.45752 0.847871 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.382953 1.58748 4.38162 1.45968 0.81315 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0780188 0.127859 0.184095 0.133847 0.0283467 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0242104 0.0420578 0.0562928 0.0438101 0.00898242 35
produce:emtrkmichelid:EmTrackMichelId 12.7795 24.1455 36.3802 24.6742 5.19405 35
[art]:TriggerResults:TriggerResultInserter 1.4475e-05 2.28599e-05 6.6985e-05 2.0868e-05 9.32455e-06 35
end_path:out1:RootOutput 5.56e-06 7.9998e-06 2.2526e-05 7.738e-06 2.74278e-06 35
end_path:michelremoving:michelremoving 0.0176478 0.0922801 0.567425 0.0327126 0.11549 35
end_path:michelremovinggnocchi:michelremoving 0.0159992 0.0897106 0.565564 0.0295776 0.115139 35
end_path:calibanagnocchi:CalibAnaTree 0.223528 0.555048 1.04421 0.55237 0.183188 35
end_path:out1:RootOutput(write) 0.408217 0.775998 1.15421 0.783694 0.193747 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5033.94 MB
Peak resident set size usage (VmHWM): 2678.97 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027298_0212_dataflow3_datawriter_0_20240619T150230_reco_stage1_reco_stage2_20240926T112050_keepup.root
\tHists: np04hd_raw_run027298_0212_dataflow3_datawriter_0_20240619T150230_reco_stage1_reco_stage2_20240926T112050_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
