Jobsub ID 262600.148@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 262600.148@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3449 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 00:29:24 |
| Site | UK_Durham |
| Entry | DUNE_UK_SGridDurham_ce3 |
| Last heartbeat | 2024-09-26 05:11:01 |
| From worker node | Hostname | n259.dur.scotgrid.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | aborted |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 02:46:25 |
| Input files | hd-protodune:np04hd_raw_run029107_0663_dataflow3_datawriter_0_20240907T020756.hdf5
|
| Outputting started | 2024-09-26 04:20:03 |
| Output files | |
| Finished | 2024-09-26 05:11:01 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
er: saving 68179 traces tagged "gauss"
FrameSaver: q=1.37769e+06 n=1267783 tag=gauss
wclsFrameSaver: saving 92687 traces tagged "wiener"
FrameSaver: q=1.48895e+06 n=1144698 tag=wiener
5571 hits in TPC 0
4428 hits in TPC 1
8279 hits in TPC 2
3515 hits in TPC 3
4421 hits in TPC 4
10640 hits in TPC 5
7971 hits in TPC 6
3595 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 173 XUs and 161 XVs -> 18 XUVs
C:0 T:2 58039 XUs and 51921 XVs -> 1912 XUVs
C:0 T:3 102 XUs and 106 XVs -> 0 XUVs
C:0 T:4 206 XUs and 308 XVs -> 6 XUVs
C:0 T:5 77497 XUs and 107016 XVs -> 4373 XUVs
C:0 T:6 71064 XUs and 94912 XVs -> 4864 XUVs
C:0 T:7 1108 XUs and 1171 XVs -> 24 XUVs
11197 XUVs total
2689 collection wire objects
11197 potential space points
Neighbour search...
1455187 tests to find 710358 neighbours
Iterating with no regularization...
Begin: 1.19974e+07
0 1.07746e+07
1 1.06995e+07
2 1.06874e+07
3 1.0683e+07
Now with regularization...
Begin: 1.01183e+07
0 1.01156e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 05:19:55 BST Closed output file "np04hd_raw_run029107_0663_dataflow3_datawriter_0_20240907T020756_reco_stage1_reco_stage2_20240926T041955_keepup.root"
26-Sep-2024 05:19:55 BST Closed input file "np04hd_raw_run029107_0663_dataflow3_datawriter_0_20240907T020756_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 50.0074 81.0174 123.205 80.1819 18.2901 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000612321 0.00218927 0.00592706 0.00228312 0.00116788 30
produce:fembfilter:PDHDFEMBFilter 0.517726 0.692713 0.85272 0.631875 0.1357 30
produce:wclsdatahd:WireCellToolkit 28.0806 34.8834 42.0075 34.671 5.48058 30
produce:gaushit:GausHitFinder 0.320195 0.721961 1.21604 0.766998 0.237309 30
produce:nhitsfilter:NumberOfHitsFilter 0.000225107 0.000354852 0.000521258 0.00037191 7.48842e-05 30
produce:reco3d:SpacePointSolver 0.135469 0.944982 3.10203 0.705875 0.773052 30
produce:hitpdune:DisambigFromSpacePoints 0.167745 0.553111 1.45297 0.584324 0.297272 30
produce:pandora:StandardPandora 3.76214 11.9643 27.6493 10.5003 5.86483 30
produce:pandoraWriter:StandardPandora 0.070025 0.142423 0.263483 0.150513 0.044345 30
produce:pandoraTrack:LArPandoraTrackCreation 0.332409 0.964457 2.22976 0.931717 0.438591 30
produce:pandoraShower:LArPandoraShowerCreation 0.400747 1.20289 3.14227 1.13744 0.635773 30
produce:pandoracalo:Calorimetry 0.200489 0.542746 1.18107 0.514613 0.221362 30
produce:pandoracalonosce:Calorimetry 0.169215 0.491986 1.15398 0.462971 0.222806 30
produce:pandorapid:Chi2ParticleID 0.000942376 0.00180547 0.00314937 0.00179805 0.000529968 30
produce:pandoraShowercalo:ShowerCalorimetry 0.350571 1.16373 3.33815 1.06456 0.674015 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.345192 1.12635 3.19798 1.04112 0.632399 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0672827 0.142393 0.268327 0.139995 0.0566804 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0226812 0.0486204 0.0879808 0.0490575 0.0186555 30
produce:emtrkmichelid:EmTrackMichelId 13.7876 23.9546 39.9728 23.8841 6.22604 30
[art]:TriggerResults:TriggerResultInserter 2.0299e-05 3.39083e-05 8.8979e-05 2.9271e-05 1.35644e-05 30
end_path:out1:RootOutput 6.191e-06 9.2746e-06 2.5999e-05 8.812e-06 3.36832e-06 30
end_path:michelremoving:michelremoving 0.013581 0.0904128 0.42756 0.0329449 0.103069 30
end_path:michelremovinggnocchi:michelremoving 0.012699 0.0840563 0.308006 0.0304265 0.0912393 30
end_path:calibanagnocchi:CalibAnaTree 0.137689 0.400924 0.891331 0.356339 0.170227 30
end_path:out1:RootOutput(write) 0.419407 0.784675 1.40645 0.776036 0.22163 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4913.8 MB
Peak resident set size usage (VmHWM): 2586.22 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_0663_dataflow3_datawriter_0_20240907T020756_reco_stage1_reco_stage2_20240926T041955_keepup.root
\tHists: np04hd_raw_run029107_0663_dataflow3_datawriter_0_20240907T020756_reco_stage1_reco_stage2_20240926T041955_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_0663_dataflow3_datawriter_0_20240907T020756_reco_stage1_reco_stage2_20240926T041955_keepup.root
Ran successfully
{
"name": "np04hd_raw_run029107_0663_dataflow3_datawriter_0_20240907T020756_reco_stage1_reco_stage2_20240926T041955_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727321918.0,
"core.end_time": 1727324396.0,
"core.events": [
159139,
159155,
159163,
159171,
159179,
159187,
159195,
159203,
159211,
159219,
159227,
159235,
159243,
159251,
159259,
159267,
159275,
159283,
159291,
159299,
159307,
159315,
159323,
159331,
159339,
159347,
159355,
159363,
159371,
159379
],
"core.event_count": 30,
"core.first_event_number": 159139,
"core.last_event_number": 159379,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29107
],
"core.runs_subruns": [
2910700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029107_0663_dataflow3_datawriter_0_20240907T020756.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run029107_0663_dataflow3_datawriter_0_20240907T020756_reco_stage1_reco_stage2_20240926T041955_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727321918.0,
"core.end_time": 1727324396.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29107
],
"core.runs_subruns": [
2910700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029107_0663_dataflow3_datawriter_0_20240907T020756.hdf5"
}
]
} 