Jobsub ID 79737.16@justin-prod-sched02.dune.hep.ac.uk
Jobsub ID | 79737.16@justin-prod-sched02.dune.hep.ac.uk | |
Workflow ID | 3517 | |
Stage ID | 1 | |
User name | calcuttj@fnal.gov | |
HTCondor Group | group_dune.prod_mcsim | |
Requested | Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) | |
Wall seconds limit | 18000 (5 hours) | |
Submitted time | 2024-09-27 02:58:26 | |
Site | US_Wisconsin | |
Entry | HCCHTPC_US_Wisconsin_osg01_rhel7 | |
Last heartbeat | 2024-09-27 10:54:36 | |
From worker node | Hostname | e2400 |
cpuinfo | Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz | |
OS release | Scientific Linux release 7.9 (Nitrogen) | |
Processors | 1 | |
RSS bytes | 4193255424 (3999 MiB) | |
Wall seconds limit | 82800 (23 hours) | |
Inner Apptainer? | True | |
Job state | finished | |
Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
Started | 2024-09-27 07:15:26 | |
Input files | hd-protodune:np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729.hdf5 | |
Jobscript | Exit code | 0 |
Real time | 3h (12950s) | |
CPU time | 2h (7860s = 60%) | |
Outputting started | 2024-09-27 10:51:18 | |
Output files | hd-protodune-det-reco:np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729_reco_stage1_reco_stage2_20240927T105051_keepup.root hd-protodune-det-reco:np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729_reco_stage1_reco_stage2_20240927T105051_keepup_hists.root | |
Finished | 2024-09-27 10:54:36 | |
Saved logs | justin-logs:79737.16-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
mary wclsFrameSaver saving cooked to 5859 ticks wclsFrameSaver: saving 53912 traces tagged "gauss" FrameSaver: q=2.01169e+06 n=944988 tag=gauss wclsFrameSaver: saving 71786 traces tagged "wiener" FrameSaver: q=2.29899e+06 n=858356 tag=wiener 3882 hits in TPC 0 6504 hits in TPC 1 8754 hits in TPC 2 3320 hits in TPC 3 2387 hits in TPC 4 3453 hits in TPC 5 10161 hits in TPC 6 5162 hits in TPC 7 0 X, 0 U, 0 V bad channels Finding XUV coincidences... C:0 T:1 19225 XUs and 15604 XVs -> 913 XUVs C:0 T:2 139178 XUs and 139566 XVs -> 14751 XUVs C:0 T:3 1117 XUs and 809 XVs -> 41 XUVs C:0 T:4 767 XUs and 866 XVs -> 34 XUVs C:0 T:5 19293 XUs and 10034 XVs -> 467 XUVs C:0 T:6 121481 XUs and 103667 XVs -> 9237 XUVs C:0 T:7 1265 XUs and 1077 XVs -> 34 XUVs 25477 XUVs total 3087 collection wire objects 25477 potential space points Neighbour search... 5427565 tests to find 1704498 neighbours Iterating with no regularization... Begin: 5.24308e+07 0 3.50378e+07 1 3.34339e+07 2 3.30824e+07 3 3.2942e+07 4 3.28716e+07 5 3.28317e+07 6 3.28049e+07 Now with regularization... Begin: 3.13824e+07 0 3.13455e+07 1 3.132e+07 ---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------ ---SUMMARY-------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------------ 27-Sep-2024 05:50:51 CDT Closed output file "np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729_reco_stage1_reco_stage2_20240927T105051_keepup.root" 27-Sep-2024 05:50:51 CDT Closed input file "np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729_reco_stage1.root" ======================================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ======================================================================================================================================== Full event 139.387 206.912 325.128 196.204 46.854 35 ---------------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.000803785 0.00687016 0.0811111 0.00306562 0.0153365 35 produce:fembfilter:PDHDFEMBFilter 1.45233 6.86056 45.5372 1.6353 10.6172 35 produce:wclsdatahd:WireCellToolkit 65.0221 75.1337 126.179 71.674 12.7466 35 produce:gaushit:GausHitFinder 0.609132 1.03101 1.5234 1.00364 0.236511 35 produce:nhitsfilter:NumberOfHitsFilter 0.000371141 0.0106125 0.35255 0.000552093 0.0586419 35 produce:reco3d:SpacePointSolver 0.299388 1.88482 10.1884 1.34366 1.8922 35 produce:hitpdune:DisambigFromSpacePoints 0.274037 0.935743 2.08945 0.826673 0.435961 35 produce:pandora:StandardPandora 11.778 26.8186 134.348 22.2949 20.1501 35 produce:pandoraWriter:StandardPandora 0.152209 0.3745 4.20233 0.234395 0.677853 35 produce:pandoraTrack:LArPandoraTrackCreation 1.17357 3.96873 7.4551 3.97398 1.49437 35 produce:pandoraShower:LArPandoraShowerCreation 1.01069 5.02127 12.3716 4.79418 2.70144 35 produce:pandoracalo:Calorimetry 0.529634 1.71003 3.34295 1.6821 0.642272 35 produce:pandoracalonosce:Calorimetry 0.521326 1.66204 3.31294 1.61185 0.637284 35 produce:pandorapid:Chi2ParticleID 0.00194155 0.00296147 0.00533695 0.00288994 0.000629656 35 produce:pandoraShowercalo:ShowerCalorimetry 1.00379 4.0043 9.00888 3.74121 2.0363 35 produce:pandoraShowercalonosce:ShowerCalorimetry 1.01159 3.74647 8.14409 3.60041 1.84836 35 produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.100471 0.166294 0.248366 0.171976 0.0365105 35 produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0322449 0.0582028 0.0854855 0.0605136 0.012864 35 produce:emtrkmichelid:EmTrackMichelId 44.2055 69.1071 93.9218 69.6445 13.2282 35 [art]:TriggerResults:TriggerResultInserter 4.4574e-05 8.63996e-05 0.00018236 8.2541e-05 2.14778e-05 35 end_path:out1:RootOutput 1.2012e-05 2.33027e-05 5.9018e-05 2.2472e-05 1.04388e-05 35 end_path:michelremoving:michelremoving 0.0318095 0.254837 4.65165 0.0881124 0.758868 35 end_path:michelremovinggnocchi:michelremoving 0.0289543 0.116834 0.314255 0.0791344 0.0851906 35 end_path:calibanagnocchi:CalibAnaTree 0.344602 1.21588 2.52208 1.16536 0.478254 35 end_path:out1:RootOutput(write) 0.543896 0.975249 2.41322 0.923346 0.308994 35 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 5005.36 MB Peak resident set size usage (VmHWM): 2360.16 MB Details saved in: 'mem.db' ==================================================================================================== Art has completed and will exit with status 0. Output files: \tReco: np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729_reco_stage1_reco_stage2_20240927T105051_keepup.root \tHists: np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729_reco_stage1_reco_stage2_20240927T105051_keepup_hists.root Forming reco metadata Successfully opened file np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729_reco_stage1_reco_stage2_20240927T105051_keepup.root Ran successfully { "name": "np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729_reco_stage1_reco_stage2_20240927T105051_keepup.root", "namespace": "hd-protodune-det-reco", "metadata": { "core.file_format": "artroot", "core.application.name": "reco", "core.application.family": "dunesw", "core.application.version": "v09_91_02d01", "core.data_tier": "full-reconstructed", "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl", "dune.campaign": "hd-protodune-reco-keepup-v0", "core.start_time": 1727426949.0, "core.end_time": 1727434254.0, "core.events": [ 22542, 22546, 22550, 22554, 22558, 22562, 22566, 22570, 22574, 22578, 22582, 22586, 22590, 22594, 22598, 22602, 22606, 22610, 22614, 22618, 22622, 22626, 22630, 22634, 22638, 22642, 22646, 22650, 22654, 22658, 22662, 22666, 22670, 22674, 22678 ], "core.event_count": 35, "core.first_event_number": 22542, "core.last_event_number": 22678, "core.data_stream": "physics", "core.file_content_status": "good", "core.file_type": "detector", "core.run_type": "hd-protodune", "core.runs": [ 27398 ], "core.runs_subruns": [ 2739800001 ], "dune.daq_test": false, "retention.status": "active", "retention.class": "physics", "origin.applications.config_files": { "reco1": "standard_reco_stage1_protodunehd_keepup.fcl" }, "origin.applications.versions": { "reco1": "v09_91_02d01" }, "origin.applications.names": [ "reco1" ] }, "parents": [ { "did": "hd-protodune:np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729.hdf5" } ] }Forming hist metadata formed { "name": "np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729_reco_stage1_reco_stage2_20240927T105051_keepup_hists.root", "namespace": "hd-protodune-det-reco", "metadata": { "core.file_format": "root", "core.application.name": "reco", "core.application.family": "dunesw", "core.application.version": "v09_91_02d01", "core.data_tier": "root-tuple-virtual", "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl", "dune.campaign": "hd-protodune-reco-keepup-v0", "core.start_time": 1727426949.0, "core.end_time": 1727434254.0, "core.data_stream": "physics", "core.file_content_status": "good", "core.file_type": "detector", "core.run_type": "hd-protodune", "core.runs": [ 27398 ], "core.runs_subruns": [ 2739800001 ], "dune.daq_test": false, "retention.status": "active", "retention.class": "physics", "origin.applications.config_files": { "reco1": "standard_reco_stage1_protodunehd_keepup.fcl" }, "origin.applications.versions": { "reco1": "v09_91_02d01" }, "origin.applications.names": [ "reco1" ] }, "parents": [ { "did": "hd-protodune:np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729.hdf5" } ] }