Jobsub ID 276101.128@justin-prod-sched01.dune.hep.ac.uk
Jobsub ID | 276101.128@justin-prod-sched01.dune.hep.ac.uk | |
Workflow ID | 3693 | |
Stage ID | 1 | |
User name | calcuttj@fnal.gov | |
HTCondor Group | group_dune.prod_mcsim | |
Requested | Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) | |
Wall seconds limit | 18000 (5 hours) | |
Submitted time | 2024-10-17 01:12:24 | |
Site | US_FNAL-FermiGrid | |
Entry | FNAL_GPGrid_ce04_mcore_op_duneonly | |
Last heartbeat | 2024-10-17 14:16:37 | |
From worker node | Hostname | dunegli-4188968-0-fnpc17141.fnal.gov |
cpuinfo | Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz | |
OS release | Scientific Linux release 7.9 (Nitrogen) | |
Processors | 1 | |
RSS bytes | 4193255424 (3999 MiB) | |
Wall seconds limit | 172800 (48 hours) | |
Inner Apptainer? | True | |
Job state | finished | |
Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
Started | 2024-10-17 06:08:08 | |
Input files | hd-protodune:np04hd_raw_run027331_0047_dataflow3_datawriter_0_20240620T160501.hdf5 | |
Jobscript | Exit code | 0 |
Real time | 7h (28798s) | |
CPU time | 7h (26485s = 91%) | |
Outputting started | 2024-10-17 14:08:07 | |
Output files | hd-protodune-det-reco:np04hd_raw_run027331_0047_dataflow3_datawriter_0_20240620T160501_reco_stage1_reco_stage2_20241017T140758_keepup.root hd-protodune-det-reco:np04hd_raw_run027331_0047_dataflow3_datawriter_0_20240620T160501_reco_stage1_reco_stage2_20241017T140758_keepup_hists.root | |
Finished | 2024-10-17 14:16:37 | |
Saved logs | justin-logs:276101.128-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
races, 0 summary wclsFrameSaver saving cooked to 5859 ticks wclsFrameSaver: saving 43581 traces tagged "gauss" FrameSaver: q=1.69961e+06 n=780045 tag=gauss wclsFrameSaver: saving 58381 traces tagged "wiener" FrameSaver: q=1.81654e+06 n=701329 tag=wiener 1612 hits in TPC 0 2501 hits in TPC 1 5012 hits in TPC 2 4029 hits in TPC 3 2758 hits in TPC 4 4711 hits in TPC 5 6505 hits in TPC 6 4267 hits in TPC 7 0 X, 0 U, 0 V bad channels Finding XUV coincidences... C:0 T:0 10 XUs and 10 XVs -> 0 XUVs C:0 T:1 1185 XUs and 1069 XVs -> 23 XUVs C:0 T:2 14300 XUs and 14007 XVs -> 861 XUVs C:0 T:3 398 XUs and 403 XVs -> 14 XUVs C:0 T:4 22 XUs and 53 XVs -> 2 XUVs C:0 T:5 16780 XUs and 21654 XVs -> 1526 XUVs C:0 T:6 21203 XUs and 15244 XVs -> 593 XUVs C:0 T:7 480 XUs and 589 XVs -> 10 XUVs 3029 XUVs total 1430 collection wire objects 3029 potential space points Neighbour search... 83637 tests to find 50290 neighbours Iterating with no regularization... Begin: 2.69822e+07 0 2.50544e+07 1 2.49218e+07 2 2.49036e+07 Now with regularization... Begin: 2.29209e+07 0 2.29144e+07 BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list ---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------ ---SUMMARY-------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------------ 17-Oct-2024 14:07:58 UTC Closed output file "np04hd_raw_run027331_0047_dataflow3_datawriter_0_20240620T160501_reco_stage1_reco_stage2_20241017T140758_keepup.root" 17-Oct-2024 14:07:58 UTC Closed input file "np04hd_raw_run027331_0047_dataflow3_datawriter_0_20240620T160501_reco_stage1.root" ======================================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ======================================================================================================================================== Full event 89.6349 726.335 18928.9 169.502 3122.59 35 ---------------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.00079023 0.00427084 0.0328812 0.00253597 0.00565522 35 produce:fembfilter:PDHDFEMBFilter 1.12558 1.55769 2.07695 1.65336 0.236562 35 produce:wclsdatahd:WireCellToolkit 44.7163 55.7784 73.1253 50.9604 9.2508 35 produce:gaushit:GausHitFinder 0.499133 1.25223 2.25882 1.22095 0.428157 35 produce:nhitsfilter:NumberOfHitsFilter 0.000332979 0.00327829 0.0931836 0.000628426 0.0154194 35 produce:reco3d:SpacePointSolver 0.297968 2.36565 7.4594 1.47495 1.96187 35 produce:hitpdune:DisambigFromSpacePoints 0.225498 1.42918 3.85046 1.07533 0.943631 35 produce:pandora:StandardPandora 8.03237 590.202 18800.6 45.7768 3123.37 35 produce:pandoraWriter:StandardPandora 0.127824 0.307643 1.43864 0.254469 0.214083 35 produce:pandoraTrack:LArPandoraTrackCreation 1.24824 6.51767 14.9318 5.91975 3.87587 35 produce:pandoraShower:LArPandoraShowerCreation 0.949336 6.88708 19.1086 5.94437 4.4681 35 produce:pandoracalo:Calorimetry 0.473395 2.48097 6.09767 2.22122 1.4631 35 produce:pandoracalonosce:Calorimetry 0.432355 2.3671 6.16863 2.01728 1.44563 35 produce:pandorapid:Chi2ParticleID 0.00146114 0.00328995 0.00545018 0.0030849 0.00108096 35 produce:pandoraShowercalo:ShowerCalorimetry 0.680054 4.99074 15.6208 3.78661 3.4732 35 produce:pandoraShowercalonosce:ShowerCalorimetry 0.665401 4.96876 20.2921 3.64962 3.91901 35 produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0934334 0.178785 0.379825 0.156827 0.0691668 35 produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0358182 0.0707239 0.153013 0.0614025 0.0280797 35 produce:emtrkmichelid:EmTrackMichelId 21.2057 40.9824 80.9455 39.384 12.5162 35 [art]:TriggerResults:TriggerResultInserter 3.2703e-05 5.93517e-05 9.3409e-05 5.7553e-05 1.35888e-05 35 end_path:out1:RootOutput 1.0099e-05 1.62732e-05 2.8605e-05 1.572e-05 4.20047e-06 35 end_path:michelremoving:michelremoving 0.0258962 0.107895 0.557918 0.0751599 0.0991403 35 end_path:michelremovinggnocchi:michelremoving 0.0234735 0.100154 0.522315 0.0728218 0.09434 35 end_path:calibanagnocchi:CalibAnaTree 0.466054 2.19304 8.86871 1.90415 1.67836 35 end_path:out1:RootOutput(write) 0.660261 1.36328 2.54209 1.30792 0.454585 35 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 5096.25 MB Peak resident set size usage (VmHWM): 2751.5 MB Details saved in: 'mem.db' ==================================================================================================== Art has completed and will exit with status 0. Output files: \tReco: np04hd_raw_run027331_0047_dataflow3_datawriter_0_20240620T160501_reco_stage1_reco_stage2_20241017T140758_keepup.root \tHists: np04hd_raw_run027331_0047_dataflow3_datawriter_0_20240620T160501_reco_stage1_reco_stage2_20241017T140758_keepup_hists.root Forming reco metadata Successfully opened file np04hd_raw_run027331_0047_dataflow3_datawriter_0_20240620T160501_reco_stage1_reco_stage2_20241017T140758_keepup.root Ran successfully { "name": "np04hd_raw_run027331_0047_dataflow3_datawriter_0_20240620T160501_reco_stage1_reco_stage2_20241017T140758_keepup.root", "namespace": "hd-protodune-det-reco", "metadata": { "core.file_format": "artroot", "core.application.name": "reco", "core.application.family": "dunesw", "core.application.version": "v09_91_02d01", "core.data_tier": "full-reconstructed", "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl", "dune.campaign": "hd-protodune-reco-keepup-v0", "core.start_time": 1729148587.0, "core.end_time": 1729174080.0, "core.events": [ 6583, 6587, 6591, 6595, 6599, 6603, 6607, 6611, 6615, 6619, 6623, 6627, 6631, 6635, 6639, 6643, 6647, 6651, 6655, 6659, 6663, 6667, 6671, 6675, 6679, 6683, 6687, 6691, 6695, 6699, 6703, 6707, 6711, 6715, 6719 ], "core.event_count": 35, "core.first_event_number": 6583, "core.last_event_number": 6719, "core.data_stream": "physics", "core.file_content_status": "good", "core.file_type": "detector", "core.run_type": "hd-protodune", "core.runs": [ 27331 ], "core.runs_subruns": [ 2733100001 ], "dune.daq_test": false, "retention.status": "active", "retention.class": "physics", "origin.applications.config_files": { "reco1": "standard_reco_stage1_protodunehd_keepup.fcl" }, "origin.applications.versions": { "reco1": "v09_91_02d01" }, "origin.applications.names": [ "reco1" ] }, "parents": [ { "did": "hd-protodune:np04hd_raw_run027331_0047_dataflow3_datawriter_0_20240620T160501.hdf5" } ] }Forming hist metadata formed { "name": "np04hd_raw_run027331_0047_dataflow3_datawriter_0_20240620T160501_reco_stage1_reco_stage2_20241017T140758_keepup_hists.root", "namespace": "hd-protodune-det-reco", "metadata": { "core.file_format": "root", "core.application.name": "reco", "core.application.family": "dunesw", "core.application.version": "v09_91_02d01", "core.data_tier": "root-tuple-virtual", "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl", "dune.campaign": "hd-protodune-reco-keepup-v0", "core.start_time": 1729148587.0, "core.end_time": 1729174080.0, "core.data_stream": "physics", "core.file_content_status": "good", "core.file_type": "detector", "core.run_type": "hd-protodune", "core.runs": [ 27331 ], "core.runs_subruns": [ 2733100001 ], "dune.daq_test": false, "retention.status": "active", "retention.class": "physics", "origin.applications.config_files": { "reco1": "standard_reco_stage1_protodunehd_keepup.fcl" }, "origin.applications.versions": { "reco1": "v09_91_02d01" }, "origin.applications.names": [ "reco1" ] }, "parents": [ { "did": "hd-protodune:np04hd_raw_run027331_0047_dataflow3_datawriter_0_20240620T160501.hdf5" } ] }