Jobsub ID 79944.176@justin-prod-sched02.dune.hep.ac.uk
Jobsub ID | 79944.176@justin-prod-sched02.dune.hep.ac.uk | |
Workflow ID | 3517 | |
Stage ID | 1 | |
User name | calcuttj@fnal.gov | |
HTCondor Group | group_dune.prod_mcsim | |
Requested | Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) | |
Wall seconds limit | 18000 (5 hours) | |
Submitted time | 2024-09-27 07:59:52 | |
Site | CA_SFU | |
Entry | DUNE_CA_SFU_lcg-ce3 | |
Last heartbeat | 2024-09-27 15:51:48 | |
From worker node | Hostname | cdr143.int.cedar.computecanada.ca |
cpuinfo | Intel(R) Xeon(R) CPU E5-2683 v4 @ 2.10GHz | |
OS release | Scientific Linux release 7.9 (Nitrogen) | |
Processors | 1 | |
RSS bytes | 4193255424 (3999 MiB) | |
Wall seconds limit | 84598 (23 hours) | |
Inner Apptainer? | True | |
Job state | finished | |
Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
Started | 2024-09-27 12:58:00 | |
Input files | hd-protodune:np04hd_raw_run027394_0488_dataflow1_datawriter_0_20240623T203649.hdf5 | |
Jobscript | Exit code | 0 |
Real time | 2h (7972s) | |
CPU time | 1h (6293s = 78%) | |
Outputting started | 2024-09-27 15:10:54 | |
Output files | hd-protodune-det-reco:np04hd_raw_run027394_0488_dataflow1_datawriter_0_20240623T203649_reco_stage1_reco_stage2_20240927T151043_keepup.root hd-protodune-det-reco:np04hd_raw_run027394_0488_dataflow1_datawriter_0_20240623T203649_reco_stage1_reco_stage2_20240927T151043_keepup_hists.root | |
Finished | 2024-09-27 15:51:48 | |
Saved logs | justin-logs:79944.176-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
ng trace set: wiener with 45947 traces, 45947 summary Retagger: tagging trace set: gauss with 35713 traces, 0 summary wclsFrameSaver saving cooked to 5859 ticks wclsFrameSaver: saving 35713 traces tagged "gauss" FrameSaver: q=1.19014e+06 n=669600 tag=gauss wclsFrameSaver: saving 45947 traces tagged "wiener" FrameSaver: q=1.27376e+06 n=607202 tag=wiener 4010 hits in TPC 0 4559 hits in TPC 1 2944 hits in TPC 2 2325 hits in TPC 3 3993 hits in TPC 4 5461 hits in TPC 5 2676 hits in TPC 6 1259 hits in TPC 7 0 X, 0 U, 0 V bad channels Finding XUV coincidences... C:0 T:1 3659 XUs and 3650 XVs -> 531 XUVs C:0 T:2 8388 XUs and 5349 XVs -> 263 XUVs C:0 T:3 6 XUs and 22 XVs -> 0 XUVs C:0 T:4 672 XUs and 699 XVs -> 33 XUVs C:0 T:5 10059 XUs and 10448 XVs -> 485 XUVs C:0 T:6 5249 XUs and 3108 XVs -> 49 XUVs C:0 T:7 72 XUs and 38 XVs -> 4 XUVs 1365 XUVs total 748 collection wire objects 1365 potential space points Neighbour search... 23503 tests to find 14054 neighbours Iterating with no regularization... Begin: 9.40202e+06 0 9.21576e+06 1 9.21152e+06 Now with regularization... Begin: 8.73128e+06 0 8.73099e+06 ---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------ ---SUMMARY-------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------------ 27-Sep-2024 08:10:43 PDT Closed output file "np04hd_raw_run027394_0488_dataflow1_datawriter_0_20240623T203649_reco_stage1_reco_stage2_20240927T151043_keepup.root" 27-Sep-2024 08:10:43 PDT Closed input file "np04hd_raw_run027394_0488_dataflow1_datawriter_0_20240623T203649_reco_stage1.root" ======================================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ======================================================================================================================================== Full event 104.108 144.506 204.667 142.915 23.6614 35 ---------------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.000676133 0.00317391 0.00527336 0.00349474 0.0013865 35 produce:fembfilter:PDHDFEMBFilter 0.913846 0.928398 0.960864 0.926979 0.00819773 35 produce:wclsdatahd:WireCellToolkit 53.6932 55.5922 57.2327 55.7206 0.916383 35 produce:gaushit:GausHitFinder 0.834286 1.143 1.47033 1.12075 0.158458 35 produce:nhitsfilter:NumberOfHitsFilter 0.000362444 0.000543217 0.000670434 0.000534701 7.2013e-05 35 produce:reco3d:SpacePointSolver 0.265916 1.69812 8.86667 1.04605 1.74067 35 produce:hitpdune:DisambigFromSpacePoints 0.400087 0.963457 2.51772 0.866031 0.422125 35 produce:pandora:StandardPandora 15.7333 29.3014 70.5582 26.0537 13.2868 35 produce:pandoraWriter:StandardPandora 0.153533 0.229342 0.296744 0.225824 0.0341045 35 produce:pandoraTrack:LArPandoraTrackCreation 1.32191 3.36882 5.82376 3.22112 1.04951 35 produce:pandoraShower:LArPandoraShowerCreation 1.218 4.10497 7.91819 3.91311 1.71228 35 produce:pandoracalo:Calorimetry 0.635415 1.4185 2.62678 1.27912 0.420674 35 produce:pandoracalonosce:Calorimetry 0.603617 1.33336 2.51462 1.21144 0.406679 35 produce:pandorapid:Chi2ParticleID 0.00215751 0.00289435 0.00447272 0.00280759 0.000452113 35 produce:pandoraShowercalo:ShowerCalorimetry 1.06884 3.14986 6.10756 2.92379 1.22713 35 produce:pandoraShowercalonosce:ShowerCalorimetry 0.981133 2.96968 5.65388 2.72616 1.13209 35 produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0947282 0.179053 0.232044 0.178586 0.0348197 35 produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0364065 0.0655665 0.0852675 0.0651216 0.0116144 35 produce:emtrkmichelid:EmTrackMichelId 24.7907 35.5514 44.9728 34.8758 5.27908 35 [art]:TriggerResults:TriggerResultInserter 2.7481e-05 5.29141e-05 8.0686e-05 5.3024e-05 9.79012e-06 35 end_path:out1:RootOutput 1.1031e-05 1.49329e-05 2.8463e-05 1.3918e-05 3.6921e-06 35 end_path:michelremoving:michelremoving 0.0275055 0.105027 0.451523 0.0584216 0.0903366 35 end_path:michelremovinggnocchi:michelremoving 0.0235256 0.100705 0.448626 0.0576087 0.0905879 35 end_path:calibanagnocchi:CalibAnaTree 0.42561 1.03791 1.79156 0.839711 0.347618 35 end_path:out1:RootOutput(write) 0.720577 1.09628 1.46463 1.05714 0.177403 35 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 4944.38 MB Peak resident set size usage (VmHWM): 2621.73 MB Details saved in: 'mem.db' ==================================================================================================== Art has completed and will exit with status 0. Output files: \tReco: np04hd_raw_run027394_0488_dataflow1_datawriter_0_20240623T203649_reco_stage1_reco_stage2_20240927T151043_keepup.root \tHists: np04hd_raw_run027394_0488_dataflow1_datawriter_0_20240623T203649_reco_stage1_reco_stage2_20240927T151043_keepup_hists.root Forming reco metadata Successfully opened file np04hd_raw_run027394_0488_dataflow1_datawriter_0_20240623T203649_reco_stage1_reco_stage2_20240927T151043_keepup.root Ran successfully { "name": "np04hd_raw_run027394_0488_dataflow1_datawriter_0_20240623T203649_reco_stage1_reco_stage2_20240927T151043_keepup.root", "namespace": "hd-protodune-det-reco", "metadata": { "core.file_format": "artroot", "core.application.name": "reco", "core.application.family": "dunesw", "core.application.version": "v09_91_02d01", "core.data_tier": "full-reconstructed", "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl", "dune.campaign": "hd-protodune-reco-keepup-v0", "core.start_time": 1727444729.0, "core.end_time": 1727449844.0, "core.events": [ 68321, 68325, 68329, 68333, 68337, 68341, 68345, 68349, 68353, 68357, 68361, 68365, 68369, 68373, 68377, 68381, 68385, 68389, 68393, 68397, 68401, 68405, 68409, 68413, 68417, 68421, 68425, 68429, 68433, 68437, 68441, 68445, 68449, 68453, 68457 ], "core.event_count": 35, "core.first_event_number": 68321, "core.last_event_number": 68457, "core.data_stream": "physics", "core.file_content_status": "good", "core.file_type": "detector", "core.run_type": "hd-protodune", "core.runs": [ 27394 ], "core.runs_subruns": [ 2739400001 ], "dune.daq_test": false, "retention.status": "active", "retention.class": "physics", "origin.applications.config_files": { "reco1": "standard_reco_stage1_protodunehd_keepup.fcl" }, "origin.applications.versions": { "reco1": "v09_91_02d01" }, "origin.applications.names": [ "reco1" ] }, "parents": [ { "did": "hd-protodune:np04hd_raw_run027394_0488_dataflow1_datawriter_0_20240623T203649.hdf5" } ] }Forming hist metadata formed { "name": "np04hd_raw_run027394_0488_dataflow1_datawriter_0_20240623T203649_reco_stage1_reco_stage2_20240927T151043_keepup_hists.root", "namespace": "hd-protodune-det-reco", "metadata": { "core.file_format": "root", "core.application.name": "reco", "core.application.family": "dunesw", "core.application.version": "v09_91_02d01", "core.data_tier": "root-tuple-virtual", "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl", "dune.campaign": "hd-protodune-reco-keepup-v0", "core.start_time": 1727444729.0, "core.end_time": 1727449844.0, "core.data_stream": "physics", "core.file_content_status": "good", "core.file_type": "detector", "core.run_type": "hd-protodune", "core.runs": [ 27394 ], "core.runs_subruns": [ 2739400001 ], "dune.daq_test": false, "retention.status": "active", "retention.class": "physics", "origin.applications.config_files": { "reco1": "standard_reco_stage1_protodunehd_keepup.fcl" }, "origin.applications.versions": { "reco1": "v09_91_02d01" }, "origin.applications.names": [ "reco1" ] }, "parents": [ { "did": "hd-protodune:np04hd_raw_run027394_0488_dataflow1_datawriter_0_20240623T203649.hdf5" } ] }