Jobsub ID 254038.6@justin-prod-sched01.dune.hep.ac.uk
Jobsub ID | 254038.6@justin-prod-sched01.dune.hep.ac.uk | |
Workflow ID | 3162 | |
Stage ID | 1 | |
User name | calcuttj@fnal.gov | |
HTCondor Group | group_dune.prod_mcsim | |
Requested | Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) | |
Wall seconds limit | 18000 (5 hours) | |
Submitted time | 2024-09-11 03:41:06 | |
Site | UK_Manchester | |
Entry | UBoone_T2_UK_Manchester_ce02 | |
Last heartbeat | 2024-09-11 05:04:20 | |
From worker node | Hostname | wn1207240.tier2.hep.manchester.ac.uk |
cpuinfo | AMD EPYC 7702P 64-Core Processor | |
OS release | Scientific Linux release 7.9 (Nitrogen) | |
Processors | 1 | |
RSS bytes | 4193255424 (3999 MiB) | |
Wall seconds limit | 257400 (71 hours) | |
Inner Apptainer? | True | |
Job state | finished | |
Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
Started | 2024-09-11 03:42:32 | |
Input files | hd-protodune:np04hd_raw_run028116_0001_dataflow1_datawriter_0_20240724T091330.hdf5 | |
Jobscript | Exit code | 0 |
Real time | 1h (3966s) | |
CPU time | 44m (2672s = 67%) | |
Outputting started | 2024-09-11 04:48:39 | |
Output files | hd-protodune-det-reco:np04hd_raw_run028116_0001_dataflow1_datawriter_0_20240724T091330_reco_stage1_reco_stage2_20240911T044832_keepup.root hd-protodune-det-reco:np04hd_raw_run028116_0001_dataflow1_datawriter_0_20240724T091330_reco_stage1_reco_stage2_20240911T044832_keepup_hists.root | |
Finished | 2024-09-11 05:04:20 | |
Saved logs | justin-logs:254038.6-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
d 9455 XVs -> 399 XUVs C:0 T:6 26794 XUs and 22000 XVs -> 1371 XUVs C:0 T:7 372 XUs and 423 XVs -> 21 XUVs 2560 XUVs total 926 collection wire objects 2560 potential space points Neighbour search... 74998 tests to find 43852 neighbours Iterating with no regularization... Begin: 2.21662e+07 0 2.07789e+07 1 2.05852e+07 2 2.0563e+07 3 2.05586e+07 Now with regularization... Begin: 1.93827e+07 0 1.93801e+07 this->SetupTestBeamPfo(pNuPfo, pTestBeamPfo, testBeamStartVertex) return STATUS_CODE_NOT_FOUND in function: Run in file: /scratch/workspace/build-larsoft/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/AlmaLinux-9.4/build/larpandoracontent/v04_09_00-buildFW/src/larpandoracontent/LArThreeDReco/LArEventBuilding/TestBeamParticleCreationAlgorithm.cc line#: 43 iter->second->Run() throw STATUS_CODE_NOT_FOUND in function: RunAlgorithm in file: /scratch/workspace/build-larbase/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/SLF7/build/pandora/v03_16_00l/src/pandora-v03-16-00/PandoraSDK-v03-04-01/src/Api/PandoraContentApiImpl.cc line#: 235 Failure in algorithm Alg0087, LArTestBeamParticleCreation, STATUS_CODE_NOT_FOUND BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list ---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------ ---SUMMARY-------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------------ 11-Sep-2024 05:48:32 BST Closed output file "np04hd_raw_run028116_0001_dataflow1_datawriter_0_20240724T091330_reco_stage1_reco_stage2_20240911T044832_keepup.root" 11-Sep-2024 05:48:32 BST Closed input file "np04hd_raw_run028116_0001_dataflow1_datawriter_0_20240724T091330_reco_stage1.root" ======================================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ======================================================================================================================================== Full event 48.7614 63.8668 89.5154 62.1347 10.5374 31 ---------------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.000306748 0.00112522 0.00292459 0.000988104 0.000638728 31 produce:fembfilter:PDHDFEMBFilter 0.532284 0.537271 0.554588 0.536273 0.00402617 31 produce:wclsdatahd:WireCellToolkit 26.4091 27.1594 28.663 27.0064 0.587587 31 produce:gaushit:GausHitFinder 0.323761 0.505492 0.719787 0.512794 0.10651 31 produce:nhitsfilter:NumberOfHitsFilter 0.000195138 0.00029689 0.000422156 0.000294245 5.8587e-05 31 produce:reco3d:SpacePointSolver 0.0786509 0.572541 1.99029 0.393266 0.44723 31 produce:hitpdune:DisambigFromSpacePoints 0.121402 0.376528 0.821122 0.333215 0.164296 31 produce:pandora:StandardPandora 4.76909 9.92994 18.9618 9.1815 3.91054 31 produce:pandoraWriter:StandardPandora 0.0714779 0.11539 0.182038 0.110152 0.0266621 31 produce:pandoraTrack:LArPandoraTrackCreation 0.284481 0.836513 1.55359 0.833649 0.273718 31 produce:pandoraShower:LArPandoraShowerCreation 0.376547 1.00109 2.30567 0.852432 0.463374 31 produce:pandoracalo:Calorimetry 0.163108 0.428291 0.788427 0.435942 0.125911 31 produce:pandoracalonosce:Calorimetry 0.14276 0.39105 0.74125 0.399527 0.120513 31 produce:pandorapid:Chi2ParticleID 0.000865572 0.00137685 0.00231365 0.00139358 0.000251059 31 produce:pandoraShowercalo:ShowerCalorimetry 0.323871 0.905327 2.23006 0.810107 0.405892 31 produce:pandoraShowercalonosce:ShowerCalorimetry 0.312788 0.867656 2.13699 0.773023 0.387523 31 produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0571801 0.0976268 0.132077 0.100956 0.0181089 31 produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0203347 0.0341142 0.0476196 0.0346183 0.00645157 31 produce:emtrkmichelid:EmTrackMichelId 12.655 18.9726 28.877 18.6331 3.91437 31 [art]:TriggerResults:TriggerResultInserter 1.2393e-05 1.63685e-05 5.31e-05 1.3425e-05 9.33625e-06 31 end_path:out1:RootOutput 3.006e-06 3.91368e-06 1.5379e-05 3.486e-06 2.15186e-06 31 end_path:michelremoving:michelremoving 0.0112928 0.0534159 0.212098 0.0214583 0.0547827 31 end_path:michelremovinggnocchi:michelremoving 0.0110479 0.0530544 0.210303 0.0227515 0.0544946 31 end_path:calibanagnocchi:CalibAnaTree 0.14362 0.332056 0.646614 0.302275 0.114427 31 end_path:out1:RootOutput(write) 0.385831 0.622404 0.934911 0.625473 0.128407 31 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 4999.55 MB Peak resident set size usage (VmHWM): 2632.93 MB Details saved in: 'mem.db' ==================================================================================================== Art has completed and will exit with status 0. Output files: \tReco: np04hd_raw_run028116_0001_dataflow1_datawriter_0_20240724T091330_reco_stage1_reco_stage2_20240911T044832_keepup.root \tHists: np04hd_raw_run028116_0001_dataflow1_datawriter_0_20240724T091330_reco_stage1_reco_stage2_20240911T044832_keepup_hists.root Forming reco metadata Successfully opened file np04hd_raw_run028116_0001_dataflow1_datawriter_0_20240724T091330_reco_stage1_reco_stage2_20240911T044832_keepup.root Ran successfully { "name": "np04hd_raw_run028116_0001_dataflow1_datawriter_0_20240724T091330_reco_stage1_reco_stage2_20240911T044832_keepup.root", "namespace": "hd-protodune-det-reco", "metadata": { "core.file_format": "artroot", "core.application.name": "reco", "core.application.family": "dunesw", "core.application.version": "v09_91_02d01", "core.data_tier": "full-reconstructed", "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl", "dune.campaign": "hd-protodune-reco-keepup-v0", "core.start_time": 1726028102.0, "core.end_time": 1726030112.0, "core.events": [ 233, 241, 249, 257, 265, 273, 297, 305, 313, 321, 329, 337, 345, 353, 361, 369, 377, 385, 393, 401, 409, 417, 425, 433, 441, 449, 457, 465, 473, 481, 489 ], "core.event_count": 31, "core.first_event_number": 233, "core.last_event_number": 489, "core.data_stream": "cosmics", "core.file_content_status": "good", "core.file_type": "detector", "core.run_type": "hd-protodune", "core.runs": [ 28116 ], "core.runs_subruns": [ 2811600001 ], "dune.daq_test": false, "retention.status": "active", "retention.class": "physics", "origin.applications.config_files": { "reco1": "standard_reco_stage1_protodunehd_keepup.fcl" }, "origin.applications.versions": { "reco1": "v09_91_02d01" }, "origin.applications.names": [ "reco1" ] }, "parents": [ { "did": "hd-protodune:np04hd_raw_run028116_0001_dataflow1_datawriter_0_20240724T091330.hdf5" } ] }Forming hist metadata formed { "name": "np04hd_raw_run028116_0001_dataflow1_datawriter_0_20240724T091330_reco_stage1_reco_stage2_20240911T044832_keepup_hists.root", "namespace": "hd-protodune-det-reco", "metadata": { "core.file_format": "root", "core.application.name": "reco", "core.application.family": "dunesw", "core.application.version": "v09_91_02d01", "core.data_tier": "root-tuple-virtual", "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl", "dune.campaign": "hd-protodune-reco-keepup-v0", "core.start_time": 1726028102.0, "core.end_time": 1726030112.0, "core.data_stream": "cosmics", "core.file_content_status": "good", "core.file_type": "detector", "core.run_type": "hd-protodune", "core.runs": [ 28116 ], "core.runs_subruns": [ 2811600001 ], "dune.daq_test": false, "retention.status": "active", "retention.class": "physics", "origin.applications.config_files": { "reco1": "standard_reco_stage1_protodunehd_keepup.fcl" }, "origin.applications.versions": { "reco1": "v09_91_02d01" }, "origin.applications.names": [ "reco1" ] }, "parents": [ { "did": "hd-protodune:np04hd_raw_run028116_0001_dataflow1_datawriter_0_20240724T091330.hdf5" } ] }