Jobsub ID 167096.97@justin-prod-sched02.dune.hep.ac.uk
Jobsub ID | 167096.97@justin-prod-sched02.dune.hep.ac.uk | |
Workflow ID | 5781 | |
Stage ID | 1 | |
User name | ykermaid@fnal.gov | |
HTCondor Group | group_dune | |
Requested | Processors | 1 |
GPU | No | |
RSS bytes | 6815744000 (6500 MiB) | |
Wall seconds limit | 80000 (22 hours) | |
Submitted time | 2025-03-28 15:45:31 | |
Site | US_PuertoRico | |
Entry | CMSHTPC_T3_US_PuertoRico_UPRM | |
Last heartbeat | 2025-03-28 16:30:33 | |
From worker node | Hostname | compute-1-3.local |
cpuinfo | Intel(R) Xeon(R) CPU W3550 @ 3.07GHz | |
OS release | Scientific Linux release 7.9 (Nitrogen) | |
Processors | 1 | |
RSS bytes | 6815744000 (6500 MiB) | |
Wall seconds limit | 171000 (47 hours) | |
GPU | ||
Inner Apptainer? | True | |
Job state | finished | |
Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
Started | 2025-03-28 16:04:14 | |
Input files | monte-carlo-005781-000092 | |
Jobscript | Exit code | 0 |
Real time | 25m (1518s) | |
CPU time | 25m (1501s = 98%) | |
Max RSS bytes | 1598787584 (1524 MiB) | |
Outputting started | 2025-03-28 16:29:33 | |
Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_97_1743177863_gen_g4_stage1_g4_stage2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_97_1743177863_gen_g4_stage1_g4_stage2_detsim.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_97_1743177863_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_97_1743177863_gen.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_97_1743177863_gen_g4_stage1.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_97_1743177863_gen_g4_stage1_g4_stage2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_97_1743177863_gen_g4_stage1_g4_stage2_detsim.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_97_1743177863_gen_g4_stage1_g4_stage2.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_97_1743177863_gen_g4_stage1_g4_stage2_detsim_reco.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_97_1743177863_gen_g4_stage1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_97_1743177863_gen_g4_stage1_g4_stage2_detsim_reco.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_97_1743177863_gen.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_97_1743177863_gen_g4_stage1.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_97_1743177863_gen_g4_stage1_g4_stage2_detsim_reco.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_97_1743177863_gen_g4_stage1_g4_stage2_detsim.err | |
Finished | 2025-03-28 16:30:33 | |
Saved logs | justin-logs:167096.97-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
.. Begin: 2.40143e+07 0 2.40143e+07 BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list Art has completed and will exit with status 0. Stderr: The following module labels are either not assigned to any path, or they have been assigned to ignored path(s): emtrkmichelid nhitsfilter pandoraWriter pandoracalipid pandorapid trigfilter Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/497fe0b9af7ebfe5ac11fff59041e9416f4d09cb/protodunevd_v4_refactored.gdml Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100 Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes... Info in <TGeoManager::CheckGeometry>: ...Nothing to fix Info in <TGeoManager::CloseGeometry>: Counting nodes... Info in <TGeoManager::Voxelize>: Voxelizing... Info in <TGeoManager::CloseGeometry>: Building cache... Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292 Info in <TGeoManager::CloseGeometry>: 16499 nodes/ 2408 volume UID's in Geometry imported from GDML Info in <TGeoManager::CloseGeometry>: ----------------modeler ready---------------- Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak). Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak). Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak). Inputer: "wclsRawFrameSource" Outputer: "wclsFrameSaver:spsaver" wclsFrameSaver: promising to produce recob::Wires named "gauss" wclsFrameSaver: promising to produce recob::Wires named "wiener" 28-Mar-2025 12:16:42 AST Initiating request to open input file "prod_muon_p_450MeV_protodunevd_1_167096_97_1743177863_gen_g4_stage1_g4_stage2_detsim.root" 28-Mar-2025 12:16:42 AST Opened input file "prod_muon_p_450MeV_protodunevd_1_167096_97_1743177863_gen_g4_stage1_g4_stage2_detsim.root" RawFrameSource: got 12288 raw::RawDigit objects input nticks=6000 keeping as is Retagger: tagging trace set: wiener with 1688 traces, 1688 summary Retagger: tagging trace set: gauss with 1271 traces, 0 summary wclsFrameSaver saving cooked to 6000 ticks wclsFrameSaver: saving 1271 traces tagged "gauss" FrameSaver: q=157986 n=17258 tag=gauss wclsFrameSaver: saving 1688 traces tagged "wiener" FrameSaver: q=176774 n=15036 tag=wiener 28-Mar-2025 12:17:59 AST Opened output file with pattern "prod_muon_p_450MeV_protodunevd_1_167096_97_1743177863_gen_g4_stage1_g4_stage2_detsim_reco.root" RawFrameSource: got 12288 raw::RawDigit objects input nticks=6000 keeping as is Retagger: tagging trace set: wiener with 1902 traces, 1902 summary Retagger: tagging trace set: gauss with 1412 traces, 0 summary wclsFrameSaver saving cooked to 6000 ticks wclsFrameSaver: saving 1412 traces tagged "gauss" FrameSaver: q=177935 n=19463 tag=gauss wclsFrameSaver: saving 1902 traces tagged "wiener" FrameSaver: q=197389 n=16967 tag=wiener RawFrameSource: got 12288 raw::RawDigit objects input nticks=6000 keeping as is Retagger: tagging trace set: wiener with 1804 traces, 1804 summary Retagger: tagging trace set: gauss with 1471 traces, 0 summary wclsFrameSaver saving cooked to 6000 ticks wclsFrameSaver: saving 1471 traces tagged "gauss" FrameSaver: q=178593 n=20057 tag=gauss wclsFrameSaver: saving 1804 traces tagged "wiener" FrameSaver: q=194950 n=18011 tag=wiener RawFrameSource: got 12288 raw::RawDigit objects input nticks=6000 keeping as is Retagger: tagging trace set: wiener with 1766 traces, 1766 summary Retagger: tagging trace set: gauss with 1348 traces, 0 summary wclsFrameSaver saving cooked to 6000 ticks wclsFrameSaver: saving 1348 traces tagged "gauss" FrameSaver: q=166763 n=18265 tag=gauss wclsFrameSaver: saving 1766 traces tagged "wiener" FrameSaver: q=184071 n=15972 tag=wiener RawFrameSource: got 12288 raw::RawDigit objects input nticks=6000 keeping as is Retagger: tagging trace set: wiener with 1672 traces, 1672 summary Retagger: tagging trace set: gauss with 1380 traces, 0 summary wclsFrameSaver saving cooked to 6000 ticks wclsFrameSaver: saving 1380 traces tagged "gauss" FrameSaver: q=177530 n=18983 tag=gauss wclsFrameSaver: saving 1672 traces tagged "wiener" FrameSaver: q=192766 n=17045 tag=wiener RawFrameSource: got 12288 raw::RawDigit objects input nticks=6000 keeping as is Retagger: tagging trace set: wiener with 1753 traces, 1753 summary Retagger: tagging trace set: gauss with 1329 traces, 0 summary wclsFrameSaver saving cooked to 6000 ticks wclsFrameSaver: saving 1329 traces tagged "gauss" FrameSaver: q=169500 n=18381 tag=gauss wclsFrameSaver: saving 1753 traces tagged "wiener" FrameSaver: q=187995 n=16122 tag=wiener RawFrameSource: got 12288 raw::RawDigit objects input nticks=6000 keeping as is Retagger: tagging trace set: wiener with 1838 traces, 1838 summary Retagger: tagging trace set: gauss with 1482 traces, 0 summary wclsFrameSaver saving cooked to 6000 ticks wclsFrameSaver: saving 1482 traces tagged "gauss" FrameSaver: q=172677 n=19872 tag=gauss wclsFrameSaver: saving 1838 traces tagged "wiener" FrameSaver: q=190045 n=17676 tag=wiener RawFrameSource: got 12288 raw::RawDigit objects input nticks=6000 keeping as is Retagger: tagging trace set: wiener with 1775 traces, 1775 summary Retagger: tagging trace set: gauss with 1384 traces, 0 summary wclsFrameSaver saving cooked to 6000 ticks wclsFrameSaver: saving 1384 traces tagged "gauss" FrameSaver: q=177340 n=19319 tag=gauss wclsFrameSaver: saving 1775 traces tagged "wiener" FrameSaver: q=193974 n=17000 tag=wiener RawFrameSource: got 12288 raw::RawDigit objects input nticks=6000 keeping as is Retagger: tagging trace set: wiener with 1757 traces, 1757 summary Retagger: tagging trace set: gauss with 1406 traces, 0 summary wclsFrameSaver saving cooked to 6000 ticks wclsFrameSaver: saving 1406 traces tagged "gauss" FrameSaver: q=167868 n=18722 tag=gauss wclsFrameSaver: saving 1757 traces tagged "wiener" FrameSaver: q=184280 n=16559 tag=wiener RawFrameSource: got 12288 raw::RawDigit objects input nticks=6000 keeping as is Retagger: tagging trace set: wiener with 1753 traces, 1753 summary Retagger: tagging trace set: gauss with 1384 traces, 0 summary wclsFrameSaver saving cooked to 6000 ticks wclsFrameSaver: saving 1384 traces tagged "gauss" FrameSaver: q=168491 n=18791 tag=gauss wclsFrameSaver: saving 1753 traces tagged "wiener" FrameSaver: q=184763 n=16555 tag=wiener 28-Mar-2025 12:29:31 AST Closed output file "prod_muon_p_450MeV_protodunevd_1_167096_97_1743177863_gen_g4_stage1_g4_stage2_detsim_reco.root" 28-Mar-2025 12:29:31 AST Closed input file "prod_muon_p_450MeV_protodunevd_1_167096_97_1743177863_gen_g4_stage1_g4_stage2_detsim.root" ================================================================================================================================= TimeTracker printout (sec) Min Avg Max Median RMS nEvts ================================================================================================================================= Full event 72.6793 76.0921 82.5977 75.2472 3.24515 10 --------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.000307326 0.000386003 0.000575719 0.00035193 8.16636e-05 10 reco:rns:RandomNumberSaver 3.4834e-05 5.77147e-05 0.000235609 3.8874e-05 5.93288e-05 10 reco:wclsdatavd:WireCellToolkit 72.3507 75.5339 82.2225 74.6749 3.26375 10 reco:gaushit:GausHitFinder 0.0210728 0.022029 0.0245667 0.021755 0.000903878 10 reco:reco3d:SpacePointSolver 0.0605401 0.0746969 0.0871821 0.0742772 0.0066279 10 reco:hitpdune:DisambigFromSpacePoints 0.0018984 0.00235209 0.00432771 0.00214982 0.000669822 10 reco:pandora:StandardPandora 0.186945 0.41497 1.7859 0.272683 0.4581 10 reco:pandoraTrack:LArPandoraTrackCreation 0.00179057 0.00278387 0.00641202 0.00229593 0.0013693 10 reco:pandoraShower:LArPandoraShowerCreation 0.000218828 0.000452656 0.00138886 0.000242513 0.000372308 10 reco:pandoraStdcalo:Calorimetry 0.00166294 0.00219104 0.00448005 0.00196295 0.00078435 10 reco:pandoraGnocalo:GnocchiCalorimetry 0.00104297 0.00135765 0.00361224 0.00109328 0.000753256 10 [art]:TriggerResults:TriggerResultInserter 1.7999e-05 2.36789e-05 6.9102e-05 1.8361e-05 1.51567e-05 10 end_path:out1:RootOutput 3.979e-06 5.5068e-06 1.7477e-05 4.1915e-06 3.99181e-06 10 end_path:out1:RootOutput(write) 0.0312612 0.0330015 0.037707 0.0325794 0.00176073 10 ================================================================================================================================= ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 3350.36 MB Peak resident set size usage (VmHWM): 1374.5 MB Details saved in: 'mem.db' ==================================================================================================== {'art_out': 'prod_muon_p_450MeV_protodunevd_1_167096_97_1743177863_gen_g4_stage1_g4_stage2_detsim_reco.root', 'start_time': 1743178565.818389, 'end_time': 1743179372.3386896}