Jobsub ID 167106.33@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 167106.33@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 5780 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-03-28 15:52:21 | |
| Site | CA_SFU | |
| Entry | DUNE_CA_SFU_lcg-ce3 | |
| Last heartbeat | 2025-03-28 17:06:18 | |
| From worker node | Hostname | cdr1215.int.cedar.computecanada.ca |
| cpuinfo | Intel(R) Xeon(R) Platinum 8160 CPU @ 2.10GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 84598 (23 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-03-28 16:45:43 | |
| Input files | monte-carlo-005780-000783 | |
| Jobscript | Exit code | 0 |
| Real time | 19m (1162s) | |
| CPU time | 19m (1146s = 98%) | |
| Max RSS bytes | 1727291392 (1647 MiB) | |
| Outputting started | 2025-03-28 17:05:05 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_33_1743180351_gen.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_33_1743180351_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_33_1743180351_gen.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_33_1743180351_gen_g4_stage1.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_33_1743180351_gen_g4_stage1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_33_1743180351_gen_g4_stage1.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_33_1743180351_gen_g4_stage1_g4_stage2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_33_1743180351_gen_g4_stage1_g4_stage2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_33_1743180351_gen_g4_stage1_g4_stage2.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_33_1743180351_gen_g4_stage1_g4_stage2_detsim.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_33_1743180351_gen_g4_stage1_g4_stage2_detsim.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_33_1743180351_gen_g4_stage1_g4_stage2_detsim.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_33_1743180351_gen_g4_stage1_g4_stage2_detsim_reco.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_33_1743180351_gen_g4_stage1_g4_stage2_detsim_reco.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_33_1743180351_gen_g4_stage1_g4_stage2_detsim_reco.err | |
| Finished | 2025-03-28 17:06:18 | |
| Saved logs | justin-logs:167106.33-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
Begin: 1.81413e+07
0 1.81412e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
Art has completed and will exit with status 0.
Stderr:
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
emtrkmichelid
nhitsfilter
pandoraWriter
pandoracalipid
pandorapid
trigfilter
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/497fe0b9af7ebfe5ac11fff59041e9416f4d09cb/protodunevd_v4_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16499 nodes/ 2408 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
28-Mar-2025 09:55:24 PDT Initiating request to open input file "prod_muon_m_450MeV_protodunevd_1_167106_33_1743180351_gen_g4_stage1_g4_stage2_detsim.root"
28-Mar-2025 09:55:25 PDT Opened input file "prod_muon_m_450MeV_protodunevd_1_167106_33_1743180351_gen_g4_stage1_g4_stage2_detsim.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1750 traces, 1750 summary
Retagger: tagging trace set: gauss with 1412 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1412 traces tagged "gauss"
FrameSaver: q=163118 n=18927 tag=gauss
wclsFrameSaver: saving 1750 traces tagged "wiener"
FrameSaver: q=179823 n=16780 tag=wiener
28-Mar-2025 09:56:16 PDT Opened output file with pattern "prod_muon_m_450MeV_protodunevd_1_167106_33_1743180351_gen_g4_stage1_g4_stage2_detsim_reco.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1696 traces, 1696 summary
Retagger: tagging trace set: gauss with 1382 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1382 traces tagged "gauss"
FrameSaver: q=160267 n=18402 tag=gauss
wclsFrameSaver: saving 1696 traces tagged "wiener"
FrameSaver: q=175734 n=16105 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1703 traces, 1703 summary
Retagger: tagging trace set: gauss with 1288 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1288 traces tagged "gauss"
FrameSaver: q=156760 n=17304 tag=gauss
wclsFrameSaver: saving 1703 traces tagged "wiener"
FrameSaver: q=174398 n=15100 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1866 traces, 1866 summary
Retagger: tagging trace set: gauss with 1346 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1346 traces tagged "gauss"
FrameSaver: q=164952 n=18956 tag=gauss
wclsFrameSaver: saving 1866 traces tagged "wiener"
FrameSaver: q=184029 n=16324 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1732 traces, 1732 summary
Retagger: tagging trace set: gauss with 1389 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1389 traces tagged "gauss"
FrameSaver: q=158383 n=18142 tag=gauss
wclsFrameSaver: saving 1732 traces tagged "wiener"
FrameSaver: q=175903 n=16010 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1660 traces, 1660 summary
Retagger: tagging trace set: gauss with 1386 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1386 traces tagged "gauss"
FrameSaver: q=160715 n=18130 tag=gauss
wclsFrameSaver: saving 1660 traces tagged "wiener"
FrameSaver: q=175950 n=16320 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1731 traces, 1731 summary
Retagger: tagging trace set: gauss with 1273 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1273 traces tagged "gauss"
FrameSaver: q=161318 n=17814 tag=gauss
wclsFrameSaver: saving 1731 traces tagged "wiener"
FrameSaver: q=179909 n=15524 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1798 traces, 1798 summary
Retagger: tagging trace set: gauss with 1452 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1452 traces tagged "gauss"
FrameSaver: q=163901 n=19259 tag=gauss
wclsFrameSaver: saving 1798 traces tagged "wiener"
FrameSaver: q=180255 n=17146 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1730 traces, 1730 summary
Retagger: tagging trace set: gauss with 1446 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1446 traces tagged "gauss"
FrameSaver: q=163376 n=19150 tag=gauss
wclsFrameSaver: saving 1730 traces tagged "wiener"
FrameSaver: q=178604 n=17185 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1675 traces, 1675 summary
Retagger: tagging trace set: gauss with 1339 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1339 traces tagged "gauss"
FrameSaver: q=176988 n=18446 tag=gauss
wclsFrameSaver: saving 1675 traces tagged "wiener"
FrameSaver: q=192849 n=16281 tag=wiener
28-Mar-2025 10:05:04 PDT Closed output file "prod_muon_m_450MeV_protodunevd_1_167106_33_1743180351_gen_g4_stage1_g4_stage2_detsim_reco.root"
28-Mar-2025 10:05:04 PDT Closed input file "prod_muon_m_450MeV_protodunevd_1_167106_33_1743180351_gen_g4_stage1_g4_stage2_detsim.root"
=================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
=================================================================================================================================
Full event 51.1484 57.6595 61.2594 58.4522 3.37038 10
---------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000506411 0.000715081 0.000936914 0.000721738 0.000120627 10
reco:rns:RandomNumberSaver 4.4827e-05 7.64966e-05 0.000280137 4.94115e-05 6.8805e-05 10
reco:wclsdatavd:WireCellToolkit 48.8713 57.006 60.7666 58.0301 3.73939 10
reco:gaushit:GausHitFinder 0.0202296 0.0223682 0.0249896 0.0225418 0.00137566 10
reco:reco3d:SpacePointSolver 0.0649041 0.0885655 0.122094 0.0863988 0.0140234 10
reco:hitpdune:DisambigFromSpacePoints 0.00230983 0.00277231 0.00438357 0.00253898 0.000633482 10
reco:pandora:StandardPandora 0.228437 0.487289 2.08331 0.312583 0.533365 10
reco:pandoraTrack:LArPandoraTrackCreation 0.00180833 0.00283274 0.00535294 0.00286587 0.00103207 10
reco:pandoraShower:LArPandoraShowerCreation 0.000249451 0.000500357 0.00212433 0.00026364 0.000563697 10
reco:pandoraStdcalo:Calorimetry 0.00192709 0.0023095 0.00454027 0.00206244 0.000751702 10
reco:pandoraGnocalo:GnocchiCalorimetry 0.00112867 0.00142799 0.00309695 0.00124163 0.000558938 10
[art]:TriggerResults:TriggerResultInserter 1.7809e-05 2.36195e-05 7.0916e-05 1.81555e-05 1.57865e-05 10
end_path:out1:RootOutput 8.695e-06 1.11186e-05 2.5561e-05 9.5895e-06 4.83906e-06 10
end_path:out1:RootOutput(write) 0.038358 0.0410098 0.0495405 0.0400372 0.00305936 10
=================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3378.73 MB
Peak resident set size usage (VmHWM): 1622.79 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_muon_m_450MeV_protodunevd_1_167106_33_1743180351_gen_g4_stage1_g4_stage2_detsim_reco.root', 'start_time': 1743180892.7436078, 'end_time': 1743181505.4056227}