Jobsub ID 167096.187@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 167096.187@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 5781 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-03-28 15:45:32 | |
| Site | CA_SFU | |
| Entry | DUNE_CA_SFU_lcg-ce3 | |
| Last heartbeat | 2025-03-28 16:28:59 | |
| From worker node | Hostname | cdr1221.int.cedar.computecanada.ca |
| cpuinfo | Intel(R) Xeon(R) Platinum 8160 CPU @ 2.10GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 84598 (23 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-03-28 16:08:44 | |
| Input files | monte-carlo-005781-000168 | |
| Jobscript | Exit code | 0 |
| Real time | 19m (1156s) | |
| CPU time | 18m (1080s = 93%) | |
| Max RSS bytes | 1728954368 (1648 MiB) | |
| Outputting started | 2025-03-28 16:28:02 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_187_1743178131_gen.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_187_1743178131_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_187_1743178131_gen.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_187_1743178131_gen_g4_stage1.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_187_1743178131_gen_g4_stage1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_187_1743178131_gen_g4_stage1.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_187_1743178131_gen_g4_stage1_g4_stage2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_187_1743178131_gen_g4_stage1_g4_stage2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_187_1743178131_gen_g4_stage1_g4_stage2.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_187_1743178131_gen_g4_stage1_g4_stage2_detsim.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_187_1743178131_gen_g4_stage1_g4_stage2_detsim.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_187_1743178131_gen_g4_stage1_g4_stage2_detsim.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_187_1743178131_gen_g4_stage1_g4_stage2_detsim_reco.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_187_1743178131_gen_g4_stage1_g4_stage2_detsim_reco.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/003/prod_muon_p_450MeV_protodunevd_1_167096_187_1743178131_gen_g4_stage1_g4_stage2_detsim_reco.err | |
| Finished | 2025-03-28 16:28:59 | |
| Saved logs | justin-logs:167096.187-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
..
Begin: 4.8476e+06
0 4.80482e+06
1 4.80482e+06
Now with regularization...
Begin: 3.85128e+06
0 3.85128e+06
Art has completed and will exit with status 0.
Stderr:
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
emtrkmichelid
nhitsfilter
pandoraWriter
pandoracalipid
pandorapid
trigfilter
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/497fe0b9af7ebfe5ac11fff59041e9416f4d09cb/protodunevd_v4_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16499 nodes/ 2408 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
28-Mar-2025 09:18:53 PDT Initiating request to open input file "prod_muon_p_450MeV_protodunevd_1_167096_187_1743178131_gen_g4_stage1_g4_stage2_detsim.root"
28-Mar-2025 09:18:53 PDT Opened input file "prod_muon_p_450MeV_protodunevd_1_167096_187_1743178131_gen_g4_stage1_g4_stage2_detsim.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1792 traces, 1792 summary
Retagger: tagging trace set: gauss with 1377 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1377 traces tagged "gauss"
FrameSaver: q=168121 n=19212 tag=gauss
wclsFrameSaver: saving 1792 traces tagged "wiener"
FrameSaver: q=185209 n=16876 tag=wiener
28-Mar-2025 09:20:23 PDT Opened output file with pattern "prod_muon_p_450MeV_protodunevd_1_167096_187_1743178131_gen_g4_stage1_g4_stage2_detsim_reco.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1740 traces, 1740 summary
Retagger: tagging trace set: gauss with 1321 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1321 traces tagged "gauss"
FrameSaver: q=173969 n=18486 tag=gauss
wclsFrameSaver: saving 1740 traces tagged "wiener"
FrameSaver: q=191889 n=16396 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1740 traces, 1740 summary
Retagger: tagging trace set: gauss with 1375 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1375 traces tagged "gauss"
FrameSaver: q=172052 n=18603 tag=gauss
wclsFrameSaver: saving 1740 traces tagged "wiener"
FrameSaver: q=188993 n=16340 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1804 traces, 1804 summary
Retagger: tagging trace set: gauss with 1428 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1428 traces tagged "gauss"
FrameSaver: q=175185 n=19986 tag=gauss
wclsFrameSaver: saving 1804 traces tagged "wiener"
FrameSaver: q=191293 n=17753 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1680 traces, 1680 summary
Retagger: tagging trace set: gauss with 1393 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1393 traces tagged "gauss"
FrameSaver: q=170821 n=18967 tag=gauss
wclsFrameSaver: saving 1680 traces tagged "wiener"
FrameSaver: q=185846 n=17000 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1895 traces, 1895 summary
Retagger: tagging trace set: gauss with 1527 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1527 traces tagged "gauss"
FrameSaver: q=179646 n=20922 tag=gauss
wclsFrameSaver: saving 1895 traces tagged "wiener"
FrameSaver: q=196488 n=18700 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1796 traces, 1796 summary
Retagger: tagging trace set: gauss with 1363 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1363 traces tagged "gauss"
FrameSaver: q=172690 n=19202 tag=gauss
wclsFrameSaver: saving 1796 traces tagged "wiener"
FrameSaver: q=190409 n=16760 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1746 traces, 1746 summary
Retagger: tagging trace set: gauss with 1446 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1446 traces tagged "gauss"
FrameSaver: q=169601 n=19118 tag=gauss
wclsFrameSaver: saving 1746 traces tagged "wiener"
FrameSaver: q=185394 n=17008 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1858 traces, 1858 summary
Retagger: tagging trace set: gauss with 1468 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1468 traces tagged "gauss"
FrameSaver: q=173792 n=19666 tag=gauss
wclsFrameSaver: saving 1858 traces tagged "wiener"
FrameSaver: q=192131 n=17470 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1729 traces, 1729 summary
Retagger: tagging trace set: gauss with 1489 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1489 traces tagged "gauss"
FrameSaver: q=175467 n=19643 tag=gauss
wclsFrameSaver: saving 1729 traces tagged "wiener"
FrameSaver: q=190031 n=18004 tag=wiener
28-Mar-2025 09:28:01 PDT Closed output file "prod_muon_p_450MeV_protodunevd_1_167096_187_1743178131_gen_g4_stage1_g4_stage2_detsim_reco.root"
28-Mar-2025 09:28:01 PDT Closed input file "prod_muon_p_450MeV_protodunevd_1_167096_187_1743178131_gen_g4_stage1_g4_stage2_detsim.root"
=================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
=================================================================================================================================
Full event 48.567 54.1243 88.6792 49.4332 11.64 10
---------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000387159 0.000537702 0.000678207 0.000556064 7.75304e-05 10
reco:rns:RandomNumberSaver 2.8846e-05 5.62259e-05 0.000190607 4.3503e-05 4.50848e-05 10
reco:wclsdatavd:WireCellToolkit 47.7021 49.5588 52.7512 48.8086 1.78889 10
reco:gaushit:GausHitFinder 0.0223918 0.024469 0.027727 0.0244209 0.00151511 10
reco:reco3d:SpacePointSolver 0.0753217 0.0908183 0.102695 0.0906358 0.0078649 10
reco:hitpdune:DisambigFromSpacePoints 0.00228466 0.00263732 0.00396799 0.00251864 0.000472195 10
reco:pandora:StandardPandora 0.324752 4.39548 40.7928 0.353786 12.1325 10
reco:pandoraTrack:LArPandoraTrackCreation 0.0019217 0.00317951 0.0046608 0.0031649 0.000706237 10
reco:pandoraShower:LArPandoraShowerCreation 0.000240739 0.000435134 0.00141977 0.000280827 0.000350295 10
reco:pandoraStdcalo:Calorimetry 0.00168112 0.00221665 0.00373261 0.00203116 0.000552068 10
reco:pandoraGnocalo:GnocchiCalorimetry 0.00112433 0.00137828 0.00266409 0.00125013 0.00043424 10
[art]:TriggerResults:TriggerResultInserter 1.6292e-05 2.10832e-05 4.6486e-05 1.80865e-05 8.6395e-06 10
end_path:out1:RootOutput 6.059e-06 7.6778e-06 1.6109e-05 6.813e-06 2.84107e-06 10
end_path:out1:RootOutput(write) 0.0385572 0.0400517 0.0421657 0.0399821 0.0010585 10
=================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3283.26 MB
Peak resident set size usage (VmHWM): 1529.48 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_muon_p_450MeV_protodunevd_1_167096_187_1743178131_gen_g4_stage1_g4_stage2_detsim_reco.root', 'start_time': 1743178687.5988455, 'end_time': 1743179281.43745}