Jobsub ID 167098.1@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 167098.1@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 5781 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-03-28 15:46:42 | |
| Site | CA_SFU | |
| Entry | DUNE_CA_SFU_lcg-ce3 | |
| Last heartbeat | 2025-03-28 16:43:23 | |
| From worker node | Hostname | cdr939.int.cedar.computecanada.ca |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2683 v4 @ 2.10GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 84598 (23 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-03-28 16:18:24 | |
| Input files | monte-carlo-005781-000206 | |
| Jobscript | Exit code | 0 |
| Real time | 22m (1337s) | |
| CPU time | 19m (1143s = 85%) | |
| Max RSS bytes | 1731645440 (1651 MiB) | |
| Outputting started | 2025-03-28 16:40:42 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_1_1743178785_gen.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_1_1743178785_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_1_1743178785_gen.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_1_1743178785_gen_g4_stage1.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_1_1743178785_gen_g4_stage1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_1_1743178785_gen_g4_stage1.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_1_1743178785_gen_g4_stage1_g4_stage2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_1_1743178785_gen_g4_stage1_g4_stage2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_1_1743178785_gen_g4_stage1_g4_stage2.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_1_1743178785_gen_g4_stage1_g4_stage2_detsim.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_1_1743178785_gen_g4_stage1_g4_stage2_detsim.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_1_1743178785_gen_g4_stage1_g4_stage2_detsim.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_1_1743178785_gen_g4_stage1_g4_stage2_detsim_reco.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_1_1743178785_gen_g4_stage1_g4_stage2_detsim_reco.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_1_1743178785_gen_g4_stage1_g4_stage2_detsim_reco.err | |
| Finished | 2025-03-28 16:43:23 | |
| Saved logs | justin-logs:167098.1-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
larization...
Begin: 1.01417e+07
0 9.95955e+06
1 9.95955e+06
Now with regularization...
Begin: 9.59435e+06
0 9.59434e+06
Art has completed and will exit with status 0.
Stderr:
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
emtrkmichelid
nhitsfilter
pandoraWriter
pandoracalipid
pandorapid
trigfilter
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/497fe0b9af7ebfe5ac11fff59041e9416f4d09cb/protodunevd_v4_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16499 nodes/ 2408 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
28-Mar-2025 09:31:05 PDT Initiating request to open input file "prod_muon_p_450MeV_protodunevd_1_167098_1_1743178785_gen_g4_stage1_g4_stage2_detsim.root"
28-Mar-2025 09:31:05 PDT Opened input file "prod_muon_p_450MeV_protodunevd_1_167098_1_1743178785_gen_g4_stage1_g4_stage2_detsim.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1687 traces, 1687 summary
Retagger: tagging trace set: gauss with 1400 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1400 traces tagged "gauss"
FrameSaver: q=175827 n=19872 tag=gauss
wclsFrameSaver: saving 1687 traces tagged "wiener"
FrameSaver: q=189999 n=17936 tag=wiener
28-Mar-2025 09:32:07 PDT Opened output file with pattern "prod_muon_p_450MeV_protodunevd_1_167098_1_1743178785_gen_g4_stage1_g4_stage2_detsim_reco.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1827 traces, 1827 summary
Retagger: tagging trace set: gauss with 1382 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1382 traces tagged "gauss"
FrameSaver: q=173783 n=19500 tag=gauss
wclsFrameSaver: saving 1827 traces tagged "wiener"
FrameSaver: q=192174 n=17104 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1703 traces, 1703 summary
Retagger: tagging trace set: gauss with 1428 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1428 traces tagged "gauss"
FrameSaver: q=177751 n=19585 tag=gauss
wclsFrameSaver: saving 1703 traces tagged "wiener"
FrameSaver: q=192801 n=17647 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1722 traces, 1722 summary
Retagger: tagging trace set: gauss with 1403 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1403 traces tagged "gauss"
FrameSaver: q=168879 n=18999 tag=gauss
wclsFrameSaver: saving 1722 traces tagged "wiener"
FrameSaver: q=184233 n=17001 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1769 traces, 1769 summary
Retagger: tagging trace set: gauss with 1276 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1276 traces tagged "gauss"
FrameSaver: q=169683 n=18053 tag=gauss
wclsFrameSaver: saving 1769 traces tagged "wiener"
FrameSaver: q=188024 n=15426 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1864 traces, 1864 summary
Retagger: tagging trace set: gauss with 1489 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1489 traces tagged "gauss"
FrameSaver: q=174675 n=19552 tag=gauss
wclsFrameSaver: saving 1864 traces tagged "wiener"
FrameSaver: q=192611 n=17182 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1939 traces, 1939 summary
Retagger: tagging trace set: gauss with 1393 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1393 traces tagged "gauss"
FrameSaver: q=174738 n=19671 tag=gauss
wclsFrameSaver: saving 1939 traces tagged "wiener"
FrameSaver: q=194027 n=17013 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1639 traces, 1639 summary
Retagger: tagging trace set: gauss with 1314 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1314 traces tagged "gauss"
FrameSaver: q=164198 n=17882 tag=gauss
wclsFrameSaver: saving 1639 traces tagged "wiener"
FrameSaver: q=180423 n=15792 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1802 traces, 1802 summary
Retagger: tagging trace set: gauss with 1461 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1461 traces tagged "gauss"
FrameSaver: q=178084 n=19876 tag=gauss
wclsFrameSaver: saving 1802 traces tagged "wiener"
FrameSaver: q=193811 n=17745 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1611 traces, 1611 summary
Retagger: tagging trace set: gauss with 1417 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1417 traces tagged "gauss"
FrameSaver: q=171838 n=19670 tag=gauss
wclsFrameSaver: saving 1611 traces tagged "wiener"
FrameSaver: q=184792 n=18131 tag=wiener
28-Mar-2025 09:40:41 PDT Closed output file "prod_muon_p_450MeV_protodunevd_1_167098_1_1743178785_gen_g4_stage1_g4_stage2_detsim_reco.root"
28-Mar-2025 09:40:41 PDT Closed input file "prod_muon_p_450MeV_protodunevd_1_167098_1_1743178785_gen_g4_stage1_g4_stage2_detsim.root"
=================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
=================================================================================================================================
Full event 54.5917 57.0077 61.5792 56.2186 2.30042 10
---------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000437666 0.00053768 0.000690391 0.000515141 9.22624e-05 10
reco:rns:RandomNumberSaver 3.5912e-05 6.19214e-05 0.000240898 4.2464e-05 5.98644e-05 10
reco:wclsdatavd:WireCellToolkit 53.1754 55.7742 61.0758 55.2559 2.04896 10
reco:gaushit:GausHitFinder 0.0218934 0.023829 0.0257314 0.0239396 0.00137594 10
reco:reco3d:SpacePointSolver 0.0724605 0.0865154 0.101588 0.0879154 0.0100307 10
reco:hitpdune:DisambigFromSpacePoints 0.00222643 0.00274612 0.00431683 0.00258605 0.000557624 10
reco:pandora:StandardPandora 0.21469 1.07019 7.76356 0.341201 2.23149 10
reco:pandoraTrack:LArPandoraTrackCreation 0.00193991 0.00295809 0.00533652 0.00286238 0.000911366 10
reco:pandoraShower:LArPandoraShowerCreation 0.00027928 0.000505707 0.00199108 0.000292748 0.000513904 10
reco:pandoraStdcalo:Calorimetry 0.00187044 0.00235326 0.00431014 0.00218682 0.000680102 10
reco:pandoraGnocalo:GnocchiCalorimetry 0.00117349 0.00147446 0.00290218 0.00133458 0.000479506 10
[art]:TriggerResults:TriggerResultInserter 2.2658e-05 2.60103e-05 5.1014e-05 2.3204e-05 8.34471e-06 10
end_path:out1:RootOutput 6.997e-06 8.9851e-06 1.964e-05 7.905e-06 3.57042e-06 10
end_path:out1:RootOutput(write) 0.0373274 0.0388006 0.0427107 0.0382855 0.00155946 10
=================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3354.9 MB
Peak resident set size usage (VmHWM): 1595.99 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_muon_p_450MeV_protodunevd_1_167098_1_1743178785_gen_g4_stage1_g4_stage2_detsim_reco.root', 'start_time': 1743179398.5644274, 'end_time': 1743180042.181692}