Jobsub ID 167098.2@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 167098.2@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 5781 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-03-28 15:46:42 | |
| Site | CA_SFU | |
| Entry | DUNE_CA_SFU_lcg-ce3 | |
| Last heartbeat | 2025-03-28 16:42:51 | |
| From worker node | Hostname | cdr929.int.cedar.computecanada.ca |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2683 v4 @ 2.10GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 84598 (23 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-03-28 16:18:01 | |
| Input files | monte-carlo-005781-000210 | |
| Jobscript | Exit code | 0 |
| Real time | 23m (1426s) | |
| CPU time | 19m (1150s = 80%) | |
| Max RSS bytes | 1731706880 (1651 MiB) | |
| Outputting started | 2025-03-28 16:41:49 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_2_1743178787_gen.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_2_1743178787_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_2_1743178787_gen.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_2_1743178787_gen_g4_stage1.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_2_1743178787_gen_g4_stage1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_2_1743178787_gen_g4_stage1.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_2_1743178787_gen_g4_stage1_g4_stage2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_2_1743178787_gen_g4_stage1_g4_stage2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_2_1743178787_gen_g4_stage1_g4_stage2.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_2_1743178787_gen_g4_stage1_g4_stage2_detsim.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_2_1743178787_gen_g4_stage1_g4_stage2_detsim.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_2_1743178787_gen_g4_stage1_g4_stage2_detsim.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_2_1743178787_gen_g4_stage1_g4_stage2_detsim_reco.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_2_1743178787_gen_g4_stage1_g4_stage2_detsim_reco.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_2_1743178787_gen_g4_stage1_g4_stage2_detsim_reco.err | |
| Finished | 2025-03-28 16:42:51 | |
| Saved logs | justin-logs:167098.2-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
gin: 9.18724e+06
0 8.53554e+06
1 8.46531e+06
2 8.46395e+06
Now with regularization...
Begin: 7.19961e+06
0 7.19952e+06
Art has completed and will exit with status 0.
Stderr:
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
emtrkmichelid
nhitsfilter
pandoraWriter
pandoracalipid
pandorapid
trigfilter
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/497fe0b9af7ebfe5ac11fff59041e9416f4d09cb/protodunevd_v4_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16499 nodes/ 2408 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
28-Mar-2025 09:31:53 PDT Initiating request to open input file "prod_muon_p_450MeV_protodunevd_1_167098_2_1743178787_gen_g4_stage1_g4_stage2_detsim.root"
28-Mar-2025 09:31:54 PDT Opened input file "prod_muon_p_450MeV_protodunevd_1_167098_2_1743178787_gen_g4_stage1_g4_stage2_detsim.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1762 traces, 1762 summary
Retagger: tagging trace set: gauss with 1405 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1405 traces tagged "gauss"
FrameSaver: q=178059 n=19949 tag=gauss
wclsFrameSaver: saving 1762 traces tagged "wiener"
FrameSaver: q=193802 n=17613 tag=wiener
28-Mar-2025 09:33:21 PDT Opened output file with pattern "prod_muon_p_450MeV_protodunevd_1_167098_2_1743178787_gen_g4_stage1_g4_stage2_detsim_reco.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1747 traces, 1747 summary
Retagger: tagging trace set: gauss with 1438 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1438 traces tagged "gauss"
FrameSaver: q=177854 n=19643 tag=gauss
wclsFrameSaver: saving 1747 traces tagged "wiener"
FrameSaver: q=193412 n=17560 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1843 traces, 1843 summary
Retagger: tagging trace set: gauss with 1442 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1442 traces tagged "gauss"
FrameSaver: q=168000 n=19386 tag=gauss
wclsFrameSaver: saving 1843 traces tagged "wiener"
FrameSaver: q=186857 n=17139 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1700 traces, 1700 summary
Retagger: tagging trace set: gauss with 1379 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1379 traces tagged "gauss"
FrameSaver: q=168214 n=18607 tag=gauss
wclsFrameSaver: saving 1700 traces tagged "wiener"
FrameSaver: q=183793 n=16641 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1878 traces, 1878 summary
Retagger: tagging trace set: gauss with 1420 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1420 traces tagged "gauss"
FrameSaver: q=177808 n=19685 tag=gauss
wclsFrameSaver: saving 1878 traces tagged "wiener"
FrameSaver: q=195809 n=17321 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1857 traces, 1857 summary
Retagger: tagging trace set: gauss with 1497 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1497 traces tagged "gauss"
FrameSaver: q=174724 n=19894 tag=gauss
wclsFrameSaver: saving 1857 traces tagged "wiener"
FrameSaver: q=192605 n=17514 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1713 traces, 1713 summary
Retagger: tagging trace set: gauss with 1370 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1370 traces tagged "gauss"
FrameSaver: q=176152 n=19300 tag=gauss
wclsFrameSaver: saving 1713 traces tagged "wiener"
FrameSaver: q=192065 n=17116 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1894 traces, 1894 summary
Retagger: tagging trace set: gauss with 1422 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1422 traces tagged "gauss"
FrameSaver: q=176177 n=19780 tag=gauss
wclsFrameSaver: saving 1894 traces tagged "wiener"
FrameSaver: q=195098 n=17252 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1852 traces, 1852 summary
Retagger: tagging trace set: gauss with 1467 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1467 traces tagged "gauss"
FrameSaver: q=177357 n=19705 tag=gauss
wclsFrameSaver: saving 1852 traces tagged "wiener"
FrameSaver: q=195220 n=17321 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1848 traces, 1848 summary
Retagger: tagging trace set: gauss with 1433 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1433 traces tagged "gauss"
FrameSaver: q=176126 n=19553 tag=gauss
wclsFrameSaver: saving 1848 traces tagged "wiener"
FrameSaver: q=194434 n=17238 tag=wiener
28-Mar-2025 09:41:48 PDT Closed output file "prod_muon_p_450MeV_protodunevd_1_167098_2_1743178787_gen_g4_stage1_g4_stage2_detsim_reco.root"
28-Mar-2025 09:41:48 PDT Closed input file "prod_muon_p_450MeV_protodunevd_1_167098_2_1743178787_gen_g4_stage1_g4_stage2_detsim.root"
=================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
=================================================================================================================================
Full event 55.1745 58.9308 86.052 56.0742 9.06088 10
---------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000378694 0.00048874 0.000625335 0.00048326 7.73892e-05 10
reco:rns:RandomNumberSaver 4.1343e-05 6.00518e-05 0.000207477 4.374e-05 4.91718e-05 10
reco:wclsdatavd:WireCellToolkit 53.8092 55.2406 56.5253 55.1743 0.773521 10
reco:gaushit:GausHitFinder 0.0215637 0.0239541 0.0314981 0.0230273 0.00267872 10
reco:reco3d:SpacePointSolver 0.0783263 0.0891941 0.0996404 0.0913591 0.00637534 10
reco:hitpdune:DisambigFromSpacePoints 0.00238048 0.0028421 0.00423276 0.00280632 0.000500399 10
reco:pandora:StandardPandora 0.30747 3.52305 32.0545 0.35718 9.51051 10
reco:pandoraTrack:LArPandoraTrackCreation 0.00229412 0.00334417 0.00597481 0.00311366 0.000958867 10
reco:pandoraShower:LArPandoraShowerCreation 0.000275018 0.000340349 0.000775785 0.000291882 0.00014552 10
reco:pandoraStdcalo:Calorimetry 0.00199997 0.00249071 0.00451381 0.00232024 0.0006881 10
reco:pandoraGnocalo:GnocchiCalorimetry 0.00120092 0.0014838 0.00286117 0.00134997 0.000465259 10
[art]:TriggerResults:TriggerResultInserter 2.0342e-05 2.47313e-05 5.1452e-05 2.18395e-05 8.96206e-06 10
end_path:out1:RootOutput 6.9e-06 8.9998e-06 2.0549e-05 7.895e-06 3.87566e-06 10
end_path:out1:RootOutput(write) 0.0368209 0.0388879 0.0402225 0.0391423 0.00106769 10
=================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3381.81 MB
Peak resident set size usage (VmHWM): 1621.42 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_muon_p_450MeV_protodunevd_1_167098_2_1743178787_gen_g4_stage1_g4_stage2_detsim_reco.root', 'start_time': 1743179469.4936826, 'end_time': 1743180108.4401464}