Jobsub ID 167105.50@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 167105.50@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 5781 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-03-28 15:51:17 | |
| Site | CA_SFU | |
| Entry | DUNE_CA_SFU_lcg-ce3 | |
| Last heartbeat | 2025-03-28 17:02:58 | |
| From worker node | Hostname | cdr928.int.cedar.computecanada.ca |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2683 v4 @ 2.10GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 84598 (23 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-03-28 16:41:40 | |
| Input files | monte-carlo-005781-000800 | |
| Jobscript | Exit code | 0 |
| Real time | 20m (1224s) | |
| CPU time | 20m (1211s = 98%) | |
| Max RSS bytes | 1732100096 (1651 MiB) | |
| Outputting started | 2025-03-28 17:02:06 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_50_1743180108_gen.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_50_1743180108_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_50_1743180108_gen.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_50_1743180108_gen_g4_stage1.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_50_1743180108_gen_g4_stage1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_50_1743180108_gen_g4_stage1.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_50_1743180108_gen_g4_stage1_g4_stage2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_50_1743180108_gen_g4_stage1_g4_stage2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_50_1743180108_gen_g4_stage1_g4_stage2.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_50_1743180108_gen_g4_stage1_g4_stage2_detsim.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_50_1743180108_gen_g4_stage1_g4_stage2_detsim.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_50_1743180108_gen_g4_stage1_g4_stage2_detsim.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_50_1743180108_gen_g4_stage1_g4_stage2_detsim_reco.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_50_1743180108_gen_g4_stage1_g4_stage2_detsim_reco.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_50_1743180108_gen_g4_stage1_g4_stage2_detsim_reco.err | |
| Finished | 2025-03-28 17:02:58 | |
| Saved logs | justin-logs:167105.50-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
1.4126e+07
0 1.35026e+07
1 1.34075e+07
2 1.34049e+07
Now with regularization...
Begin: 1.23828e+07
0 1.23827e+07
Art has completed and will exit with status 0.
Stderr:
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
emtrkmichelid
nhitsfilter
pandoraWriter
pandoracalipid
pandorapid
trigfilter
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/497fe0b9af7ebfe5ac11fff59041e9416f4d09cb/protodunevd_v4_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16499 nodes/ 2408 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
28-Mar-2025 09:51:48 PDT Initiating request to open input file "prod_muon_p_450MeV_protodunevd_1_167105_50_1743180108_gen_g4_stage1_g4_stage2_detsim.root"
28-Mar-2025 09:51:49 PDT Opened input file "prod_muon_p_450MeV_protodunevd_1_167105_50_1743180108_gen_g4_stage1_g4_stage2_detsim.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1868 traces, 1868 summary
Retagger: tagging trace set: gauss with 1508 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1508 traces tagged "gauss"
FrameSaver: q=174533 n=19955 tag=gauss
wclsFrameSaver: saving 1868 traces tagged "wiener"
FrameSaver: q=192276 n=17636 tag=wiener
28-Mar-2025 09:52:47 PDT Opened output file with pattern "prod_muon_p_450MeV_protodunevd_1_167105_50_1743180108_gen_g4_stage1_g4_stage2_detsim_reco.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1718 traces, 1718 summary
Retagger: tagging trace set: gauss with 1402 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1402 traces tagged "gauss"
FrameSaver: q=174285 n=19210 tag=gauss
wclsFrameSaver: saving 1718 traces tagged "wiener"
FrameSaver: q=189602 n=17015 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1749 traces, 1749 summary
Retagger: tagging trace set: gauss with 1381 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1381 traces tagged "gauss"
FrameSaver: q=173245 n=18877 tag=gauss
wclsFrameSaver: saving 1749 traces tagged "wiener"
FrameSaver: q=189211 n=16839 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1755 traces, 1755 summary
Retagger: tagging trace set: gauss with 1486 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1486 traces tagged "gauss"
FrameSaver: q=176965 n=20084 tag=gauss
wclsFrameSaver: saving 1755 traces tagged "wiener"
FrameSaver: q=191819 n=18177 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1934 traces, 1934 summary
Retagger: tagging trace set: gauss with 1432 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1432 traces tagged "gauss"
FrameSaver: q=174503 n=20013 tag=gauss
wclsFrameSaver: saving 1934 traces tagged "wiener"
FrameSaver: q=194441 n=17377 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1862 traces, 1862 summary
Retagger: tagging trace set: gauss with 1361 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1361 traces tagged "gauss"
FrameSaver: q=168532 n=18856 tag=gauss
wclsFrameSaver: saving 1862 traces tagged "wiener"
FrameSaver: q=188648 n=16608 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1718 traces, 1718 summary
Retagger: tagging trace set: gauss with 1405 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1405 traces tagged "gauss"
FrameSaver: q=169733 n=18880 tag=gauss
wclsFrameSaver: saving 1718 traces tagged "wiener"
FrameSaver: q=185629 n=16709 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1868 traces, 1868 summary
Retagger: tagging trace set: gauss with 1478 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1478 traces tagged "gauss"
FrameSaver: q=175958 n=19615 tag=gauss
wclsFrameSaver: saving 1868 traces tagged "wiener"
FrameSaver: q=194386 n=17295 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1636 traces, 1636 summary
Retagger: tagging trace set: gauss with 1294 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1294 traces tagged "gauss"
FrameSaver: q=172854 n=17801 tag=gauss
wclsFrameSaver: saving 1636 traces tagged "wiener"
FrameSaver: q=188910 n=15749 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1771 traces, 1771 summary
Retagger: tagging trace set: gauss with 1327 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1327 traces tagged "gauss"
FrameSaver: q=166367 n=18127 tag=gauss
wclsFrameSaver: saving 1771 traces tagged "wiener"
FrameSaver: q=184694 n=15814 tag=wiener
28-Mar-2025 10:02:05 PDT Closed output file "prod_muon_p_450MeV_protodunevd_1_167105_50_1743180108_gen_g4_stage1_g4_stage2_detsim_reco.root"
28-Mar-2025 10:02:05 PDT Closed input file "prod_muon_p_450MeV_protodunevd_1_167105_50_1743180108_gen_g4_stage1_g4_stage2_detsim.root"
=================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
=================================================================================================================================
Full event 57.6969 61.2919 63.5146 61.3516 1.80113 10
---------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000390404 0.000617548 0.00080444 0.000658974 0.000137829 10
reco:rns:RandomNumberSaver 4.2178e-05 6.98964e-05 0.000288137 4.54295e-05 7.28039e-05 10
reco:wclsdatavd:WireCellToolkit 55.4397 60.6098 62.9982 60.8202 2.18194 10
reco:gaushit:GausHitFinder 0.0214744 0.0235479 0.0267714 0.0230924 0.00157024 10
reco:reco3d:SpacePointSolver 0.0722865 0.0889453 0.103122 0.0877038 0.00929904 10
reco:hitpdune:DisambigFromSpacePoints 0.00224422 0.00287954 0.00485554 0.00261721 0.000722815 10
reco:pandora:StandardPandora 0.306186 0.515486 2.07231 0.342778 0.519416 10
reco:pandoraTrack:LArPandoraTrackCreation 0.00215892 0.00306793 0.00548676 0.00307195 0.000950246 10
reco:pandoraShower:LArPandoraShowerCreation 0.000281376 0.000344458 0.000801585 0.000291877 0.000152652 10
reco:pandoraStdcalo:Calorimetry 0.00189368 0.00247418 0.00487521 0.00223586 0.000820071 10
reco:pandoraGnocalo:GnocchiCalorimetry 0.00114911 0.00176346 0.00422059 0.00131752 0.000998742 10
[art]:TriggerResults:TriggerResultInserter 2.1264e-05 2.62954e-05 5.2567e-05 2.31115e-05 9.01458e-06 10
end_path:out1:RootOutput 7.719e-06 9.8711e-06 2.1484e-05 8.5135e-06 3.91276e-06 10
end_path:out1:RootOutput(write) 0.0370529 0.0390678 0.0416977 0.0389809 0.00127526 10
=================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3328.58 MB
Peak resident set size usage (VmHWM): 1569.24 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_muon_p_450MeV_protodunevd_1_167105_50_1743180108_gen_g4_stage1_g4_stage2_detsim_reco.root', 'start_time': 1743180668.654287, 'end_time': 1743181325.5401936}