Jobsub ID 167133.104@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 167133.104@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 5781 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-03-28 15:54:01 | |
| Site | CA_SFU | |
| Entry | DUNE_CA_SFU_lcg-ce3 | |
| Last heartbeat | 2025-03-28 17:11:45 | |
| From worker node | Hostname | cdr1221.int.cedar.computecanada.ca |
| cpuinfo | Intel(R) Xeon(R) Platinum 8160 CPU @ 2.10GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 84598 (23 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-03-28 16:51:35 | |
| Input files | monte-carlo-005781-000996 | |
| Jobscript | Exit code | 0 |
| Real time | 18m (1107s) | |
| CPU time | 18m (1099s = 99%) | |
| Max RSS bytes | 1730048000 (1649 MiB) | |
| Outputting started | 2025-03-28 17:10:03 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/015/prod_muon_p_450MeV_protodunevd_1_167133_104_1743180702_gen.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/015/prod_muon_p_450MeV_protodunevd_1_167133_104_1743180702_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/015/prod_muon_p_450MeV_protodunevd_1_167133_104_1743180702_gen.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/015/prod_muon_p_450MeV_protodunevd_1_167133_104_1743180702_gen_g4_stage1.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/015/prod_muon_p_450MeV_protodunevd_1_167133_104_1743180702_gen_g4_stage1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/015/prod_muon_p_450MeV_protodunevd_1_167133_104_1743180702_gen_g4_stage1.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/015/prod_muon_p_450MeV_protodunevd_1_167133_104_1743180702_gen_g4_stage1_g4_stage2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/015/prod_muon_p_450MeV_protodunevd_1_167133_104_1743180702_gen_g4_stage1_g4_stage2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/015/prod_muon_p_450MeV_protodunevd_1_167133_104_1743180702_gen_g4_stage1_g4_stage2.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/015/prod_muon_p_450MeV_protodunevd_1_167133_104_1743180702_gen_g4_stage1_g4_stage2_detsim.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/015/prod_muon_p_450MeV_protodunevd_1_167133_104_1743180702_gen_g4_stage1_g4_stage2_detsim.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/015/prod_muon_p_450MeV_protodunevd_1_167133_104_1743180702_gen_g4_stage1_g4_stage2_detsim.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/015/prod_muon_p_450MeV_protodunevd_1_167133_104_1743180702_gen_g4_stage1_g4_stage2_detsim_reco.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/015/prod_muon_p_450MeV_protodunevd_1_167133_104_1743180702_gen_g4_stage1_g4_stage2_detsim_reco.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/015/prod_muon_p_450MeV_protodunevd_1_167133_104_1743180702_gen_g4_stage1_g4_stage2_detsim_reco.err | |
| Finished | 2025-03-28 17:11:45 | |
| Saved logs | justin-logs:167133.104-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
55e+07
0 9.62478e+06
1 9.58605e+06
2 9.5858e+06
Now with regularization...
Begin: 8.51342e+06
0 8.51338e+06
Art has completed and will exit with status 0.
Stderr:
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
emtrkmichelid
nhitsfilter
pandoraWriter
pandoracalipid
pandorapid
trigfilter
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/497fe0b9af7ebfe5ac11fff59041e9416f4d09cb/protodunevd_v4_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16499 nodes/ 2408 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
28-Mar-2025 10:01:22 PDT Initiating request to open input file "prod_muon_p_450MeV_protodunevd_1_167133_104_1743180702_gen_g4_stage1_g4_stage2_detsim.root"
28-Mar-2025 10:01:22 PDT Opened input file "prod_muon_p_450MeV_protodunevd_1_167133_104_1743180702_gen_g4_stage1_g4_stage2_detsim.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1794 traces, 1794 summary
Retagger: tagging trace set: gauss with 1452 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1452 traces tagged "gauss"
FrameSaver: q=179512 n=20310 tag=gauss
wclsFrameSaver: saving 1794 traces tagged "wiener"
FrameSaver: q=195580 n=18129 tag=wiener
28-Mar-2025 10:02:13 PDT Opened output file with pattern "prod_muon_p_450MeV_protodunevd_1_167133_104_1743180702_gen_g4_stage1_g4_stage2_detsim_reco.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1735 traces, 1735 summary
Retagger: tagging trace set: gauss with 1438 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1438 traces tagged "gauss"
FrameSaver: q=179222 n=20658 tag=gauss
wclsFrameSaver: saving 1735 traces tagged "wiener"
FrameSaver: q=192770 n=18569 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1841 traces, 1841 summary
Retagger: tagging trace set: gauss with 1440 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1440 traces tagged "gauss"
FrameSaver: q=178099 n=19892 tag=gauss
wclsFrameSaver: saving 1841 traces tagged "wiener"
FrameSaver: q=194983 n=17747 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1864 traces, 1864 summary
Retagger: tagging trace set: gauss with 1402 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1402 traces tagged "gauss"
FrameSaver: q=172284 n=19521 tag=gauss
wclsFrameSaver: saving 1864 traces tagged "wiener"
FrameSaver: q=191883 n=17273 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1832 traces, 1832 summary
Retagger: tagging trace set: gauss with 1443 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1443 traces tagged "gauss"
FrameSaver: q=176376 n=19927 tag=gauss
wclsFrameSaver: saving 1832 traces tagged "wiener"
FrameSaver: q=193543 n=17527 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1786 traces, 1786 summary
Retagger: tagging trace set: gauss with 1372 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1372 traces tagged "gauss"
FrameSaver: q=177135 n=18897 tag=gauss
wclsFrameSaver: saving 1786 traces tagged "wiener"
FrameSaver: q=195446 n=16651 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1712 traces, 1712 summary
Retagger: tagging trace set: gauss with 1432 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1432 traces tagged "gauss"
FrameSaver: q=170391 n=19469 tag=gauss
wclsFrameSaver: saving 1712 traces tagged "wiener"
FrameSaver: q=185512 n=17483 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1785 traces, 1785 summary
Retagger: tagging trace set: gauss with 1444 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1444 traces tagged "gauss"
FrameSaver: q=169131 n=19047 tag=gauss
wclsFrameSaver: saving 1785 traces tagged "wiener"
FrameSaver: q=185561 n=16887 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1739 traces, 1739 summary
Retagger: tagging trace set: gauss with 1447 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1447 traces tagged "gauss"
FrameSaver: q=177194 n=19556 tag=gauss
wclsFrameSaver: saving 1739 traces tagged "wiener"
FrameSaver: q=192347 n=17699 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1748 traces, 1748 summary
Retagger: tagging trace set: gauss with 1364 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1364 traces tagged "gauss"
FrameSaver: q=170257 n=18702 tag=gauss
wclsFrameSaver: saving 1748 traces tagged "wiener"
FrameSaver: q=186637 n=16520 tag=wiener
28-Mar-2025 10:10:02 PDT Closed output file "prod_muon_p_450MeV_protodunevd_1_167133_104_1743180702_gen_g4_stage1_g4_stage2_detsim_reco.root"
28-Mar-2025 10:10:02 PDT Closed input file "prod_muon_p_450MeV_protodunevd_1_167133_104_1743180702_gen_g4_stage1_g4_stage2_detsim.root"
=================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
=================================================================================================================================
Full event 49.2738 51.6836 53.1129 51.8082 1.05601 10
---------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00041905 0.000562656 0.000758353 0.000543135 9.16345e-05 10
reco:rns:RandomNumberSaver 4.225e-05 6.9702e-05 0.000263113 4.65595e-05 6.47058e-05 10
reco:wclsdatavd:WireCellToolkit 48.2973 50.9968 52.5606 51.2953 1.33362 10
reco:gaushit:GausHitFinder 0.0222144 0.0241013 0.0265386 0.0233732 0.0015825 10
reco:reco3d:SpacePointSolver 0.0743666 0.0873444 0.101346 0.0868371 0.00787016 10
reco:hitpdune:DisambigFromSpacePoints 0.00223401 0.00268676 0.00447347 0.00244546 0.000626795 10
reco:pandora:StandardPandora 0.316264 0.520465 2.07338 0.343431 0.518255 10
reco:pandoraTrack:LArPandoraTrackCreation 0.00214075 0.00320089 0.00601922 0.00308546 0.00103157 10
reco:pandoraShower:LArPandoraShowerCreation 0.000245185 0.000438628 0.0015213 0.00026128 0.000394872 10
reco:pandoraStdcalo:Calorimetry 0.00154243 0.00229002 0.00476918 0.00214959 0.000867773 10
reco:pandoraGnocalo:GnocchiCalorimetry 0.00111618 0.00142784 0.00311494 0.0012577 0.000565312 10
[art]:TriggerResults:TriggerResultInserter 1.9607e-05 2.44198e-05 5.8156e-05 2.02175e-05 1.13099e-05 10
end_path:out1:RootOutput 7.055e-06 8.6182e-06 1.9892e-05 7.3255e-06 3.7704e-06 10
end_path:out1:RootOutput(write) 0.0393342 0.0402869 0.0420706 0.0399899 0.00085047 10
=================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3312.96 MB
Peak resident set size usage (VmHWM): 1558.25 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_muon_p_450MeV_protodunevd_1_167133_104_1743180702_gen_g4_stage1_g4_stage2_detsim_reco.root', 'start_time': 1743181252.3339756, 'end_time': 1743181803.026001}