Jobsub ID 167105.79@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 167105.79@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 5781 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-03-28 15:51:17 | |
| Site | CA_SFU | |
| Entry | DUNE_CA_SFU_lcg-ce3 | |
| Last heartbeat | 2025-03-28 17:02:35 | |
| From worker node | Hostname | cdr928.int.cedar.computecanada.ca |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2683 v4 @ 2.10GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 84598 (23 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-03-28 16:42:00 | |
| Input files | monte-carlo-005781-000817 | |
| Jobscript | Exit code | 0 |
| Real time | 19m (1180s) | |
| CPU time | 19m (1170s = 99%) | |
| Max RSS bytes | 1730342912 (1650 MiB) | |
| Outputting started | 2025-03-28 17:01:42 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_79_1743180128_gen.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_79_1743180128_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_79_1743180128_gen.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_79_1743180128_gen_g4_stage1.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_79_1743180128_gen_g4_stage1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_79_1743180128_gen_g4_stage1.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_79_1743180128_gen_g4_stage1_g4_stage2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_79_1743180128_gen_g4_stage1_g4_stage2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_79_1743180128_gen_g4_stage1_g4_stage2.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_79_1743180128_gen_g4_stage1_g4_stage2_detsim.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_79_1743180128_gen_g4_stage1_g4_stage2_detsim.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_79_1743180128_gen_g4_stage1_g4_stage2_detsim.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_79_1743180128_gen_g4_stage1_g4_stage2_detsim_reco.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_79_1743180128_gen_g4_stage1_g4_stage2_detsim_reco.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/013/prod_muon_p_450MeV_protodunevd_1_167105_79_1743180128_gen_g4_stage1_g4_stage2_detsim_reco.err | |
| Finished | 2025-03-28 17:02:35 | |
| Saved logs | justin-logs:167105.79-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
on...
Begin: 1.58584e+07
0 1.53717e+07
1 1.53667e+07
Now with regularization...
Begin: 1.46694e+07
0 1.46688e+07
Art has completed and will exit with status 0.
Stderr:
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
emtrkmichelid
nhitsfilter
pandoraWriter
pandoracalipid
pandorapid
trigfilter
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/497fe0b9af7ebfe5ac11fff59041e9416f4d09cb/protodunevd_v4_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16499 nodes/ 2408 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
28-Mar-2025 09:51:50 PDT Initiating request to open input file "prod_muon_p_450MeV_protodunevd_1_167105_79_1743180128_gen_g4_stage1_g4_stage2_detsim.root"
28-Mar-2025 09:51:50 PDT Opened input file "prod_muon_p_450MeV_protodunevd_1_167105_79_1743180128_gen_g4_stage1_g4_stage2_detsim.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1769 traces, 1769 summary
Retagger: tagging trace set: gauss with 1326 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1326 traces tagged "gauss"
FrameSaver: q=170311 n=18555 tag=gauss
wclsFrameSaver: saving 1769 traces tagged "wiener"
FrameSaver: q=188932 n=16230 tag=wiener
28-Mar-2025 09:52:47 PDT Opened output file with pattern "prod_muon_p_450MeV_protodunevd_1_167105_79_1743180128_gen_g4_stage1_g4_stage2_detsim_reco.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1768 traces, 1768 summary
Retagger: tagging trace set: gauss with 1258 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1258 traces tagged "gauss"
FrameSaver: q=166725 n=17892 tag=gauss
wclsFrameSaver: saving 1768 traces tagged "wiener"
FrameSaver: q=185295 n=15436 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1849 traces, 1849 summary
Retagger: tagging trace set: gauss with 1446 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1446 traces tagged "gauss"
FrameSaver: q=174782 n=20365 tag=gauss
wclsFrameSaver: saving 1849 traces tagged "wiener"
FrameSaver: q=191280 n=17858 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1785 traces, 1785 summary
Retagger: tagging trace set: gauss with 1526 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1526 traces tagged "gauss"
FrameSaver: q=179113 n=20830 tag=gauss
wclsFrameSaver: saving 1785 traces tagged "wiener"
FrameSaver: q=193433 n=19003 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1862 traces, 1862 summary
Retagger: tagging trace set: gauss with 1537 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1537 traces tagged "gauss"
FrameSaver: q=175390 n=20272 tag=gauss
wclsFrameSaver: saving 1862 traces tagged "wiener"
FrameSaver: q=192628 n=18076 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1741 traces, 1741 summary
Retagger: tagging trace set: gauss with 1427 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1427 traces tagged "gauss"
FrameSaver: q=166337 n=18836 tag=gauss
wclsFrameSaver: saving 1741 traces tagged "wiener"
FrameSaver: q=183167 n=16805 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1675 traces, 1675 summary
Retagger: tagging trace set: gauss with 1263 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1263 traces tagged "gauss"
FrameSaver: q=165832 n=17467 tag=gauss
wclsFrameSaver: saving 1675 traces tagged "wiener"
FrameSaver: q=183288 n=15238 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1771 traces, 1771 summary
Retagger: tagging trace set: gauss with 1397 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1397 traces tagged "gauss"
FrameSaver: q=173187 n=18579 tag=gauss
wclsFrameSaver: saving 1771 traces tagged "wiener"
FrameSaver: q=191616 n=16476 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1738 traces, 1738 summary
Retagger: tagging trace set: gauss with 1433 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1433 traces tagged "gauss"
FrameSaver: q=172450 n=19265 tag=gauss
wclsFrameSaver: saving 1738 traces tagged "wiener"
FrameSaver: q=187776 n=17159 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1760 traces, 1760 summary
Retagger: tagging trace set: gauss with 1396 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1396 traces tagged "gauss"
FrameSaver: q=170446 n=19007 tag=gauss
wclsFrameSaver: saving 1760 traces tagged "wiener"
FrameSaver: q=187229 n=16832 tag=wiener
28-Mar-2025 10:01:41 PDT Closed output file "prod_muon_p_450MeV_protodunevd_1_167105_79_1743180128_gen_g4_stage1_g4_stage2_detsim_reco.root"
28-Mar-2025 10:01:41 PDT Closed input file "prod_muon_p_450MeV_protodunevd_1_167105_79_1743180128_gen_g4_stage1_g4_stage2_detsim.root"
=================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
=================================================================================================================================
Full event 56.468 58.7643 62.3297 58.5233 1.48316 10
---------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000414105 0.000539068 0.000728494 0.000526772 7.79709e-05 10
reco:rns:RandomNumberSaver 4.2932e-05 7.36208e-05 0.00030571 4.7272e-05 7.74292e-05 10
reco:wclsdatavd:WireCellToolkit 54.3566 58.0958 61.7787 58.0191 1.76448 10
reco:gaushit:GausHitFinder 0.0215148 0.0233326 0.026005 0.0230407 0.00141374 10
reco:reco3d:SpacePointSolver 0.0816806 0.0885024 0.107396 0.0853227 0.00753631 10
reco:hitpdune:DisambigFromSpacePoints 0.00241646 0.00290896 0.00500999 0.00267562 0.000720332 10
reco:pandora:StandardPandora 0.309998 0.502962 1.93596 0.345982 0.478099 10
reco:pandoraTrack:LArPandoraTrackCreation 0.00176231 0.00312018 0.00608412 0.00308555 0.00121334 10
reco:pandoraShower:LArPandoraShowerCreation 0.000274179 0.000502138 0.00176233 0.00029224 0.000450858 10
reco:pandoraStdcalo:Calorimetry 0.0019991 0.00244849 0.00511827 0.00213873 0.000900566 10
reco:pandoraGnocalo:GnocchiCalorimetry 0.00116012 0.00149487 0.00312903 0.00134262 0.000549163 10
[art]:TriggerResults:TriggerResultInserter 2.1442e-05 2.62276e-05 5.8507e-05 2.2621e-05 1.08006e-05 10
end_path:out1:RootOutput 7.116e-06 9.2367e-06 2.2076e-05 7.872e-06 4.30024e-06 10
end_path:out1:RootOutput(write) 0.0371911 0.0388522 0.0399302 0.0387415 0.000862234 10
=================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3331.22 MB
Peak resident set size usage (VmHWM): 1584.41 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_muon_p_450MeV_protodunevd_1_167105_79_1743180128_gen_g4_stage1_g4_stage2_detsim_reco.root', 'start_time': 1743180672.0621097, 'end_time': 1743181301.8935392}