Jobsub ID 167106.117@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 167106.117@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 5780 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-03-28 15:52:21 | |
| Site | CA_SFU | |
| Entry | DUNE_CA_SFU_lcg-ce3 | |
| Last heartbeat | 2025-03-28 17:06:22 | |
| From worker node | Hostname | cdr1215.int.cedar.computecanada.ca |
| cpuinfo | Intel(R) Xeon(R) Platinum 8160 CPU @ 2.10GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 84598 (23 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-03-28 16:47:11 | |
| Input files | monte-carlo-005780-000846 | |
| Jobscript | Exit code | 0 |
| Real time | 18m (1086s) | |
| CPU time | 17m (1072s = 98%) | |
| Max RSS bytes | 1731981312 (1651 MiB) | |
| Outputting started | 2025-03-28 17:05:19 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_117_1743180440_gen.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_117_1743180440_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_117_1743180440_gen.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_117_1743180440_gen_g4_stage1.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_117_1743180440_gen_g4_stage1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_117_1743180440_gen_g4_stage1.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_117_1743180440_gen_g4_stage1_g4_stage2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_117_1743180440_gen_g4_stage1_g4_stage2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_117_1743180440_gen_g4_stage1_g4_stage2.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_117_1743180440_gen_g4_stage1_g4_stage2_detsim.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_117_1743180440_gen_g4_stage1_g4_stage2_detsim.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_117_1743180440_gen_g4_stage1_g4_stage2_detsim.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_117_1743180440_gen_g4_stage1_g4_stage2_detsim_reco.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_117_1743180440_gen_g4_stage1_g4_stage2_detsim_reco.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/014/prod_muon_m_450MeV_protodunevd_1_167106_117_1743180440_gen_g4_stage1_g4_stage2_detsim_reco.err | |
| Finished | 2025-03-28 17:06:22 | |
| Saved logs | justin-logs:167106.117-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
3e+06
2 7.01131e+06
3 7.0001e+06
4 6.99436e+06
Now with regularization...
Begin: 5.79871e+06
0 5.79361e+06
Art has completed and will exit with status 0.
Stderr:
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
emtrkmichelid
nhitsfilter
pandoraWriter
pandoracalipid
pandorapid
trigfilter
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/497fe0b9af7ebfe5ac11fff59041e9416f4d09cb/protodunevd_v4_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16499 nodes/ 2408 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
28-Mar-2025 09:56:52 PDT Initiating request to open input file "prod_muon_m_450MeV_protodunevd_1_167106_117_1743180440_gen_g4_stage1_g4_stage2_detsim.root"
28-Mar-2025 09:56:52 PDT Opened input file "prod_muon_m_450MeV_protodunevd_1_167106_117_1743180440_gen_g4_stage1_g4_stage2_detsim.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1618 traces, 1618 summary
Retagger: tagging trace set: gauss with 1385 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1385 traces tagged "gauss"
FrameSaver: q=161116 n=18670 tag=gauss
wclsFrameSaver: saving 1618 traces tagged "wiener"
FrameSaver: q=174588 n=16708 tag=wiener
28-Mar-2025 09:57:45 PDT Opened output file with pattern "prod_muon_m_450MeV_protodunevd_1_167106_117_1743180440_gen_g4_stage1_g4_stage2_detsim_reco.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1646 traces, 1646 summary
Retagger: tagging trace set: gauss with 1297 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1297 traces tagged "gauss"
FrameSaver: q=159305 n=17834 tag=gauss
wclsFrameSaver: saving 1646 traces tagged "wiener"
FrameSaver: q=174419 n=15653 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1731 traces, 1731 summary
Retagger: tagging trace set: gauss with 1273 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1273 traces tagged "gauss"
FrameSaver: q=156197 n=17454 tag=gauss
wclsFrameSaver: saving 1731 traces tagged "wiener"
FrameSaver: q=174136 n=15150 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1873 traces, 1873 summary
Retagger: tagging trace set: gauss with 1457 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1457 traces tagged "gauss"
FrameSaver: q=165022 n=19511 tag=gauss
wclsFrameSaver: saving 1873 traces tagged "wiener"
FrameSaver: q=184203 n=17170 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1793 traces, 1793 summary
Retagger: tagging trace set: gauss with 1436 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1436 traces tagged "gauss"
FrameSaver: q=164177 n=19199 tag=gauss
wclsFrameSaver: saving 1793 traces tagged "wiener"
FrameSaver: q=181604 n=17130 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1745 traces, 1745 summary
Retagger: tagging trace set: gauss with 1402 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1402 traces tagged "gauss"
FrameSaver: q=157493 n=18248 tag=gauss
wclsFrameSaver: saving 1745 traces tagged "wiener"
FrameSaver: q=175624 n=16179 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1665 traces, 1665 summary
Retagger: tagging trace set: gauss with 1372 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1372 traces tagged "gauss"
FrameSaver: q=159840 n=18350 tag=gauss
wclsFrameSaver: saving 1665 traces tagged "wiener"
FrameSaver: q=174644 n=16301 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1744 traces, 1744 summary
Retagger: tagging trace set: gauss with 1410 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1410 traces tagged "gauss"
FrameSaver: q=178215 n=19531 tag=gauss
wclsFrameSaver: saving 1744 traces tagged "wiener"
FrameSaver: q=193525 n=17410 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1731 traces, 1731 summary
Retagger: tagging trace set: gauss with 1324 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1324 traces tagged "gauss"
FrameSaver: q=159928 n=18246 tag=gauss
wclsFrameSaver: saving 1731 traces tagged "wiener"
FrameSaver: q=177275 n=16064 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1720 traces, 1720 summary
Retagger: tagging trace set: gauss with 1261 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1261 traces tagged "gauss"
FrameSaver: q=156069 n=17126 tag=gauss
wclsFrameSaver: saving 1720 traces tagged "wiener"
FrameSaver: q=174802 n=14880 tag=wiener
28-Mar-2025 10:05:17 PDT Closed output file "prod_muon_m_450MeV_protodunevd_1_167106_117_1743180440_gen_g4_stage1_g4_stage2_detsim_reco.root"
28-Mar-2025 10:05:17 PDT Closed input file "prod_muon_m_450MeV_protodunevd_1_167106_117_1743180440_gen_g4_stage1_g4_stage2_detsim.root"
=================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
=================================================================================================================================
Full event 49.7083 50.1496 52.3637 49.8546 0.759734 10
---------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000599305 0.000772775 0.00107122 0.000746759 0.000121912 10
reco:rns:RandomNumberSaver 5.0542e-05 8.18052e-05 0.000319341 5.63845e-05 7.92449e-05 10
reco:wclsdatavd:WireCellToolkit 49.2083 49.4875 50.1269 49.3799 0.272768 10
reco:gaushit:GausHitFinder 0.0207131 0.023134 0.0268774 0.0224376 0.00194461 10
reco:reco3d:SpacePointSolver 0.0747711 0.0878508 0.0941968 0.0890004 0.00597239 10
reco:hitpdune:DisambigFromSpacePoints 0.00211132 0.00268736 0.00438153 0.00257511 0.000596895 10
reco:pandora:StandardPandora 0.287234 0.496995 2.06009 0.330264 0.521465 10
reco:pandoraTrack:LArPandoraTrackCreation 0.00169785 0.00280435 0.00627995 0.00212667 0.00131919 10
reco:pandoraShower:LArPandoraShowerCreation 0.000242671 0.000488457 0.00186403 0.000273289 0.000493563 10
reco:pandoraStdcalo:Calorimetry 0.00171609 0.00222695 0.00455338 0.00197797 0.000793249 10
reco:pandoraGnocalo:GnocchiCalorimetry 0.00110447 0.00144015 0.00329957 0.00124518 0.000621826 10
[art]:TriggerResults:TriggerResultInserter 1.5638e-05 2.13177e-05 6.4317e-05 1.6589e-05 1.43409e-05 10
end_path:out1:RootOutput 6.182e-06 1.27067e-05 3.5263e-05 1.06245e-05 7.64772e-06 10
end_path:out1:RootOutput(write) 0.038657 0.039923 0.0412222 0.039832 0.000934266 10
=================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3280.28 MB
Peak resident set size usage (VmHWM): 1531.82 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_muon_m_450MeV_protodunevd_1_167106_117_1743180440_gen_g4_stage1_g4_stage2_detsim_reco.root', 'start_time': 1743180980.3756285, 'end_time': 1743181517.8725479}