Jobsub ID 167097.191@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 167097.191@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 5780 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-03-28 15:46:38 | |
| Site | CA_SFU | |
| Entry | DUNE_CA_SFU_lcg-ce3 | |
| Last heartbeat | 2025-03-28 16:40:44 | |
| From worker node | Hostname | cdr928.int.cedar.computecanada.ca |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2683 v4 @ 2.10GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 84598 (23 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-03-28 16:17:52 | |
| Input files | monte-carlo-005780-000277 | |
| Jobscript | Exit code | 0 |
| Real time | 19m (1192s) | |
| CPU time | 19m (1155s = 96%) | |
| Max RSS bytes | 1730228224 (1650 MiB) | |
| Outputting started | 2025-03-28 16:37:45 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/005/prod_muon_m_450MeV_protodunevd_1_167097_191_1743178680_gen.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/005/prod_muon_m_450MeV_protodunevd_1_167097_191_1743178680_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/005/prod_muon_m_450MeV_protodunevd_1_167097_191_1743178680_gen.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/005/prod_muon_m_450MeV_protodunevd_1_167097_191_1743178680_gen_g4_stage1.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/005/prod_muon_m_450MeV_protodunevd_1_167097_191_1743178680_gen_g4_stage1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/005/prod_muon_m_450MeV_protodunevd_1_167097_191_1743178680_gen_g4_stage1.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/005/prod_muon_m_450MeV_protodunevd_1_167097_191_1743178680_gen_g4_stage1_g4_stage2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/005/prod_muon_m_450MeV_protodunevd_1_167097_191_1743178680_gen_g4_stage1_g4_stage2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/005/prod_muon_m_450MeV_protodunevd_1_167097_191_1743178680_gen_g4_stage1_g4_stage2.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/005/prod_muon_m_450MeV_protodunevd_1_167097_191_1743178680_gen_g4_stage1_g4_stage2_detsim.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/005/prod_muon_m_450MeV_protodunevd_1_167097_191_1743178680_gen_g4_stage1_g4_stage2_detsim.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/005/prod_muon_m_450MeV_protodunevd_1_167097_191_1743178680_gen_g4_stage1_g4_stage2_detsim.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/005/prod_muon_m_450MeV_protodunevd_1_167097_191_1743178680_gen_g4_stage1_g4_stage2_detsim_reco.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/005/prod_muon_m_450MeV_protodunevd_1_167097_191_1743178680_gen_g4_stage1_g4_stage2_detsim_reco.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/005/prod_muon_m_450MeV_protodunevd_1_167097_191_1743178680_gen_g4_stage1_g4_stage2_detsim_reco.err | |
| Finished | 2025-03-28 16:40:44 | |
| Saved logs | justin-logs:167097.191-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
Begin: 7.50462e+06
0 7.18271e+06
1 7.18028e+06
Now with regularization...
Begin: 6.03678e+06
0 6.03676e+06
Art has completed and will exit with status 0.
Stderr:
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
emtrkmichelid
nhitsfilter
pandoraWriter
pandoracalipid
pandorapid
trigfilter
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/497fe0b9af7ebfe5ac11fff59041e9416f4d09cb/protodunevd_v4_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16499 nodes/ 2408 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
28-Mar-2025 09:27:47 PDT Initiating request to open input file "prod_muon_m_450MeV_protodunevd_1_167097_191_1743178680_gen_g4_stage1_g4_stage2_detsim.root"
28-Mar-2025 09:27:48 PDT Opened input file "prod_muon_m_450MeV_protodunevd_1_167097_191_1743178680_gen_g4_stage1_g4_stage2_detsim.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1667 traces, 1667 summary
Retagger: tagging trace set: gauss with 1424 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1424 traces tagged "gauss"
FrameSaver: q=162568 n=19154 tag=gauss
wclsFrameSaver: saving 1667 traces tagged "wiener"
FrameSaver: q=176444 n=17474 tag=wiener
28-Mar-2025 09:29:09 PDT Opened output file with pattern "prod_muon_m_450MeV_protodunevd_1_167097_191_1743178680_gen_g4_stage1_g4_stage2_detsim_reco.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1760 traces, 1760 summary
Retagger: tagging trace set: gauss with 1391 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1391 traces tagged "gauss"
FrameSaver: q=163033 n=18846 tag=gauss
wclsFrameSaver: saving 1760 traces tagged "wiener"
FrameSaver: q=180513 n=16593 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1663 traces, 1663 summary
Retagger: tagging trace set: gauss with 1247 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1247 traces tagged "gauss"
FrameSaver: q=171724 n=17917 tag=gauss
wclsFrameSaver: saving 1663 traces tagged "wiener"
FrameSaver: q=188360 n=15751 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1792 traces, 1792 summary
Retagger: tagging trace set: gauss with 1340 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1340 traces tagged "gauss"
FrameSaver: q=164575 n=18567 tag=gauss
wclsFrameSaver: saving 1792 traces tagged "wiener"
FrameSaver: q=182973 n=16326 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1790 traces, 1790 summary
Retagger: tagging trace set: gauss with 1342 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1342 traces tagged "gauss"
FrameSaver: q=159249 n=18141 tag=gauss
wclsFrameSaver: saving 1790 traces tagged "wiener"
FrameSaver: q=177409 n=15805 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1769 traces, 1769 summary
Retagger: tagging trace set: gauss with 1370 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1370 traces tagged "gauss"
FrameSaver: q=166824 n=18582 tag=gauss
wclsFrameSaver: saving 1769 traces tagged "wiener"
FrameSaver: q=185216 n=16319 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1781 traces, 1781 summary
Retagger: tagging trace set: gauss with 1487 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1487 traces tagged "gauss"
FrameSaver: q=166167 n=19550 tag=gauss
wclsFrameSaver: saving 1781 traces tagged "wiener"
FrameSaver: q=183593 n=17501 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1663 traces, 1663 summary
Retagger: tagging trace set: gauss with 1260 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1260 traces tagged "gauss"
FrameSaver: q=161012 n=17697 tag=gauss
wclsFrameSaver: saving 1663 traces tagged "wiener"
FrameSaver: q=177020 n=15374 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1662 traces, 1662 summary
Retagger: tagging trace set: gauss with 1378 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1378 traces tagged "gauss"
FrameSaver: q=158806 n=18082 tag=gauss
wclsFrameSaver: saving 1662 traces tagged "wiener"
FrameSaver: q=174524 n=16040 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1752 traces, 1752 summary
Retagger: tagging trace set: gauss with 1397 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1397 traces tagged "gauss"
FrameSaver: q=161728 n=18723 tag=gauss
wclsFrameSaver: saving 1752 traces tagged "wiener"
FrameSaver: q=178788 n=16575 tag=wiener
28-Mar-2025 09:37:44 PDT Closed output file "prod_muon_m_450MeV_protodunevd_1_167097_191_1743178680_gen_g4_stage1_g4_stage2_detsim_reco.root"
28-Mar-2025 09:37:44 PDT Closed input file "prod_muon_m_450MeV_protodunevd_1_167097_191_1743178680_gen_g4_stage1_g4_stage2_detsim.root"
=================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
=================================================================================================================================
Full event 55.2029 59.2716 80.7517 56.9748 7.2349 10
---------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000461691 0.000535511 0.000750302 0.000507503 7.91881e-05 10
reco:rns:RandomNumberSaver 4.7747e-05 7.45424e-05 0.000292136 5.0437e-05 7.2556e-05 10
reco:wclsdatavd:WireCellToolkit 54.0479 56.1582 58.235 55.9723 1.24917 10
reco:gaushit:GausHitFinder 0.021584 0.0232059 0.0288645 0.0223138 0.00213892 10
reco:reco3d:SpacePointSolver 0.0761487 0.0866623 0.104342 0.085423 0.00815375 10
reco:hitpdune:DisambigFromSpacePoints 0.00229406 0.00281216 0.00454844 0.00270203 0.00060991 10
reco:pandora:StandardPandora 0.28606 2.9499 26.5339 0.332432 7.86137 10
reco:pandoraTrack:LArPandoraTrackCreation 0.00191873 0.00337045 0.00632397 0.00313546 0.0010679 10
reco:pandoraShower:LArPandoraShowerCreation 0.000327893 0.000402636 0.000918863 0.000346168 0.000172466 10
reco:pandoraStdcalo:Calorimetry 0.00190467 0.00243073 0.00482298 0.00219698 0.000817375 10
reco:pandoraGnocalo:GnocchiCalorimetry 0.00121519 0.00148553 0.00338271 0.00126015 0.000634234 10
[art]:TriggerResults:TriggerResultInserter 2.0156e-05 2.64253e-05 6.4244e-05 2.24e-05 1.2647e-05 10
end_path:out1:RootOutput 7.301e-06 9.5888e-06 2.2534e-05 8.249e-06 4.33868e-06 10
end_path:out1:RootOutput(write) 0.0361287 0.0380377 0.0390622 0.0385097 0.000991894 10
=================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3347.08 MB
Peak resident set size usage (VmHWM): 1589.68 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_muon_m_450MeV_protodunevd_1_167097_191_1743178680_gen_g4_stage1_g4_stage2_detsim_reco.root', 'start_time': 1743179228.8451347, 'end_time': 1743179865.095964}