Jobsub ID 166697.5@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 166697.5@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 5746 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-03-27 13:27:15 | |
| Site | UK_Edinburgh | |
| Entry | DUNE_UK_SGridECDF_ce1_multicore | |
| Last heartbeat | 2025-03-27 13:40:36 | |
| From worker node | Hostname | node2b07.ecdf.ed.ac.uk |
| cpuinfo | Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-03-27 13:28:03 | |
| Input files | monte-carlo-005746-000973 | |
| Jobscript | Exit code | 0 |
| Real time | 10m (656s) | |
| CPU time | 10m (645s = 98%) | |
| Max RSS bytes | 1728978944 (1648 MiB) | |
| Outputting started | 2025-03-27 13:39:00 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_5_1743082088_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_5_1743082088_gen.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_5_1743082088_gen_g4_stage1_g4_stage2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_5_1743082088_gen_g4_stage1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_5_1743082088_gen_g4_stage1_g4_stage2_detsim.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_5_1743082088_gen_g4_stage1.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_5_1743082088_gen_g4_stage1_g4_stage2_detsim.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_5_1743082088_gen_g4_stage1.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_5_1743082088_gen_g4_stage1_g4_stage2_detsim.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_5_1743082088_gen_g4_stage1_g4_stage2_detsim_reco.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_5_1743082088_gen_g4_stage1_g4_stage2.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_5_1743082088_gen_g4_stage1_g4_stage2_detsim_reco.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_5_1743082088_gen.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_5_1743082088_gen_g4_stage1_g4_stage2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_5_1743082088_gen_g4_stage1_g4_stage2_detsim_reco.err | |
| Finished | 2025-03-27 13:40:36 | |
| Saved logs | justin-logs:166697.5-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
in: 1.6859e+07
0 1.55257e+07
1 1.54802e+07
2 1.54553e+07
3 1.54409e+07
Now with regularization...
Begin: 1.45655e+07
0 1.45554e+07
Art has completed and will exit with status 0.
Stderr:
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
emtrkmichelid
nhitsfilter
pandoraWriter
pandoracalipid
pandorapid
trigfilter
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/8e14053062785f80c03da35c9e53597243e9b1b5/protodunevd_v4_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16499 nodes/ 2408 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
27-Mar-2025 13:33:39 GMT Initiating request to open input file "prod_muon_400MeV_protodunevd_1_166697_5_1743082088_gen_g4_stage1_g4_stage2_detsim.root"
27-Mar-2025 13:33:39 GMT Opened input file "prod_muon_400MeV_protodunevd_1_166697_5_1743082088_gen_g4_stage1_g4_stage2_detsim.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1592 traces, 1592 summary
Retagger: tagging trace set: gauss with 1194 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1194 traces tagged "gauss"
FrameSaver: q=144760 n=16730 tag=gauss
wclsFrameSaver: saving 1592 traces tagged "wiener"
FrameSaver: q=163639 n=14615 tag=wiener
27-Mar-2025 13:34:12 GMT Opened output file with pattern "prod_muon_400MeV_protodunevd_1_166697_5_1743082088_gen_g4_stage1_g4_stage2_detsim_reco.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1585 traces, 1585 summary
Retagger: tagging trace set: gauss with 1136 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1136 traces tagged "gauss"
FrameSaver: q=139074 n=16089 tag=gauss
wclsFrameSaver: saving 1585 traces tagged "wiener"
FrameSaver: q=157219 n=13983 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1616 traces, 1616 summary
Retagger: tagging trace set: gauss with 1150 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1150 traces tagged "gauss"
FrameSaver: q=135687 n=15899 tag=gauss
wclsFrameSaver: saving 1616 traces tagged "wiener"
FrameSaver: q=154734 n=13777 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1679 traces, 1679 summary
Retagger: tagging trace set: gauss with 1272 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1272 traces tagged "gauss"
FrameSaver: q=149782 n=17372 tag=gauss
wclsFrameSaver: saving 1679 traces tagged "wiener"
FrameSaver: q=167451 n=15313 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1649 traces, 1649 summary
Retagger: tagging trace set: gauss with 1246 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1246 traces tagged "gauss"
FrameSaver: q=139249 n=16825 tag=gauss
wclsFrameSaver: saving 1649 traces tagged "wiener"
FrameSaver: q=156980 n=14786 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1651 traces, 1651 summary
Retagger: tagging trace set: gauss with 1236 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1236 traces tagged "gauss"
FrameSaver: q=138676 n=16577 tag=gauss
wclsFrameSaver: saving 1651 traces tagged "wiener"
FrameSaver: q=157067 n=14607 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1576 traces, 1576 summary
Retagger: tagging trace set: gauss with 1112 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1112 traces tagged "gauss"
FrameSaver: q=135593 n=15537 tag=gauss
wclsFrameSaver: saving 1576 traces tagged "wiener"
FrameSaver: q=153844 n=13485 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1594 traces, 1594 summary
Retagger: tagging trace set: gauss with 1134 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1134 traces tagged "gauss"
FrameSaver: q=137761 n=15806 tag=gauss
wclsFrameSaver: saving 1594 traces tagged "wiener"
FrameSaver: q=156889 n=13688 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1670 traces, 1670 summary
Retagger: tagging trace set: gauss with 1169 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1169 traces tagged "gauss"
FrameSaver: q=139423 n=16641 tag=gauss
wclsFrameSaver: saving 1670 traces tagged "wiener"
FrameSaver: q=159323 n=14264 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1628 traces, 1628 summary
Retagger: tagging trace set: gauss with 1204 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1204 traces tagged "gauss"
FrameSaver: q=147459 n=16825 tag=gauss
wclsFrameSaver: saving 1628 traces tagged "wiener"
FrameSaver: q=165544 n=14747 tag=wiener
27-Mar-2025 13:38:59 GMT Closed output file "prod_muon_400MeV_protodunevd_1_166697_5_1743082088_gen_g4_stage1_g4_stage2_detsim_reco.root"
27-Mar-2025 13:38:59 GMT Closed input file "prod_muon_400MeV_protodunevd_1_166697_5_1743082088_gen_g4_stage1_g4_stage2_detsim.root"
=================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
=================================================================================================================================
Full event 31.2678 31.751 32.9101 31.4961 0.548461 10
---------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000265889 0.000542612 0.000848311 0.000469965 0.000213575 10
reco:rns:RandomNumberSaver 2.8143e-05 4.85088e-05 0.000180284 3.4192e-05 4.40246e-05 10
reco:wclsdatavd:WireCellToolkit 31.0196 31.4104 32.6788 31.2458 0.446694 10
reco:gaushit:GausHitFinder 0.0112931 0.0127635 0.0148515 0.0127143 0.000911368 10
reco:reco3d:SpacePointSolver 0.0442931 0.0518653 0.0710605 0.0489736 0.00853309 10
reco:hitpdune:DisambigFromSpacePoints 0.00129915 0.00158578 0.00240511 0.00137535 0.000383635 10
reco:pandora:StandardPandora 0.130083 0.243103 1.14964 0.142765 0.302251 10
reco:pandoraTrack:LArPandoraTrackCreation 0.000969598 0.00176802 0.00289525 0.00175671 0.000485131 10
reco:pandoraShower:LArPandoraShowerCreation 0.000142661 0.000256438 0.000903629 0.000154161 0.000231449 10
reco:pandoraStdcalo:Calorimetry 0.000912682 0.00110648 0.0022994 0.000967087 0.000401861 10
reco:pandoraGnocalo:GnocchiCalorimetry 0.000555845 0.000747552 0.00160166 0.000660505 0.000287561 10
[art]:TriggerResults:TriggerResultInserter 1.0998e-05 1.37394e-05 3.3415e-05 1.13195e-05 6.59096e-06 10
end_path:out1:RootOutput 2.723e-06 5.094e-06 1.2809e-05 4.7855e-06 2.75876e-06 10
end_path:out1:RootOutput(write) 0.0212414 0.0240383 0.0348026 0.0225312 0.00394232 10
=================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3288.74 MB
Peak resident set size usage (VmHWM): 1532.66 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_muon_400MeV_protodunevd_1_166697_5_1743082088_gen_g4_stage1_g4_stage2_detsim_reco.root', 'start_time': 1743082399.7677493, 'end_time': 1743082740.0861356}