Jobsub ID 167098.14@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 167098.14@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 5781 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-03-28 15:46:42 | |
| Site | CA_SFU | |
| Entry | DUNE_CA_SFU_lcg-ce3 | |
| Last heartbeat | 2025-03-28 16:45:13 | |
| From worker node | Hostname | cdr929.int.cedar.computecanada.ca |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2683 v4 @ 2.10GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 84598 (23 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-03-28 16:18:25 | |
| Input files | monte-carlo-005781-000211 | |
| Jobscript | Exit code | 0 |
| Real time | 23m (1432s) | |
| CPU time | 19m (1175s = 82%) | |
| Max RSS bytes | 1729515520 (1649 MiB) | |
| Outputting started | 2025-03-28 16:42:18 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_14_1743178787_gen.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_14_1743178787_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_14_1743178787_gen.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_14_1743178787_gen_g4_stage1.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_14_1743178787_gen_g4_stage1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_14_1743178787_gen_g4_stage1.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_14_1743178787_gen_g4_stage1_g4_stage2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_14_1743178787_gen_g4_stage1_g4_stage2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_14_1743178787_gen_g4_stage1_g4_stage2.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_14_1743178787_gen_g4_stage1_g4_stage2_detsim.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_14_1743178787_gen_g4_stage1_g4_stage2_detsim.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_14_1743178787_gen_g4_stage1_g4_stage2_detsim.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_14_1743178787_gen_g4_stage1_g4_stage2_detsim_reco.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_14_1743178787_gen_g4_stage1_g4_stage2_detsim_reco.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_14_1743178787_gen_g4_stage1_g4_stage2_detsim_reco.err | |
| Finished | 2025-03-28 16:45:13 | |
| Saved logs | justin-logs:167098.14-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
ion...
Begin: 8.23444e+06
0 7.70572e+06
1 7.70372e+06
Now with regularization...
Begin: 6.57981e+06
0 6.57972e+06
Art has completed and will exit with status 0.
Stderr:
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
emtrkmichelid
nhitsfilter
pandoraWriter
pandoracalipid
pandorapid
trigfilter
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/497fe0b9af7ebfe5ac11fff59041e9416f4d09cb/protodunevd_v4_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16499 nodes/ 2408 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
28-Mar-2025 09:31:53 PDT Initiating request to open input file "prod_muon_p_450MeV_protodunevd_1_167098_14_1743178787_gen_g4_stage1_g4_stage2_detsim.root"
28-Mar-2025 09:31:54 PDT Opened input file "prod_muon_p_450MeV_protodunevd_1_167098_14_1743178787_gen_g4_stage1_g4_stage2_detsim.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1881 traces, 1881 summary
Retagger: tagging trace set: gauss with 1411 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1411 traces tagged "gauss"
FrameSaver: q=177189 n=19479 tag=gauss
wclsFrameSaver: saving 1881 traces tagged "wiener"
FrameSaver: q=196541 n=17015 tag=wiener
28-Mar-2025 09:33:21 PDT Opened output file with pattern "prod_muon_p_450MeV_protodunevd_1_167098_14_1743178787_gen_g4_stage1_g4_stage2_detsim_reco.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1767 traces, 1767 summary
Retagger: tagging trace set: gauss with 1463 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1463 traces tagged "gauss"
FrameSaver: q=171465 n=19383 tag=gauss
wclsFrameSaver: saving 1767 traces tagged "wiener"
FrameSaver: q=187551 n=17401 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1670 traces, 1670 summary
Retagger: tagging trace set: gauss with 1341 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1341 traces tagged "gauss"
FrameSaver: q=167997 n=18190 tag=gauss
wclsFrameSaver: saving 1670 traces tagged "wiener"
FrameSaver: q=184020 n=16230 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1801 traces, 1801 summary
Retagger: tagging trace set: gauss with 1416 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1416 traces tagged "gauss"
FrameSaver: q=169113 n=19289 tag=gauss
wclsFrameSaver: saving 1801 traces tagged "wiener"
FrameSaver: q=187123 n=16981 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1930 traces, 1930 summary
Retagger: tagging trace set: gauss with 1447 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1447 traces tagged "gauss"
FrameSaver: q=176406 n=20094 tag=gauss
wclsFrameSaver: saving 1930 traces tagged "wiener"
FrameSaver: q=196074 n=17603 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1812 traces, 1812 summary
Retagger: tagging trace set: gauss with 1440 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1440 traces tagged "gauss"
FrameSaver: q=174312 n=19818 tag=gauss
wclsFrameSaver: saving 1812 traces tagged "wiener"
FrameSaver: q=190515 n=17541 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1725 traces, 1725 summary
Retagger: tagging trace set: gauss with 1366 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1366 traces tagged "gauss"
FrameSaver: q=172696 n=18489 tag=gauss
wclsFrameSaver: saving 1725 traces tagged "wiener"
FrameSaver: q=189418 n=16304 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1831 traces, 1831 summary
Retagger: tagging trace set: gauss with 1456 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1456 traces tagged "gauss"
FrameSaver: q=165555 n=19189 tag=gauss
wclsFrameSaver: saving 1831 traces tagged "wiener"
FrameSaver: q=183302 n=16952 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1775 traces, 1775 summary
Retagger: tagging trace set: gauss with 1432 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1432 traces tagged "gauss"
FrameSaver: q=175193 n=19395 tag=gauss
wclsFrameSaver: saving 1775 traces tagged "wiener"
FrameSaver: q=192002 n=17167 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1857 traces, 1857 summary
Retagger: tagging trace set: gauss with 1434 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1434 traces tagged "gauss"
FrameSaver: q=174988 n=19308 tag=gauss
wclsFrameSaver: saving 1857 traces tagged "wiener"
FrameSaver: q=193376 n=16803 tag=wiener
28-Mar-2025 09:42:17 PDT Closed output file "prod_muon_p_450MeV_protodunevd_1_167098_14_1743178787_gen_g4_stage1_g4_stage2_detsim_reco.root"
28-Mar-2025 09:42:17 PDT Closed input file "prod_muon_p_450MeV_protodunevd_1_167098_14_1743178787_gen_g4_stage1_g4_stage2_detsim.root"
=================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
=================================================================================================================================
Full event 58.2017 61.9288 86.0734 59.3985 8.06271 10
---------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000406372 0.000524293 0.000645868 0.000515713 7.10908e-05 10
reco:rns:RandomNumberSaver 3.7938e-05 6.00165e-05 0.000230359 3.9779e-05 5.68779e-05 10
reco:wclsdatavd:WireCellToolkit 52.8763 58.14 59.4413 58.7391 1.81773 10
reco:gaushit:GausHitFinder 0.0221468 0.0234613 0.0261584 0.0230054 0.00124046 10
reco:reco3d:SpacePointSolver 0.0758446 0.0897404 0.103018 0.0894827 0.00946762 10
reco:hitpdune:DisambigFromSpacePoints 0.00240088 0.00294273 0.004965 0.00271959 0.000693321 10
reco:pandora:StandardPandora 0.315394 3.62091 33.0089 0.360079 9.79601 10
reco:pandoraTrack:LArPandoraTrackCreation 0.00169002 0.00329358 0.0050672 0.00329236 0.00083527 10
reco:pandoraShower:LArPandoraShowerCreation 0.000274671 0.000341821 0.000768732 0.000297805 0.000142734 10
reco:pandoraStdcalo:Calorimetry 0.00188184 0.00257596 0.004688 0.00225538 0.000797504 10
reco:pandoraGnocalo:GnocchiCalorimetry 0.00117976 0.00151335 0.00307189 0.00133319 0.0005259 10
[art]:TriggerResults:TriggerResultInserter 2.3166e-05 2.75555e-05 5.109e-05 2.4781e-05 7.91927e-06 10
end_path:out1:RootOutput 6.354e-06 8.6156e-06 1.8785e-05 7.696e-06 3.42801e-06 10
end_path:out1:RootOutput(write) 0.0375502 0.0392347 0.0410444 0.0391987 0.000981672 10
=================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3305.81 MB
Peak resident set size usage (VmHWM): 1548.16 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_muon_p_450MeV_protodunevd_1_167098_14_1743178787_gen_g4_stage1_g4_stage2_detsim_reco.root', 'start_time': 1743179469.622808, 'end_time': 1743180138.3099244}