Jobsub ID 167098.0@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 167098.0@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 5781 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-03-28 15:46:42 | |
| Site | CA_SFU | |
| Entry | DUNE_CA_SFU_lcg-ce3 | |
| Last heartbeat | 2025-03-28 16:44:28 | |
| From worker node | Hostname | cdr1215.int.cedar.computecanada.ca |
| cpuinfo | Intel(R) Xeon(R) Platinum 8160 CPU @ 2.10GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 84598 (23 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-03-28 16:21:14 | |
| Input files | monte-carlo-005781-000242 | |
| Jobscript | Exit code | 0 |
| Real time | 20m (1248s) | |
| CPU time | 18m (1081s = 86%) | |
| Max RSS bytes | 1731452928 (1651 MiB) | |
| Outputting started | 2025-03-28 16:42:03 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_0_1743178899_gen.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_0_1743178899_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_0_1743178899_gen.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_0_1743178899_gen_g4_stage1.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_0_1743178899_gen_g4_stage1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_0_1743178899_gen_g4_stage1.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_0_1743178899_gen_g4_stage1_g4_stage2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_0_1743178899_gen_g4_stage1_g4_stage2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_0_1743178899_gen_g4_stage1_g4_stage2.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_0_1743178899_gen_g4_stage1_g4_stage2_detsim.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_0_1743178899_gen_g4_stage1_g4_stage2_detsim.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_0_1743178899_gen_g4_stage1_g4_stage2_detsim.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_0_1743178899_gen_g4_stage1_g4_stage2_detsim_reco.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_0_1743178899_gen_g4_stage1_g4_stage2_detsim_reco.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05781/1/005/prod_muon_p_450MeV_protodunevd_1_167098_0_1743178899_gen_g4_stage1_g4_stage2_detsim_reco.err | |
| Finished | 2025-03-28 16:44:28 | |
| Saved logs | justin-logs:167098.0-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
07
2 1.10777e+07
3 1.10613e+07
4 1.10523e+07
Now with regularization...
Begin: 1.00308e+07
0 1.00147e+07
1 1.00078e+07
Art has completed and will exit with status 0.
Stderr:
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
emtrkmichelid
nhitsfilter
pandoraWriter
pandoracalipid
pandorapid
trigfilter
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/497fe0b9af7ebfe5ac11fff59041e9416f4d09cb/protodunevd_v4_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16499 nodes/ 2408 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
28-Mar-2025 09:33:34 PDT Initiating request to open input file "prod_muon_p_450MeV_protodunevd_1_167098_0_1743178899_gen_g4_stage1_g4_stage2_detsim.root"
28-Mar-2025 09:33:35 PDT Opened input file "prod_muon_p_450MeV_protodunevd_1_167098_0_1743178899_gen_g4_stage1_g4_stage2_detsim.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1773 traces, 1773 summary
Retagger: tagging trace set: gauss with 1396 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1396 traces tagged "gauss"
FrameSaver: q=176719 n=19164 tag=gauss
wclsFrameSaver: saving 1773 traces tagged "wiener"
FrameSaver: q=193304 n=16838 tag=wiener
28-Mar-2025 09:34:31 PDT Opened output file with pattern "prod_muon_p_450MeV_protodunevd_1_167098_0_1743178899_gen_g4_stage1_g4_stage2_detsim_reco.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1714 traces, 1714 summary
Retagger: tagging trace set: gauss with 1387 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1387 traces tagged "gauss"
FrameSaver: q=175584 n=19536 tag=gauss
wclsFrameSaver: saving 1714 traces tagged "wiener"
FrameSaver: q=190793 n=17550 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1760 traces, 1760 summary
Retagger: tagging trace set: gauss with 1411 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1411 traces tagged "gauss"
FrameSaver: q=172812 n=19117 tag=gauss
wclsFrameSaver: saving 1760 traces tagged "wiener"
FrameSaver: q=188765 n=16972 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1741 traces, 1741 summary
Retagger: tagging trace set: gauss with 1370 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1370 traces tagged "gauss"
FrameSaver: q=176791 n=18394 tag=gauss
wclsFrameSaver: saving 1741 traces tagged "wiener"
FrameSaver: q=193778 n=16159 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1786 traces, 1786 summary
Retagger: tagging trace set: gauss with 1470 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1470 traces tagged "gauss"
FrameSaver: q=178958 n=19899 tag=gauss
wclsFrameSaver: saving 1786 traces tagged "wiener"
FrameSaver: q=194679 n=17630 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1919 traces, 1919 summary
Retagger: tagging trace set: gauss with 1416 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1416 traces tagged "gauss"
FrameSaver: q=169181 n=19243 tag=gauss
wclsFrameSaver: saving 1919 traces tagged "wiener"
FrameSaver: q=189591 n=16904 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1751 traces, 1751 summary
Retagger: tagging trace set: gauss with 1417 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1417 traces tagged "gauss"
FrameSaver: q=172923 n=19184 tag=gauss
wclsFrameSaver: saving 1751 traces tagged "wiener"
FrameSaver: q=189578 n=17001 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1845 traces, 1845 summary
Retagger: tagging trace set: gauss with 1370 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1370 traces tagged "gauss"
FrameSaver: q=173541 n=19190 tag=gauss
wclsFrameSaver: saving 1845 traces tagged "wiener"
FrameSaver: q=193298 n=16701 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1811 traces, 1811 summary
Retagger: tagging trace set: gauss with 1520 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1520 traces tagged "gauss"
FrameSaver: q=173608 n=19973 tag=gauss
wclsFrameSaver: saving 1811 traces tagged "wiener"
FrameSaver: q=189851 n=17934 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1770 traces, 1770 summary
Retagger: tagging trace set: gauss with 1335 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1335 traces tagged "gauss"
FrameSaver: q=168423 n=18494 tag=gauss
wclsFrameSaver: saving 1770 traces tagged "wiener"
FrameSaver: q=187013 n=16145 tag=wiener
28-Mar-2025 09:42:02 PDT Closed output file "prod_muon_p_450MeV_protodunevd_1_167098_0_1743178899_gen_g4_stage1_g4_stage2_detsim_reco.root"
28-Mar-2025 09:42:02 PDT Closed input file "prod_muon_p_450MeV_protodunevd_1_167098_0_1743178899_gen_g4_stage1_g4_stage2_detsim.root"
=================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
=================================================================================================================================
Full event 49.4198 50.311 54.9326 49.8597 1.5638 10
---------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000426304 0.000680166 0.000878034 0.000750167 0.000142277 10
reco:rns:RandomNumberSaver 4.4111e-05 6.50344e-05 0.000212561 4.8878e-05 4.93004e-05 10
reco:wclsdatavd:WireCellToolkit 48.9289 49.3633 50.0292 49.3676 0.346447 10
reco:gaushit:GausHitFinder 0.021718 0.0234182 0.0255885 0.0231942 0.00106804 10
reco:reco3d:SpacePointSolver 0.0847185 0.0934867 0.102534 0.0934945 0.00564186 10
reco:hitpdune:DisambigFromSpacePoints 0.00223248 0.00276223 0.00457832 0.00256137 0.000645631 10
reco:pandora:StandardPandora 0.310266 0.775575 4.71252 0.343555 1.31243 10
reco:pandoraTrack:LArPandoraTrackCreation 0.00185358 0.00278421 0.00552533 0.00216045 0.00108805 10
reco:pandoraShower:LArPandoraShowerCreation 0.000258212 0.000486124 0.00148821 0.000338431 0.000364484 10
reco:pandoraStdcalo:Calorimetry 0.00179961 0.00241379 0.00482414 0.00222976 0.00082029 10
reco:pandoraGnocalo:GnocchiCalorimetry 0.00120274 0.00147283 0.00320445 0.00130451 0.000578821 10
[art]:TriggerResults:TriggerResultInserter 1.7945e-05 2.53445e-05 5.9909e-05 2.0765e-05 1.19012e-05 10
end_path:out1:RootOutput 3.695e-06 8.6277e-06 2.1006e-05 7.7965e-06 4.31808e-06 10
end_path:out1:RootOutput(write) 0.0394292 0.041143 0.0425073 0.0412656 0.000939807 10
=================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3280.61 MB
Peak resident set size usage (VmHWM): 1529.43 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_muon_p_450MeV_protodunevd_1_167098_0_1743178899_gen_g4_stage1_g4_stage2_detsim_reco.root', 'start_time': 1743179574.4532495, 'end_time': 1743180123.1174664}