Jobsub ID 359067.1@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 359067.1@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 5780 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-03-31 02:39:23 | |
| Site | US_UChicago | |
| Entry | Engage_US_MWT2_iut2_gk02_condce_mcore | |
| Last heartbeat | 2025-03-31 03:18:58 | |
| From worker node | Hostname | mwt2-c144.campuscluster.illinois.edu |
| cpuinfo | Intel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 86400 (24 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-03-31 02:50:31 | |
| Input files | monte-carlo-005780-000974 | |
| Jobscript | Exit code | 0 |
| Real time | 27m (1669s) | |
| CPU time | 26m (1579s = 94%) | |
| Max RSS bytes | 1711579136 (1632 MiB) | |
| Outputting started | 2025-03-31 03:18:21 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/015/prod_muon_m_450MeV_protodunevd_1_359067_1_1743389457_gen_g4_stage1.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/015/prod_muon_m_450MeV_protodunevd_1_359067_1_1743389457_gen_g4_stage1_g4_stage2_detsim.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/015/prod_muon_m_450MeV_protodunevd_1_359067_1_1743389457_gen_g4_stage1_g4_stage2_detsim.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/015/prod_muon_m_450MeV_protodunevd_1_359067_1_1743389457_gen_g4_stage1.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/015/prod_muon_m_450MeV_protodunevd_1_359067_1_1743389457_gen_g4_stage1_g4_stage2.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/015/prod_muon_m_450MeV_protodunevd_1_359067_1_1743389457_gen.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/015/prod_muon_m_450MeV_protodunevd_1_359067_1_1743389457_gen.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/015/prod_muon_m_450MeV_protodunevd_1_359067_1_1743389457_gen_g4_stage1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/015/prod_muon_m_450MeV_protodunevd_1_359067_1_1743389457_gen_g4_stage1_g4_stage2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/015/prod_muon_m_450MeV_protodunevd_1_359067_1_1743389457_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/015/prod_muon_m_450MeV_protodunevd_1_359067_1_1743389457_gen_g4_stage1_g4_stage2_detsim.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/015/prod_muon_m_450MeV_protodunevd_1_359067_1_1743389457_gen_g4_stage1_g4_stage2_detsim_reco.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/015/prod_muon_m_450MeV_protodunevd_1_359067_1_1743389457_gen_g4_stage1_g4_stage2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/015/prod_muon_m_450MeV_protodunevd_1_359067_1_1743389457_gen_g4_stage1_g4_stage2_detsim_reco.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05780/1/015/prod_muon_m_450MeV_protodunevd_1_359067_1_1743389457_gen_g4_stage1_g4_stage2_detsim_reco.err | |
| Finished | 2025-03-31 03:18:58 | |
| Saved logs | justin-logs:359067.1-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
tion...
Begin: 1.26773e+07
0 1.26773e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
Art has completed and will exit with status 0.
Stderr:
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
emtrkmichelid
nhitsfilter
pandoraWriter
pandoracalipid
pandorapid
trigfilter
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/497fe0b9af7ebfe5ac11fff59041e9416f4d09cb/protodunevd_v4_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16499 nodes/ 2408 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
30-Mar-2025 22:05:55 CDT Initiating request to open input file "prod_muon_m_450MeV_protodunevd_1_359067_1_1743389457_gen_g4_stage1_g4_stage2_detsim.root"
30-Mar-2025 22:05:55 CDT Opened input file "prod_muon_m_450MeV_protodunevd_1_359067_1_1743389457_gen_g4_stage1_g4_stage2_detsim.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1689 traces, 1689 summary
Retagger: tagging trace set: gauss with 1421 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1421 traces tagged "gauss"
FrameSaver: q=160785 n=18446 tag=gauss
wclsFrameSaver: saving 1689 traces tagged "wiener"
FrameSaver: q=176406 n=16612 tag=wiener
30-Mar-2025 22:07:15 CDT Opened output file with pattern "prod_muon_m_450MeV_protodunevd_1_359067_1_1743389457_gen_g4_stage1_g4_stage2_detsim_reco.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1607 traces, 1607 summary
Retagger: tagging trace set: gauss with 1309 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1309 traces tagged "gauss"
FrameSaver: q=156298 n=17452 tag=gauss
wclsFrameSaver: saving 1607 traces tagged "wiener"
FrameSaver: q=171816 n=15571 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1708 traces, 1708 summary
Retagger: tagging trace set: gauss with 1464 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1464 traces tagged "gauss"
FrameSaver: q=167129 n=19586 tag=gauss
wclsFrameSaver: saving 1708 traces tagged "wiener"
FrameSaver: q=181043 n=17693 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1797 traces, 1797 summary
Retagger: tagging trace set: gauss with 1338 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1338 traces tagged "gauss"
FrameSaver: q=157867 n=18402 tag=gauss
wclsFrameSaver: saving 1797 traces tagged "wiener"
FrameSaver: q=177126 n=16137 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1789 traces, 1789 summary
Retagger: tagging trace set: gauss with 1370 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1370 traces tagged "gauss"
FrameSaver: q=175394 n=19261 tag=gauss
wclsFrameSaver: saving 1789 traces tagged "wiener"
FrameSaver: q=192487 n=16945 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1776 traces, 1776 summary
Retagger: tagging trace set: gauss with 1397 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1397 traces tagged "gauss"
FrameSaver: q=159471 n=18338 tag=gauss
wclsFrameSaver: saving 1776 traces tagged "wiener"
FrameSaver: q=176400 n=16157 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1823 traces, 1823 summary
Retagger: tagging trace set: gauss with 1334 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1334 traces tagged "gauss"
FrameSaver: q=156507 n=17981 tag=gauss
wclsFrameSaver: saving 1823 traces tagged "wiener"
FrameSaver: q=176788 n=15617 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1703 traces, 1703 summary
Retagger: tagging trace set: gauss with 1287 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1287 traces tagged "gauss"
FrameSaver: q=157918 n=17669 tag=gauss
wclsFrameSaver: saving 1703 traces tagged "wiener"
FrameSaver: q=175675 n=15474 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1790 traces, 1790 summary
Retagger: tagging trace set: gauss with 1361 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1361 traces tagged "gauss"
FrameSaver: q=164551 n=18702 tag=gauss
wclsFrameSaver: saving 1790 traces tagged "wiener"
FrameSaver: q=181970 n=16303 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1776 traces, 1776 summary
Retagger: tagging trace set: gauss with 1407 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1407 traces tagged "gauss"
FrameSaver: q=160256 n=18818 tag=gauss
wclsFrameSaver: saving 1776 traces tagged "wiener"
FrameSaver: q=177331 n=16617 tag=wiener
30-Mar-2025 22:18:19 CDT Closed output file "prod_muon_m_450MeV_protodunevd_1_359067_1_1743389457_gen_g4_stage1_g4_stage2_detsim_reco.root"
30-Mar-2025 22:18:19 CDT Closed input file "prod_muon_m_450MeV_protodunevd_1_359067_1_1743389457_gen_g4_stage1_g4_stage2_detsim.root"
=================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
=================================================================================================================================
Full event 68.94 73.6367 79.3798 72.9667 4.04588 10
---------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000738526 0.00166808 0.00740471 0.00108399 0.00192063 10
reco:rns:RandomNumberSaver 4.6157e-05 8.85671e-05 0.00035996 5.99795e-05 9.09649e-05 10
reco:wclsdatavd:WireCellToolkit 68.2811 72.6646 78.2699 72.3711 3.64673 10
reco:gaushit:GausHitFinder 0.026222 0.0309704 0.0363349 0.0304922 0.00288776 10
reco:reco3d:SpacePointSolver 0.0914473 0.119916 0.154605 0.115321 0.0195576 10
reco:hitpdune:DisambigFromSpacePoints 0.00314093 0.00432761 0.00618384 0.00393507 0.00100063 10
reco:pandora:StandardPandora 0.278428 0.731567 3.50876 0.457799 0.928415 10
reco:pandoraTrack:LArPandoraTrackCreation 0.00245832 0.00485462 0.00792397 0.00450342 0.00149315 10
reco:pandoraShower:LArPandoraShowerCreation 0.000317947 0.000785785 0.00236537 0.000555667 0.000592194 10
reco:pandoraStdcalo:Calorimetry 0.00263585 0.0033829 0.00539603 0.00293 0.00089293 10
reco:pandoraGnocalo:GnocchiCalorimetry 0.00176469 0.00324338 0.0116724 0.00202314 0.00286764 10
[art]:TriggerResults:TriggerResultInserter 2.11e-05 3.24112e-05 8.0068e-05 2.75595e-05 1.64667e-05 10
end_path:out1:RootOutput 7.61e-06 1.04876e-05 2.5101e-05 8.643e-06 4.97363e-06 10
end_path:out1:RootOutput(write) 0.0516751 0.0642892 0.0811695 0.0594526 0.0102373 10
=================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3337.58 MB
Peak resident set size usage (VmHWM): 1538.7 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_muon_m_450MeV_protodunevd_1_359067_1_1743389457_gen_g4_stage1_g4_stage2_detsim_reco.root', 'start_time': 1743390297.1048586, 'end_time': 1743391100.9509208}