Jobsub ID 358078.64@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 358078.64@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 5747 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-03-27 11:21:19 | |
| Site | US_PuertoRico | |
| Entry | CMSHTPC_T3_US_PuertoRico_UPRM | |
| Last heartbeat | 2025-03-27 13:38:22 | |
| From worker node | Hostname | compute-1-3.local |
| cpuinfo | Intel(R) Xeon(R) CPU W3550 @ 3.07GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-03-27 13:09:24 | |
| Input files | monte-carlo-005747-000931 | |
| Jobscript | Exit code | 0 |
| Real time | 28m (1682s) | |
| CPU time | 27m (1667s = 99%) | |
| Max RSS bytes | 1625632768 (1550 MiB) | |
| Outputting started | 2025-03-27 13:37:27 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_64_1743080973_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_64_1743080973_gen_g4_stage1.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_64_1743080973_gen_g4_stage1_g4_stage2_detsim_reco.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_64_1743080973_gen_g4_stage1_g4_stage2.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_64_1743080973_gen_g4_stage1_g4_stage2_detsim.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_64_1743080973_gen_g4_stage1_g4_stage2_detsim_reco.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_64_1743080973_gen_g4_stage1_g4_stage2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_64_1743080973_gen_g4_stage1_g4_stage2_detsim.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_64_1743080973_gen.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_64_1743080973_gen_g4_stage1_g4_stage2_detsim.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_64_1743080973_gen_g4_stage1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_64_1743080973_gen_g4_stage1.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_64_1743080973_gen_g4_stage1_g4_stage2_detsim_reco.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_64_1743080973_gen_g4_stage1_g4_stage2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_64_1743080973_gen.err | |
| Finished | 2025-03-27 13:38:22 | |
| Saved logs | justin-logs:358078.64-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
w with regularization...
Begin: 2.04665e+07
0 2.04576e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
Art has completed and will exit with status 0.
Stderr:
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
emtrkmichelid
nhitsfilter
pandoraWriter
pandoracalipid
pandorapid
trigfilter
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/8e14053062785f80c03da35c9e53597243e9b1b5/protodunevd_v4_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16499 nodes/ 2408 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
27-Mar-2025 09:24:39 AST Initiating request to open input file "prod_muon_5GeV_protodunevd_1_358078_64_1743080973_gen_g4_stage1_g4_stage2_detsim.root"
27-Mar-2025 09:24:40 AST Opened input file "prod_muon_5GeV_protodunevd_1_358078_64_1743080973_gen_g4_stage1_g4_stage2_detsim.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 3998 traces, 3998 summary
Retagger: tagging trace set: gauss with 2545 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2545 traces tagged "gauss"
FrameSaver: q=450343 n=39066 tag=gauss
wclsFrameSaver: saving 3998 traces tagged "wiener"
FrameSaver: q=490553 n=32262 tag=wiener
27-Mar-2025 09:25:55 AST Opened output file with pattern "prod_muon_5GeV_protodunevd_1_358078_64_1743080973_gen_g4_stage1_g4_stage2_detsim_reco.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 3979 traces, 3979 summary
Retagger: tagging trace set: gauss with 2491 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2491 traces tagged "gauss"
FrameSaver: q=441367 n=38247 tag=gauss
wclsFrameSaver: saving 3979 traces tagged "wiener"
FrameSaver: q=483057 n=31581 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4102 traces, 4102 summary
Retagger: tagging trace set: gauss with 2563 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2563 traces tagged "gauss"
FrameSaver: q=447446 n=40109 tag=gauss
wclsFrameSaver: saving 4102 traces tagged "wiener"
FrameSaver: q=488821 n=32816 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4144 traces, 4144 summary
Retagger: tagging trace set: gauss with 2569 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2569 traces tagged "gauss"
FrameSaver: q=455975 n=39758 tag=gauss
wclsFrameSaver: saving 4144 traces tagged "wiener"
FrameSaver: q=500588 n=32670 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 3910 traces, 3910 summary
Retagger: tagging trace set: gauss with 2449 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2449 traces tagged "gauss"
FrameSaver: q=421965 n=37334 tag=gauss
wclsFrameSaver: saving 3910 traces tagged "wiener"
FrameSaver: q=462360 n=30758 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4001 traces, 4001 summary
Retagger: tagging trace set: gauss with 2488 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2488 traces tagged "gauss"
FrameSaver: q=465279 n=40286 tag=gauss
wclsFrameSaver: saving 4001 traces tagged "wiener"
FrameSaver: q=506143 n=33114 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4052 traces, 4052 summary
Retagger: tagging trace set: gauss with 2456 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2456 traces tagged "gauss"
FrameSaver: q=427886 n=38548 tag=gauss
wclsFrameSaver: saving 4052 traces tagged "wiener"
FrameSaver: q=468883 n=31555 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 3846 traces, 3846 summary
Retagger: tagging trace set: gauss with 2377 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2377 traces tagged "gauss"
FrameSaver: q=388499 n=36198 tag=gauss
wclsFrameSaver: saving 3846 traces tagged "wiener"
FrameSaver: q=428472 n=29461 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4062 traces, 4062 summary
Retagger: tagging trace set: gauss with 2539 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2539 traces tagged "gauss"
FrameSaver: q=462524 n=39799 tag=gauss
wclsFrameSaver: saving 4062 traces tagged "wiener"
FrameSaver: q=503138 n=32976 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4036 traces, 4036 summary
Retagger: tagging trace set: gauss with 2486 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2486 traces tagged "gauss"
FrameSaver: q=449726 n=39682 tag=gauss
wclsFrameSaver: saving 4036 traces tagged "wiener"
FrameSaver: q=491245 n=32645 tag=wiener
27-Mar-2025 09:37:25 AST Closed output file "prod_muon_5GeV_protodunevd_1_358078_64_1743080973_gen_g4_stage1_g4_stage2_detsim_reco.root"
27-Mar-2025 09:37:25 AST Closed input file "prod_muon_5GeV_protodunevd_1_358078_64_1743080973_gen_g4_stage1_g4_stage2_detsim.root"
=================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
=================================================================================================================================
Full event 73.3081 75.8175 79.6242 75.2118 2.0929 10
---------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00039934 0.000706241 0.00169587 0.000646287 0.000353931 10
reco:rns:RandomNumberSaver 3.8165e-05 7.67549e-05 0.000352799 4.36185e-05 9.26637e-05 10
reco:wclsdatavd:WireCellToolkit 72.6791 74.9379 78.9873 73.936 2.12197 10
reco:gaushit:GausHitFinder 0.0385962 0.0485921 0.0842337 0.0442545 0.0130146 10
reco:reco3d:SpacePointSolver 0.26736 0.299668 0.458372 0.283813 0.0534161 10
reco:hitpdune:DisambigFromSpacePoints 0.00481946 0.00594523 0.00964523 0.00532429 0.00143748 10
reco:pandora:StandardPandora 0.219629 0.430216 1.84242 0.273503 0.474465 10
reco:pandoraTrack:LArPandoraTrackCreation 0.00540086 0.00659619 0.0101423 0.00603794 0.00150041 10
reco:pandoraShower:LArPandoraShowerCreation 0.00082697 0.00283396 0.00506341 0.00262682 0.00125776 10
reco:pandoraStdcalo:Calorimetry 0.0083752 0.00975861 0.0144542 0.00907144 0.00183828 10
reco:pandoraGnocalo:GnocchiCalorimetry 0.00288217 0.00362992 0.00674258 0.00313047 0.00120011 10
[art]:TriggerResults:TriggerResultInserter 1.7338e-05 2.59491e-05 5.6811e-05 2.03955e-05 1.17255e-05 10
end_path:out1:RootOutput 3.958e-06 5.6358e-06 1.6515e-05 4.3535e-06 3.64861e-06 10
end_path:out1:RootOutput(write) 0.0552242 0.0653578 0.114712 0.0609997 0.0166365 10
=================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3463.14 MB
Peak resident set size usage (VmHWM): 1484.98 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_muon_5GeV_protodunevd_1_358078_64_1743080973_gen_g4_stage1_g4_stage2_detsim_reco.root', 'start_time': 1743081842.7085466, 'end_time': 1743082646.5024393}