Jobsub ID 166663.3@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 166663.3@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 5747 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-03-27 11:50:33 | |
| Site | US_PuertoRico | |
| Entry | CMSHTPC_T3_US_PuertoRico_UPRM | |
| Last heartbeat | 2025-03-27 13:07:02 | |
| From worker node | Hostname | compute-1-3.local |
| cpuinfo | Intel(R) Xeon(R) CPU W3550 @ 3.07GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-03-27 12:37:14 | |
| Input files | monte-carlo-005747-000394 | |
| Jobscript | Exit code | 0 |
| Real time | 28m (1701s) | |
| CPU time | 27m (1678s = 98%) | |
| Max RSS bytes | 1626636288 (1551 MiB) | |
| Outputting started | 2025-03-27 13:05:36 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166663_3_1743079044_gen_g4_stage1_g4_stage2_detsim.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166663_3_1743079044_gen_g4_stage1_g4_stage2_detsim_reco.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166663_3_1743079044_gen_g4_stage1.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166663_3_1743079044_gen_g4_stage1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166663_3_1743079044_gen.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166663_3_1743079044_gen_g4_stage1_g4_stage2_detsim.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166663_3_1743079044_gen_g4_stage1_g4_stage2.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166663_3_1743079044_gen_g4_stage1_g4_stage2_detsim.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166663_3_1743079044_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166663_3_1743079044_gen_g4_stage1_g4_stage2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166663_3_1743079044_gen.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166663_3_1743079044_gen_g4_stage1_g4_stage2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166663_3_1743079044_gen_g4_stage1.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166663_3_1743079044_gen_g4_stage1_g4_stage2_detsim_reco.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166663_3_1743079044_gen_g4_stage1_g4_stage2_detsim_reco.err | |
| Finished | 2025-03-27 13:07:02 | |
| Saved logs | justin-logs:166663.3-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
+07
Now with regularization...
Begin: 2.15167e+07
0 2.15144e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
Art has completed and will exit with status 0.
Stderr:
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
emtrkmichelid
nhitsfilter
pandoraWriter
pandoracalipid
pandorapid
trigfilter
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/8e14053062785f80c03da35c9e53597243e9b1b5/protodunevd_v4_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16499 nodes/ 2408 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
27-Mar-2025 08:52:13 AST Initiating request to open input file "prod_muon_5GeV_protodunevd_1_166663_3_1743079044_gen_g4_stage1_g4_stage2_detsim.root"
27-Mar-2025 08:52:14 AST Opened input file "prod_muon_5GeV_protodunevd_1_166663_3_1743079044_gen_g4_stage1_g4_stage2_detsim.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4203 traces, 4203 summary
Retagger: tagging trace set: gauss with 2663 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2663 traces tagged "gauss"
FrameSaver: q=494551 n=42487 tag=gauss
wclsFrameSaver: saving 4203 traces tagged "wiener"
FrameSaver: q=535945 n=35544 tag=wiener
27-Mar-2025 08:53:30 AST Opened output file with pattern "prod_muon_5GeV_protodunevd_1_166663_3_1743079044_gen_g4_stage1_g4_stage2_detsim_reco.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 3961 traces, 3961 summary
Retagger: tagging trace set: gauss with 2516 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2516 traces tagged "gauss"
FrameSaver: q=455084 n=39324 tag=gauss
wclsFrameSaver: saving 3961 traces tagged "wiener"
FrameSaver: q=496205 n=32427 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4047 traces, 4047 summary
Retagger: tagging trace set: gauss with 2502 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2502 traces tagged "gauss"
FrameSaver: q=482305 n=40348 tag=gauss
wclsFrameSaver: saving 4047 traces tagged "wiener"
FrameSaver: q=524842 n=33312 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4263 traces, 4263 summary
Retagger: tagging trace set: gauss with 2672 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2672 traces tagged "gauss"
FrameSaver: q=479125 n=41719 tag=gauss
wclsFrameSaver: saving 4263 traces tagged "wiener"
FrameSaver: q=524179 n=34554 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4548 traces, 4548 summary
Retagger: tagging trace set: gauss with 2831 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2831 traces tagged "gauss"
FrameSaver: q=636816 n=47610 tag=gauss
wclsFrameSaver: saving 4548 traces tagged "wiener"
FrameSaver: q=681929 n=39943 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 3858 traces, 3858 summary
Retagger: tagging trace set: gauss with 2409 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2409 traces tagged "gauss"
FrameSaver: q=411182 n=37269 tag=gauss
wclsFrameSaver: saving 3858 traces tagged "wiener"
FrameSaver: q=451278 n=30583 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 3866 traces, 3866 summary
Retagger: tagging trace set: gauss with 2462 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2462 traces tagged "gauss"
FrameSaver: q=420197 n=37186 tag=gauss
wclsFrameSaver: saving 3866 traces tagged "wiener"
FrameSaver: q=460607 n=30511 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 3940 traces, 3940 summary
Retagger: tagging trace set: gauss with 2442 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2442 traces tagged "gauss"
FrameSaver: q=426209 n=37627 tag=gauss
wclsFrameSaver: saving 3940 traces tagged "wiener"
FrameSaver: q=468013 n=31030 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4311 traces, 4311 summary
Retagger: tagging trace set: gauss with 2706 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2706 traces tagged "gauss"
FrameSaver: q=543224 n=44737 tag=gauss
wclsFrameSaver: saving 4311 traces tagged "wiener"
FrameSaver: q=586861 n=37302 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 3910 traces, 3910 summary
Retagger: tagging trace set: gauss with 2439 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2439 traces tagged "gauss"
FrameSaver: q=421367 n=37795 tag=gauss
wclsFrameSaver: saving 3910 traces tagged "wiener"
FrameSaver: q=461395 n=31113 tag=wiener
27-Mar-2025 09:05:34 AST Closed output file "prod_muon_5GeV_protodunevd_1_166663_3_1743079044_gen_g4_stage1_g4_stage2_detsim_reco.root"
27-Mar-2025 09:05:34 AST Closed input file "prod_muon_5GeV_protodunevd_1_166663_3_1743079044_gen_g4_stage1_g4_stage2_detsim.root"
=================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
=================================================================================================================================
Full event 72.9697 78.8113 93.638 76.5521 6.86959 10
---------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00038639 0.00052629 0.000648884 0.000538345 8.8215e-05 10
reco:rns:RandomNumberSaver 3.8465e-05 6.07409e-05 0.000244241 3.99385e-05 6.11929e-05 10
reco:wclsdatavd:WireCellToolkit 72.3236 77.9343 92.8043 75.0405 6.92981 10
reco:gaushit:GausHitFinder 0.0400806 0.0489934 0.0675872 0.0450834 0.00929961 10
reco:reco3d:SpacePointSolver 0.279305 0.2945 0.320071 0.288753 0.0143545 10
reco:hitpdune:DisambigFromSpacePoints 0.00459688 0.00575156 0.00806159 0.00539968 0.00103922 10
reco:pandora:StandardPandora 0.235023 0.436407 1.87541 0.277654 0.480922 10
reco:pandoraTrack:LArPandoraTrackCreation 0.00562622 0.00691722 0.00814318 0.0066945 0.000888326 10
reco:pandoraShower:LArPandoraShowerCreation 0.00159175 0.00388686 0.00801641 0.00301719 0.00200275 10
reco:pandoraStdcalo:Calorimetry 0.00841345 0.00960812 0.0114598 0.00926232 0.000977225 10
reco:pandoraGnocalo:GnocchiCalorimetry 0.00296264 0.00337827 0.00494197 0.00318202 0.000552298 10
[art]:TriggerResults:TriggerResultInserter 1.8622e-05 2.89129e-05 6.1208e-05 2.08235e-05 1.53605e-05 10
end_path:out1:RootOutput 4.014e-06 5.7329e-06 1.6604e-05 4.4005e-06 3.65409e-06 10
end_path:out1:RootOutput(write) 0.0562651 0.0609388 0.06864 0.0592745 0.00419573 10
=================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3391.69 MB
Peak resident set size usage (VmHWM): 1418.34 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_muon_5GeV_protodunevd_1_166663_3_1743079044_gen_g4_stage1_g4_stage2_detsim_reco.root', 'start_time': 1743079896.5047667, 'end_time': 1743080735.5234046}