Jobsub ID 358078.25@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 358078.25@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 5747 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-03-27 11:21:19 | |
| Site | US_PuertoRico | |
| Entry | CMSHTPC_T3_US_PuertoRico_UPRM | |
| Last heartbeat | 2025-03-27 13:38:04 | |
| From worker node | Hostname | compute-1-3.local |
| cpuinfo | Intel(R) Xeon(R) CPU W3550 @ 3.07GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-03-27 13:08:48 | |
| Input files | monte-carlo-005747-000060 | |
| Jobscript | Exit code | 0 |
| Real time | 28m (1701s) | |
| CPU time | 28m (1683s = 98%) | |
| Max RSS bytes | 1638408192 (1562 MiB) | |
| Outputting started | 2025-03-27 13:37:10 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_25_1743080940_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_25_1743080940_gen_g4_stage1_g4_stage2_detsim.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_25_1743080940_gen.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_25_1743080940_gen_g4_stage1_g4_stage2_detsim_reco.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_25_1743080940_gen_g4_stage1_g4_stage2_detsim.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_25_1743080940_gen_g4_stage1_g4_stage2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_25_1743080940_gen.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_25_1743080940_gen_g4_stage1.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_25_1743080940_gen_g4_stage1_g4_stage2.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_25_1743080940_gen_g4_stage1_g4_stage2_detsim_reco.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_25_1743080940_gen_g4_stage1_g4_stage2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_25_1743080940_gen_g4_stage1_g4_stage2_detsim_reco.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_25_1743080940_gen_g4_stage1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_25_1743080940_gen_g4_stage1_g4_stage2_detsim.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_25_1743080940_gen_g4_stage1.root | |
| Finished | 2025-03-27 13:38:04 | |
| Saved logs | justin-logs:358078.25-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
w with regularization...
Begin: 2.00488e+07
0 2.00479e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
Art has completed and will exit with status 0.
Stderr:
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
emtrkmichelid
nhitsfilter
pandoraWriter
pandoracalipid
pandorapid
trigfilter
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/8e14053062785f80c03da35c9e53597243e9b1b5/protodunevd_v4_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16499 nodes/ 2408 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
27-Mar-2025 09:24:27 AST Initiating request to open input file "prod_muon_5GeV_protodunevd_1_358078_25_1743080940_gen_g4_stage1_g4_stage2_detsim.root"
27-Mar-2025 09:24:27 AST Opened input file "prod_muon_5GeV_protodunevd_1_358078_25_1743080940_gen_g4_stage1_g4_stage2_detsim.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4293 traces, 4293 summary
Retagger: tagging trace set: gauss with 2652 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2652 traces tagged "gauss"
FrameSaver: q=484530 n=42291 tag=gauss
wclsFrameSaver: saving 4293 traces tagged "wiener"
FrameSaver: q=528314 n=34927 tag=wiener
27-Mar-2025 09:25:43 AST Opened output file with pattern "prod_muon_5GeV_protodunevd_1_358078_25_1743080940_gen_g4_stage1_g4_stage2_detsim_reco.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4162 traces, 4162 summary
Retagger: tagging trace set: gauss with 2609 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2609 traces tagged "gauss"
FrameSaver: q=499859 n=41027 tag=gauss
wclsFrameSaver: saving 4162 traces tagged "wiener"
FrameSaver: q=542129 n=33894 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4219 traces, 4219 summary
Retagger: tagging trace set: gauss with 2649 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2649 traces tagged "gauss"
FrameSaver: q=469906 n=41312 tag=gauss
wclsFrameSaver: saving 4219 traces tagged "wiener"
FrameSaver: q=513092 n=34387 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 3996 traces, 3996 summary
Retagger: tagging trace set: gauss with 2465 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2465 traces tagged "gauss"
FrameSaver: q=456759 n=39543 tag=gauss
wclsFrameSaver: saving 3996 traces tagged "wiener"
FrameSaver: q=499236 n=32679 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 3814 traces, 3814 summary
Retagger: tagging trace set: gauss with 2406 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2406 traces tagged "gauss"
FrameSaver: q=407509 n=36235 tag=gauss
wclsFrameSaver: saving 3814 traces tagged "wiener"
FrameSaver: q=446315 n=29826 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 3739 traces, 3739 summary
Retagger: tagging trace set: gauss with 2317 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2317 traces tagged "gauss"
FrameSaver: q=404822 n=35526 tag=gauss
wclsFrameSaver: saving 3739 traces tagged "wiener"
FrameSaver: q=443943 n=28938 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 3988 traces, 3988 summary
Retagger: tagging trace set: gauss with 2500 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2500 traces tagged "gauss"
FrameSaver: q=450213 n=38647 tag=gauss
wclsFrameSaver: saving 3988 traces tagged "wiener"
FrameSaver: q=491679 n=31889 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 3849 traces, 3849 summary
Retagger: tagging trace set: gauss with 2459 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2459 traces tagged "gauss"
FrameSaver: q=419714 n=37544 tag=gauss
wclsFrameSaver: saving 3849 traces tagged "wiener"
FrameSaver: q=460219 n=31064 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 3926 traces, 3926 summary
Retagger: tagging trace set: gauss with 2433 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2433 traces tagged "gauss"
FrameSaver: q=427426 n=38065 tag=gauss
wclsFrameSaver: saving 3926 traces tagged "wiener"
FrameSaver: q=468080 n=31201 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 3879 traces, 3879 summary
Retagger: tagging trace set: gauss with 2360 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2360 traces tagged "gauss"
FrameSaver: q=436111 n=37464 tag=gauss
wclsFrameSaver: saving 3879 traces tagged "wiener"
FrameSaver: q=476139 n=30816 tag=wiener
27-Mar-2025 09:37:08 AST Closed output file "prod_muon_5GeV_protodunevd_1_358078_25_1743080940_gen_g4_stage1_g4_stage2_detsim_reco.root"
27-Mar-2025 09:37:08 AST Closed input file "prod_muon_5GeV_protodunevd_1_358078_25_1743080940_gen_g4_stage1_g4_stage2_detsim.root"
=================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
=================================================================================================================================
Full event 73.4628 75.2741 84.7985 73.7977 3.30367 10
---------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000607321 0.000692826 0.000861157 0.000670999 8.05088e-05 10
reco:rns:RandomNumberSaver 3.8123e-05 6.8236e-05 0.000274509 4.36385e-05 6.91406e-05 10
reco:wclsdatavd:WireCellToolkit 72.8501 74.4464 84.178 73.1298 3.33457 10
reco:gaushit:GausHitFinder 0.0374632 0.044665 0.0518449 0.0442593 0.00475366 10
reco:reco3d:SpacePointSolver 0.26593 0.284252 0.295399 0.28537 0.0104607 10
reco:hitpdune:DisambigFromSpacePoints 0.00469616 0.00564667 0.00799996 0.00527069 0.00103952 10
reco:pandora:StandardPandora 0.209186 0.40497 1.85913 0.24787 0.485273 10
reco:pandoraTrack:LArPandoraTrackCreation 0.00537606 0.00684425 0.0142797 0.00585146 0.00253696 10
reco:pandoraShower:LArPandoraShowerCreation 0.00112127 0.003107 0.0055963 0.00319566 0.00127292 10
reco:pandoraStdcalo:Calorimetry 0.00834951 0.00950558 0.0135401 0.00909756 0.00143717 10
reco:pandoraGnocalo:GnocchiCalorimetry 0.00301027 0.00331922 0.00543463 0.00310256 0.000705985 10
[art]:TriggerResults:TriggerResultInserter 1.915e-05 2.36541e-05 5.7269e-05 1.96015e-05 1.12358e-05 10
end_path:out1:RootOutput 3.912e-06 7.1382e-06 2.1073e-05 4.196e-06 6.00782e-06 10
end_path:out1:RootOutput(write) 0.0550734 0.0590813 0.0686865 0.0584757 0.00366824 10
=================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3402.28 MB
Peak resident set size usage (VmHWM): 1428.92 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_muon_5GeV_protodunevd_1_358078_25_1743080940_gen_g4_stage1_g4_stage2_detsim_reco.root', 'start_time': 1743081829.4126508, 'end_time': 1743082629.2103553}