Jobsub ID 358078.22@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 358078.22@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 5747 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-03-27 11:21:19 | |
| Site | US_PuertoRico | |
| Entry | CMSHTPC_T3_US_PuertoRico_UPRM | |
| Last heartbeat | 2025-03-27 13:37:31 | |
| From worker node | Hostname | compute-1-3.local |
| cpuinfo | Intel(R) Xeon(R) CPU W3550 @ 3.07GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-03-27 13:08:55 | |
| Input files | monte-carlo-005747-000086 | |
| Jobscript | Exit code | 0 |
| Real time | 27m (1656s) | |
| CPU time | 27m (1639s = 98%) | |
| Max RSS bytes | 1628925952 (1553 MiB) | |
| Outputting started | 2025-03-27 13:36:32 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_22_1743080945_gen_g4_stage1_g4_stage2_detsim.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_22_1743080945_gen_g4_stage1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_22_1743080945_gen_g4_stage1_g4_stage2_detsim.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_22_1743080945_gen_g4_stage1_g4_stage2.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_22_1743080945_gen_g4_stage1_g4_stage2_detsim_reco.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_22_1743080945_gen_g4_stage1_g4_stage2_detsim_reco.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_22_1743080945_gen_g4_stage1_g4_stage2_detsim.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_22_1743080945_gen_g4_stage1_g4_stage2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_22_1743080945_gen_g4_stage1_g4_stage2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_22_1743080945_gen_g4_stage1.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_22_1743080945_gen.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_22_1743080945_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_22_1743080945_gen_g4_stage1_g4_stage2_detsim_reco.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_22_1743080945_gen.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/015/prod_muon_5GeV_protodunevd_1_358078_22_1743080945_gen_g4_stage1.root | |
| Finished | 2025-03-27 13:37:31 | |
| Saved logs | justin-logs:358078.22-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
Now with regularization...
Begin: 2.92854e+07
0 2.92824e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
Art has completed and will exit with status 0.
Stderr:
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
emtrkmichelid
nhitsfilter
pandoraWriter
pandoracalipid
pandorapid
trigfilter
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/8e14053062785f80c03da35c9e53597243e9b1b5/protodunevd_v4_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16499 nodes/ 2408 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
27-Mar-2025 09:23:54 AST Initiating request to open input file "prod_muon_5GeV_protodunevd_1_358078_22_1743080945_gen_g4_stage1_g4_stage2_detsim.root"
27-Mar-2025 09:23:55 AST Opened input file "prod_muon_5GeV_protodunevd_1_358078_22_1743080945_gen_g4_stage1_g4_stage2_detsim.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4210 traces, 4210 summary
Retagger: tagging trace set: gauss with 2653 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2653 traces tagged "gauss"
FrameSaver: q=488916 n=41416 tag=gauss
wclsFrameSaver: saving 4210 traces tagged "wiener"
FrameSaver: q=532768 n=33973 tag=wiener
27-Mar-2025 09:25:11 AST Opened output file with pattern "prod_muon_5GeV_protodunevd_1_358078_22_1743080945_gen_g4_stage1_g4_stage2_detsim_reco.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4045 traces, 4045 summary
Retagger: tagging trace set: gauss with 2498 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2498 traces tagged "gauss"
FrameSaver: q=470557 n=39687 tag=gauss
wclsFrameSaver: saving 4045 traces tagged "wiener"
FrameSaver: q=512420 n=32603 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 3934 traces, 3934 summary
Retagger: tagging trace set: gauss with 2453 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2453 traces tagged "gauss"
FrameSaver: q=419694 n=37566 tag=gauss
wclsFrameSaver: saving 3934 traces tagged "wiener"
FrameSaver: q=460984 n=30598 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4304 traces, 4304 summary
Retagger: tagging trace set: gauss with 2704 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2704 traces tagged "gauss"
FrameSaver: q=474830 n=43338 tag=gauss
wclsFrameSaver: saving 4304 traces tagged "wiener"
FrameSaver: q=517351 n=35770 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 3910 traces, 3910 summary
Retagger: tagging trace set: gauss with 2446 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2446 traces tagged "gauss"
FrameSaver: q=417612 n=37356 tag=gauss
wclsFrameSaver: saving 3910 traces tagged "wiener"
FrameSaver: q=458894 n=30901 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4052 traces, 4052 summary
Retagger: tagging trace set: gauss with 2495 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2495 traces tagged "gauss"
FrameSaver: q=442878 n=38733 tag=gauss
wclsFrameSaver: saving 4052 traces tagged "wiener"
FrameSaver: q=484556 n=31962 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4201 traces, 4201 summary
Retagger: tagging trace set: gauss with 2656 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2656 traces tagged "gauss"
FrameSaver: q=527080 n=42964 tag=gauss
wclsFrameSaver: saving 4201 traces tagged "wiener"
FrameSaver: q=569181 n=35719 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 3883 traces, 3883 summary
Retagger: tagging trace set: gauss with 2416 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2416 traces tagged "gauss"
FrameSaver: q=414576 n=37158 tag=gauss
wclsFrameSaver: saving 3883 traces tagged "wiener"
FrameSaver: q=455042 n=30553 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4123 traces, 4123 summary
Retagger: tagging trace set: gauss with 2562 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2562 traces tagged "gauss"
FrameSaver: q=478595 n=41081 tag=gauss
wclsFrameSaver: saving 4123 traces tagged "wiener"
FrameSaver: q=519971 n=34053 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4035 traces, 4035 summary
Retagger: tagging trace set: gauss with 2564 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2564 traces tagged "gauss"
FrameSaver: q=430908 n=39139 tag=gauss
wclsFrameSaver: saving 4035 traces tagged "wiener"
FrameSaver: q=470638 n=32166 tag=wiener
27-Mar-2025 09:36:30 AST Closed output file "prod_muon_5GeV_protodunevd_1_358078_22_1743080945_gen_g4_stage1_g4_stage2_detsim_reco.root"
27-Mar-2025 09:36:30 AST Closed input file "prod_muon_5GeV_protodunevd_1_358078_22_1743080945_gen_g4_stage1_g4_stage2_detsim.root"
=================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
=================================================================================================================================
Full event 73.8571 74.7187 77.5644 74.0888 1.10839 10
---------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00047825 0.000599691 0.000754355 0.000569104 9.26375e-05 10
reco:rns:RandomNumberSaver 3.8264e-05 6.27478e-05 0.00025051 4.0595e-05 6.27381e-05 10
reco:wclsdatavd:WireCellToolkit 73.1876 73.8609 76.7873 73.3466 1.0578 10
reco:gaushit:GausHitFinder 0.0410179 0.0462756 0.0562569 0.0444857 0.00460527 10
reco:reco3d:SpacePointSolver 0.275441 0.289615 0.306063 0.28849 0.0105606 10
reco:hitpdune:DisambigFromSpacePoints 0.00487879 0.0056436 0.0075446 0.00520951 0.000917513 10
reco:pandora:StandardPandora 0.234039 0.425402 1.83343 0.257664 0.470017 10
reco:pandoraTrack:LArPandoraTrackCreation 0.005198 0.00718695 0.0118308 0.00649192 0.00206225 10
reco:pandoraShower:LArPandoraShowerCreation 0.0015658 0.00359189 0.00720764 0.00331207 0.00156146 10
reco:pandoraStdcalo:Calorimetry 0.00850411 0.00975751 0.0134686 0.00927504 0.00144889 10
reco:pandoraGnocalo:GnocchiCalorimetry 0.00300614 0.00332592 0.00521109 0.00310859 0.000634779 10
[art]:TriggerResults:TriggerResultInserter 1.906e-05 2.4167e-05 5.9321e-05 2.0336e-05 1.17467e-05 10
end_path:out1:RootOutput 4.174e-06 5.6593e-06 1.7009e-05 4.4375e-06 3.78486e-06 10
end_path:out1:RootOutput(write) 0.0565184 0.0606689 0.0705784 0.0601708 0.00392162 10
=================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3395.98 MB
Peak resident set size usage (VmHWM): 1418.29 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_muon_5GeV_protodunevd_1_358078_22_1743080945_gen_g4_stage1_g4_stage2_detsim_reco.root', 'start_time': 1743081797.780835, 'end_time': 1743082591.597168}