Jobsub ID 166664.0@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 166664.0@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 5747 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-03-27 11:52:35 | |
| Site | US_PuertoRico | |
| Entry | CMSHTPC_T3_US_PuertoRico_UPRM | |
| Last heartbeat | 2025-03-27 13:06:45 | |
| From worker node | Hostname | compute-1-3.local |
| cpuinfo | Intel(R) Xeon(R) CPU W3550 @ 3.07GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-03-27 12:37:12 | |
| Input files | monte-carlo-005747-000393 | |
| Jobscript | Exit code | 0 |
| Real time | 27m (1671s) | |
| CPU time | 27m (1648s = 98%) | |
| Max RSS bytes | 1632153600 (1556 MiB) | |
| Outputting started | 2025-03-27 13:05:05 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166664_0_1743079043_gen.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166664_0_1743079043_gen_g4_stage1_g4_stage2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166664_0_1743079043_gen_g4_stage1_g4_stage2_detsim.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166664_0_1743079043_gen_g4_stage1.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166664_0_1743079043_gen.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166664_0_1743079043_gen_g4_stage1_g4_stage2_detsim.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166664_0_1743079043_gen_g4_stage1_g4_stage2_detsim_reco.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166664_0_1743079043_gen_g4_stage1_g4_stage2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166664_0_1743079043_gen_g4_stage1_g4_stage2_detsim_reco.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166664_0_1743079043_gen_g4_stage1_g4_stage2.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166664_0_1743079043_gen_g4_stage1_g4_stage2_detsim_reco.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166664_0_1743079043_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166664_0_1743079043_gen_g4_stage1_g4_stage2_detsim.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166664_0_1743079043_gen_g4_stage1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05747/1/007/prod_muon_5GeV_protodunevd_1_166664_0_1743079043_gen_g4_stage1.root | |
| Finished | 2025-03-27 13:06:45 | |
| Saved logs | justin-logs:166664.0-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
+07
Now with regularization...
Begin: 2.72191e+07
0 2.72175e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
Art has completed and will exit with status 0.
Stderr:
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
emtrkmichelid
nhitsfilter
pandoraWriter
pandoracalipid
pandorapid
trigfilter
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/8e14053062785f80c03da35c9e53597243e9b1b5/protodunevd_v4_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16499 nodes/ 2408 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
27-Mar-2025 08:52:13 AST Initiating request to open input file "prod_muon_5GeV_protodunevd_1_166664_0_1743079043_gen_g4_stage1_g4_stage2_detsim.root"
27-Mar-2025 08:52:14 AST Opened input file "prod_muon_5GeV_protodunevd_1_166664_0_1743079043_gen_g4_stage1_g4_stage2_detsim.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 3929 traces, 3929 summary
Retagger: tagging trace set: gauss with 2438 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2438 traces tagged "gauss"
FrameSaver: q=442374 n=38087 tag=gauss
wclsFrameSaver: saving 3929 traces tagged "wiener"
FrameSaver: q=482583 n=31392 tag=wiener
27-Mar-2025 08:53:29 AST Opened output file with pattern "prod_muon_5GeV_protodunevd_1_166664_0_1743079043_gen_g4_stage1_g4_stage2_detsim_reco.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 5060 traces, 5060 summary
Retagger: tagging trace set: gauss with 3183 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 3183 traces tagged "gauss"
FrameSaver: q=708025 n=53961 tag=gauss
wclsFrameSaver: saving 5060 traces tagged "wiener"
FrameSaver: q=755609 n=45131 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4215 traces, 4215 summary
Retagger: tagging trace set: gauss with 2609 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2609 traces tagged "gauss"
FrameSaver: q=478488 n=41563 tag=gauss
wclsFrameSaver: saving 4215 traces tagged "wiener"
FrameSaver: q=520773 n=34289 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4106 traces, 4106 summary
Retagger: tagging trace set: gauss with 2586 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2586 traces tagged "gauss"
FrameSaver: q=435312 n=39659 tag=gauss
wclsFrameSaver: saving 4106 traces tagged "wiener"
FrameSaver: q=477731 n=32871 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4099 traces, 4099 summary
Retagger: tagging trace set: gauss with 2536 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2536 traces tagged "gauss"
FrameSaver: q=498800 n=41192 tag=gauss
wclsFrameSaver: saving 4099 traces tagged "wiener"
FrameSaver: q=542255 n=34168 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4066 traces, 4066 summary
Retagger: tagging trace set: gauss with 2497 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2497 traces tagged "gauss"
FrameSaver: q=460882 n=39650 tag=gauss
wclsFrameSaver: saving 4066 traces tagged "wiener"
FrameSaver: q=503412 n=32714 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4029 traces, 4029 summary
Retagger: tagging trace set: gauss with 2526 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2526 traces tagged "gauss"
FrameSaver: q=444575 n=39365 tag=gauss
wclsFrameSaver: saving 4029 traces tagged "wiener"
FrameSaver: q=484889 n=32486 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4006 traces, 4006 summary
Retagger: tagging trace set: gauss with 2537 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2537 traces tagged "gauss"
FrameSaver: q=445817 n=39321 tag=gauss
wclsFrameSaver: saving 4006 traces tagged "wiener"
FrameSaver: q=485992 n=32414 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4072 traces, 4072 summary
Retagger: tagging trace set: gauss with 2537 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2537 traces tagged "gauss"
FrameSaver: q=441461 n=39447 tag=gauss
wclsFrameSaver: saving 4072 traces tagged "wiener"
FrameSaver: q=483680 n=32566 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 4087 traces, 4087 summary
Retagger: tagging trace set: gauss with 2601 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 2601 traces tagged "gauss"
FrameSaver: q=441047 n=39562 tag=gauss
wclsFrameSaver: saving 4087 traces tagged "wiener"
FrameSaver: q=483084 n=32760 tag=wiener
27-Mar-2025 09:05:03 AST Closed output file "prod_muon_5GeV_protodunevd_1_166664_0_1743079043_gen_g4_stage1_g4_stage2_detsim_reco.root"
27-Mar-2025 09:05:03 AST Closed input file "prod_muon_5GeV_protodunevd_1_166664_0_1743079043_gen_g4_stage1_g4_stage2_detsim.root"
=================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
=================================================================================================================================
Full event 72.63 75.7773 80.6412 74.3622 2.79404 10
---------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000564741 0.163412 1.62751 0.000742718 0.488034 10
reco:rns:RandomNumberSaver 3.8951e-05 7.1928e-05 0.000340532 4.01465e-05 8.9735e-05 10
reco:wclsdatavd:WireCellToolkit 71.9042 74.7289 79.8746 73.0643 2.59112 10
reco:gaushit:GausHitFinder 0.0421287 0.0505259 0.085284 0.0451349 0.0121435 10
reco:reco3d:SpacePointSolver 0.278956 0.293673 0.35556 0.286997 0.0215182 10
reco:hitpdune:DisambigFromSpacePoints 0.00507114 0.00595353 0.00823897 0.00565601 0.000905411 10
reco:pandora:StandardPandora 0.249817 0.44113 1.81995 0.284837 0.461791 10
reco:pandoraTrack:LArPandoraTrackCreation 0.00532696 0.00783376 0.0146413 0.00720502 0.00263429 10
reco:pandoraShower:LArPandoraShowerCreation 0.00251602 0.00422646 0.00870435 0.00376336 0.00171828 10
reco:pandoraStdcalo:Calorimetry 0.00904357 0.0102468 0.0137655 0.00967518 0.00135983 10
reco:pandoraGnocalo:GnocchiCalorimetry 0.00304299 0.00338295 0.00490365 0.00314885 0.00054786 10
[art]:TriggerResults:TriggerResultInserter 1.9117e-05 2.60649e-05 5.5747e-05 2.1005e-05 1.07691e-05 10
end_path:out1:RootOutput 4.111e-06 5.7637e-06 1.6534e-05 4.4185e-06 3.62204e-06 10
end_path:out1:RootOutput(write) 0.0576837 0.0616002 0.0749734 0.0601235 0.00501574 10
=================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3441.46 MB
Peak resident set size usage (VmHWM): 1467.37 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_muon_5GeV_protodunevd_1_166664_0_1743079043_gen_g4_stage1_g4_stage2_detsim_reco.root', 'start_time': 1743079897.0920815, 'end_time': 1743080704.0298645}