Jobsub ID 166697.7@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 166697.7@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 5746 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-03-27 13:27:15 | |
| Site | UK_Edinburgh | |
| Entry | DUNE_UK_SGridECDF_ce1_multicore | |
| Last heartbeat | 2025-03-27 13:40:38 | |
| From worker node | Hostname | node2b07.ecdf.ed.ac.uk |
| cpuinfo | Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-03-27 13:28:05 | |
| Input files | monte-carlo-005746-000993 | |
| Jobscript | Exit code | 0 |
| Real time | 10m (659s) | |
| CPU time | 10m (648s = 98%) | |
| Max RSS bytes | 1729445888 (1649 MiB) | |
| Outputting started | 2025-03-27 13:39:05 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_7_1743082093_gen.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_7_1743082093_gen_g4_stage1_g4_stage2.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_7_1743082093_gen_g4_stage1_g4_stage2_detsim_reco.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_7_1743082093_gen_g4_stage1_g4_stage2_detsim_reco.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_7_1743082093_gen_g4_stage1_g4_stage2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_7_1743082093_gen_g4_stage1.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_7_1743082093_gen_g4_stage1.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_7_1743082093_gen_g4_stage1_g4_stage2_detsim.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_7_1743082093_gen.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_7_1743082093_gen.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_7_1743082093_gen_g4_stage1_g4_stage2_detsim_reco.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_7_1743082093_gen_g4_stage1_g4_stage2.err https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_7_1743082093_gen_g4_stage1_g4_stage2_detsim.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_7_1743082093_gen_g4_stage1.log https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/pdvd_muon/05746/1/015/prod_muon_400MeV_protodunevd_1_166697_7_1743082093_gen_g4_stage1_g4_stage2_detsim.err | |
| Finished | 2025-03-27 13:40:38 | |
| Saved logs | justin-logs:166697.7-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
7
0 1.45634e+07
1 1.43766e+07
2 1.43355e+07
3 1.43208e+07
4 1.43137e+07
Now with regularization...
Begin: 1.33862e+07
0 1.33797e+07
Art has completed and will exit with status 0.
Stderr:
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
emtrkmichelid
nhitsfilter
pandoraWriter
pandoracalipid
pandorapid
trigfilter
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/8e14053062785f80c03da35c9e53597243e9b1b5/protodunevd_v4_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16499 nodes/ 2408 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
27-Mar-2025 13:33:43 GMT Initiating request to open input file "prod_muon_400MeV_protodunevd_1_166697_7_1743082093_gen_g4_stage1_g4_stage2_detsim.root"
27-Mar-2025 13:33:43 GMT Opened input file "prod_muon_400MeV_protodunevd_1_166697_7_1743082093_gen_g4_stage1_g4_stage2_detsim.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1738 traces, 1738 summary
Retagger: tagging trace set: gauss with 1195 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1195 traces tagged "gauss"
FrameSaver: q=141482 n=16964 tag=gauss
wclsFrameSaver: saving 1738 traces tagged "wiener"
FrameSaver: q=161880 n=14756 tag=wiener
27-Mar-2025 13:34:16 GMT Opened output file with pattern "prod_muon_400MeV_protodunevd_1_166697_7_1743082093_gen_g4_stage1_g4_stage2_detsim_reco.root"
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1534 traces, 1534 summary
Retagger: tagging trace set: gauss with 1139 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1139 traces tagged "gauss"
FrameSaver: q=136163 n=15344 tag=gauss
wclsFrameSaver: saving 1534 traces tagged "wiener"
FrameSaver: q=154241 n=13396 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1668 traces, 1668 summary
Retagger: tagging trace set: gauss with 1178 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1178 traces tagged "gauss"
FrameSaver: q=141007 n=16840 tag=gauss
wclsFrameSaver: saving 1668 traces tagged "wiener"
FrameSaver: q=160009 n=14543 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1629 traces, 1629 summary
Retagger: tagging trace set: gauss with 1159 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1159 traces tagged "gauss"
FrameSaver: q=140383 n=16432 tag=gauss
wclsFrameSaver: saving 1629 traces tagged "wiener"
FrameSaver: q=159873 n=14291 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1616 traces, 1616 summary
Retagger: tagging trace set: gauss with 1166 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1166 traces tagged "gauss"
FrameSaver: q=138329 n=16046 tag=gauss
wclsFrameSaver: saving 1616 traces tagged "wiener"
FrameSaver: q=157276 n=13972 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1675 traces, 1675 summary
Retagger: tagging trace set: gauss with 1180 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1180 traces tagged "gauss"
FrameSaver: q=142208 n=16645 tag=gauss
wclsFrameSaver: saving 1675 traces tagged "wiener"
FrameSaver: q=161410 n=14462 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1630 traces, 1630 summary
Retagger: tagging trace set: gauss with 1181 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1181 traces tagged "gauss"
FrameSaver: q=143451 n=16335 tag=gauss
wclsFrameSaver: saving 1630 traces tagged "wiener"
FrameSaver: q=162011 n=14259 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1601 traces, 1601 summary
Retagger: tagging trace set: gauss with 1179 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1179 traces tagged "gauss"
FrameSaver: q=137862 n=15923 tag=gauss
wclsFrameSaver: saving 1601 traces tagged "wiener"
FrameSaver: q=155895 n=13907 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1655 traces, 1655 summary
Retagger: tagging trace set: gauss with 1163 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1163 traces tagged "gauss"
FrameSaver: q=138528 n=16512 tag=gauss
wclsFrameSaver: saving 1655 traces tagged "wiener"
FrameSaver: q=158068 n=14359 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 1594 traces, 1594 summary
Retagger: tagging trace set: gauss with 1123 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 1123 traces tagged "gauss"
FrameSaver: q=138174 n=15761 tag=gauss
wclsFrameSaver: saving 1594 traces tagged "wiener"
FrameSaver: q=156682 n=13596 tag=wiener
27-Mar-2025 13:39:04 GMT Closed output file "prod_muon_400MeV_protodunevd_1_166697_7_1743082093_gen_g4_stage1_g4_stage2_detsim_reco.root"
27-Mar-2025 13:39:04 GMT Closed input file "prod_muon_400MeV_protodunevd_1_166697_7_1743082093_gen_g4_stage1_g4_stage2_detsim.root"
=================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
=================================================================================================================================
Full event 31.4727 31.9433 32.7944 31.8049 0.452595 10
---------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000278477 0.000359286 0.0004893 0.000361628 5.7492e-05 10
reco:rns:RandomNumberSaver 2.7274e-05 4.71114e-05 0.000173099 3.4682e-05 4.20947e-05 10
reco:wclsdatavd:WireCellToolkit 31.2429 31.6067 32.5849 31.476 0.378295 10
reco:gaushit:GausHitFinder 0.0119685 0.0125534 0.013235 0.0125018 0.000385828 10
reco:reco3d:SpacePointSolver 0.0432333 0.0506607 0.066157 0.0498104 0.00570941 10
reco:hitpdune:DisambigFromSpacePoints 0.00124227 0.00163356 0.0027406 0.00149111 0.000409922 10
reco:pandora:StandardPandora 0.125528 0.241884 1.12528 0.147272 0.294721 10
reco:pandoraTrack:LArPandoraTrackCreation 0.00114908 0.00184366 0.00310533 0.00174336 0.000477859 10
reco:pandoraShower:LArPandoraShowerCreation 0.000135196 0.000278935 0.00112278 0.000149697 0.000296452 10
reco:pandoraStdcalo:Calorimetry 0.000871299 0.0011265 0.00255118 0.000960107 0.000479307 10
reco:pandoraGnocalo:GnocchiCalorimetry 0.000580277 0.000757895 0.00168279 0.000660797 0.00031251 10
[art]:TriggerResults:TriggerResultInserter 9.851e-06 1.40215e-05 3.3176e-05 1.14415e-05 6.68901e-06 10
end_path:out1:RootOutput 2.246e-06 4.5489e-06 1.1394e-05 4.1615e-06 2.40098e-06 10
end_path:out1:RootOutput(write) 0.0211247 0.0226834 0.0258381 0.022322 0.00134669 10
=================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3270.25 MB
Peak resident set size usage (VmHWM): 1521.81 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_muon_400MeV_protodunevd_1_166697_7_1743082093_gen_g4_stage1_g4_stage2_detsim_reco.root', 'start_time': 1743082404.045943, 'end_time': 1743082745.5806506}