21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 174973.16@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 174973.16@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 6202 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-04-09 16:57:48 | |
| Site | UK_Manchester | |
| Entry | UBoone_T2_UK_Manchester_ce02 | |
| Last heartbeat | 2025-04-09 17:20:15 | |
| From worker node | Hostname | wn6219301.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7702P 64-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 257400 (71 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | stalled | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-04-09 17:00:15 | |
| Input files | monte-carlo-006202-000800 | |
| Outputting started | 2025-04-09 17:18:49 | |
| Output files | ||
| Finished | 2025-04-09 18:23:48 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
rResults:TriggerResultInserter 2.152e-05 2.87792e-05 6.6615e-05 2.3645e-05 1.29218e-05 10
end_path:out1:RootOutput 4.238e-06 6.7596e-06 2.2973e-05 5.044e-06 5.42524e-06 10
end_path:out1:RootOutput(write) 0.207751 0.215325 0.221515 0.215764 0.00354784 10
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3111.99 MB
Peak resident set size usage (VmHWM): 1445.12 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_207Bi_ion_nest_protodunehd_1_174973_16_1744218123_gen_g4_stage1_g4_stage2_detsim_reco.root'}
ana
Running ana
['lar', '-c', 'runSingleHit_PDHD_multi.fcl', 'prod_207Bi_ion_nest_protodunehd_1_174973_16_1744218123_gen_g4_stage1_g4_stage2_detsim_reco.root', '-n', '-1', '-T', 'prod_207Bi_ion_nest_protodunehd_1_174973_16_1744218123_gen_g4_stage1_g4_stage2_detsim_reco_ana_tfile.root']
Stdout:
%MSG-i MF_INIT_OK: Early 09-Apr-2025 18:18:24 BST JobSetup
Messagelogger initialization complete.
%MSG
%MSG-i AuxDetGeometryCore: Early 09-Apr-2025 18:18:28 BST JobSetup
New detector geometry loaded from
/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_04_07d00/gdml/protodunehd_v6_refactored.gdml
%MSG
%MSG-i GeometryCore: Early 09-Apr-2025 18:18:28 BST JobSetup
Sorting volumes...
%MSG
%MSG-i GeometryCore: Early 09-Apr-2025 18:18:28 BST JobSetup
New detector geometry loaded from
/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_04_07d00/gdml/protodunehd_v6_refactored.gdml
%MSG
%MSG-i DuneApaWireReadoutGeom: Early 09-Apr-2025 18:18:28 BST JobSetup
Initializing wire readout...
%MSG
Cryostat 0:
10240 total channels
4 APAs
For all identical APA:
Number of channels per APA = 2560
U channels per APA = 800
V channels per APA = 800
Z channels per APA = 960
Pitch in U Plane = 0.4669
Pitch in V Plane = 0.4669
Pitch in Z Plane = 0.4792
%MSG-i SimpleChannelStatusService: Early 09-Apr-2025 18:18:28 BST JobSetup
Loaded from configuration:
- 0 bad channels
- 0 noisy channels
- largest channel ID: 10239, largest present: 10239
%MSG
%MSG-i setupProvider<DetectorPropertiesStandard>: Early 09-Apr-2025 18:18:28 BST JobSetup
Asked to ignore 1 keys: 'InheritNumberTimeSamples'
%MSG
IFDH constructor, got keys:
service_type,
IFDH: didn't find a base uri...
09-Apr-2025 18:18:29 BST Initiating request to open input file "prod_207Bi_ion_nest_protodunehd_1_174973_16_1744218123_gen_g4_stage1_g4_stage2_detsim_reco.root"
%MSG-i Root_Information: SingleHit:r5@Construction TClass::Init() 09-Apr-2025 18:18:30 BST ModuleConstruction
no dictionary for class sim::IDE is available
ROOT severity: 2000
%MSG
09-Apr-2025 18:18:30 BST Opened input file "prod_207Bi_ion_nest_protodunehd_1_174973_16_1744218123_gen_g4_stage1_g4_stage2_detsim_reco.root"
Begin processing the 1st record. run: 1 subRun: 0 event: 1 at 09-Apr-2025 18:18:30 BST
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 18:18:30 BST run: 1 subRun: 0 event: 1
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 2nd record. run: 1 subRun: 0 event: 2 at 09-Apr-2025 18:18:33 BST
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 18:18:33 BST run: 1 subRun: 0 event: 2
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 3rd record. run: 1 subRun: 0 event: 3 at 09-Apr-2025 18:18:35 BST
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 18:18:35 BST run: 1 subRun: 0 event: 3
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 4th record. run: 1 subRun: 0 event: 4 at 09-Apr-2025 18:18:39 BST
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 18:18:39 BST run: 1 subRun: 0 event: 4
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 5th record. run: 1 subRun: 0 event: 5 at 09-Apr-2025 18:18:40 BST
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 18:18:40 BST run: 1 subRun: 0 event: 5
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 6th record. run: 1 subRun: 0 event: 6 at 09-Apr-2025 18:18:41 BST
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 18:18:41 BST run: 1 subRun: 0 event: 6
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 7th record. run: 1 subRun: 0 event: 7 at 09-Apr-2025 18:18:44 BST
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 18:18:44 BST run: 1 subRun: 0 event: 7
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 8th record. run: 1 subRun: 0 event: 8 at 09-Apr-2025 18:18:45 BST
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 18:18:45 BST run: 1 subRun: 0 event: 8
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 9th record. run: 1 subRun: 0 event: 9 at 09-Apr-2025 18:18:46 BST
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 18:18:46 BST run: 1 subRun: 0 event: 9
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 10th record. run: 1 subRun: 0 event: 10 at 09-Apr-2025 18:18:47 BST
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 18:18:47 BST run: 1 subRun: 0 event: 10
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
09-Apr-2025 18:18:49 BST Closed input file "prod_207Bi_ion_nest_protodunehd_1_174973_16_1744218123_gen_g4_stage1_g4_stage2_detsim_reco.root"
====================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================
Full event 0.741797 1.83689 4.11004 1.70439 0.966606 10
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000198805 0.000300258 0.000981011 0.000223622 0.000227634 10
end_path:r1:SingleHit 0.226561 0.437507 0.883681 0.42451 0.189367 10
end_path:r2:SingleHit 0.139923 0.41225 0.945284 0.386538 0.226428 10
end_path:r3:SingleHit 0.114974 0.368375 0.859308 0.306603 0.206071 10
end_path:r4:SingleHit 0.12443 0.32506 0.799374 0.281557 0.198973 10
end_path:r5:SingleHit 0.13057 0.292413 0.621284 0.255375 0.158005 10
====================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 1516.1 MB
Peak resident set size usage (VmHWM): 449.413 MB
Details saved in: 'mem.db'
====================================================================================================
TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0
TrigReport ---------- Modules in End-path ----------
TrigReport Run Success Error Name
TrigReport 10 10 0 r1
TrigReport 10 10 0 r2
TrigReport 10 10 0 r3
TrigReport 10 10 0 r4
TrigReport 10 10 0 r5
TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 17.935400 Real = 18.482783
MemReport ---------- Memory summary [base-10 MB] ------
MemReport VmPeak = 1516.1 VmHWM = 449.413
Art has completed and will exit with status 0.
Stderr:
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_04_07d00/gdml/protodunehd_v6_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
{'art_out': 'prod_207Bi_ion_nest_protodunehd_1_174973_16_1744218123_gen_g4_stage1_g4_stage2_detsim_reco_ana.root', 'tfile_out': 'prod_207Bi_ion_nest_protodunehd_1_174973_16_1744218123_gen_g4_stage1_g4_stage2_detsim_reco_ana_tfile.root', 'start_time': 1744219095.816266, 'end_time': 1744219129.5921793}