21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 365943.27@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 365943.27@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 6202 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-04-09 12:50:36 | |
| Site | UK_QMUL | |
| Entry | DUNE_UK_London_QMUL_arcce03 | |
| Last heartbeat | 2025-04-09 13:16:21 | |
| From worker node | Hostname | cn107.htc.esc.qmul |
| cpuinfo | Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | stalled | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-04-09 13:03:01 | |
| Input files | monte-carlo-006202-000669 | |
| Outputting started | 2025-04-09 13:16:21 | |
| Output files | ||
| Finished | 2025-04-09 14:18:31 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
rResults:TriggerResultInserter 2.693e-05 3.75232e-05 7.6103e-05 3.1884e-05 1.41437e-05 10
end_path:out1:RootOutput 4.784e-06 1.00588e-05 3.5043e-05 7.645e-06 8.50388e-06 10
end_path:out1:RootOutput(write) 0.119127 0.135619 0.181675 0.126666 0.0190599 10
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3105.62 MB
Peak resident set size usage (VmHWM): 1467.34 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_207Bi_ion_nest_protodunehd_1_365943_27_1744203788_gen_g4_stage1_g4_stage2_detsim_reco.root'}
ana
Running ana
['lar', '-c', 'runSingleHit_PDHD_multi.fcl', 'prod_207Bi_ion_nest_protodunehd_1_365943_27_1744203788_gen_g4_stage1_g4_stage2_detsim_reco.root', '-n', '-1', '-T', 'prod_207Bi_ion_nest_protodunehd_1_365943_27_1744203788_gen_g4_stage1_g4_stage2_detsim_reco_ana_tfile.root']
Stdout:
%MSG-i MF_INIT_OK: Early 09-Apr-2025 14:16:04 BST JobSetup
Messagelogger initialization complete.
%MSG
%MSG-i AuxDetGeometryCore: Early 09-Apr-2025 14:16:07 BST JobSetup
New detector geometry loaded from
/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_04_07d00/gdml/protodunehd_v6_refactored.gdml
%MSG
%MSG-i GeometryCore: Early 09-Apr-2025 14:16:07 BST JobSetup
Sorting volumes...
%MSG
%MSG-i GeometryCore: Early 09-Apr-2025 14:16:07 BST JobSetup
New detector geometry loaded from
/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_04_07d00/gdml/protodunehd_v6_refactored.gdml
%MSG
%MSG-i DuneApaWireReadoutGeom: Early 09-Apr-2025 14:16:07 BST JobSetup
Initializing wire readout...
%MSG
Cryostat 0:
10240 total channels
4 APAs
For all identical APA:
Number of channels per APA = 2560
U channels per APA = 800
V channels per APA = 800
Z channels per APA = 960
Pitch in U Plane = 0.4669
Pitch in V Plane = 0.4669
Pitch in Z Plane = 0.4792
%MSG-i SimpleChannelStatusService: Early 09-Apr-2025 14:16:07 BST JobSetup
Loaded from configuration:
- 0 bad channels
- 0 noisy channels
- largest channel ID: 10239, largest present: 10239
%MSG
%MSG-i setupProvider<DetectorPropertiesStandard>: Early 09-Apr-2025 14:16:07 BST JobSetup
Asked to ignore 1 keys: 'InheritNumberTimeSamples'
%MSG
IFDH constructor, got keys:
service_type,
IFDH: didn't find a base uri...
09-Apr-2025 14:16:08 BST Initiating request to open input file "prod_207Bi_ion_nest_protodunehd_1_365943_27_1744203788_gen_g4_stage1_g4_stage2_detsim_reco.root"
%MSG-i Root_Information: SingleHit:r5@Construction TClass::Init() 09-Apr-2025 14:16:08 BST ModuleConstruction
no dictionary for class sim::IDE is available
ROOT severity: 2000
%MSG
09-Apr-2025 14:16:09 BST Opened input file "prod_207Bi_ion_nest_protodunehd_1_365943_27_1744203788_gen_g4_stage1_g4_stage2_detsim_reco.root"
Begin processing the 1st record. run: 1 subRun: 0 event: 1 at 09-Apr-2025 14:16:09 BST
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 14:16:09 BST run: 1 subRun: 0 event: 1
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 2nd record. run: 1 subRun: 0 event: 2 at 09-Apr-2025 14:16:10 BST
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 14:16:10 BST run: 1 subRun: 0 event: 2
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 3rd record. run: 1 subRun: 0 event: 3 at 09-Apr-2025 14:16:10 BST
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 14:16:10 BST run: 1 subRun: 0 event: 3
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 4th record. run: 1 subRun: 0 event: 4 at 09-Apr-2025 14:16:11 BST
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 14:16:11 BST run: 1 subRun: 0 event: 4
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 5th record. run: 1 subRun: 0 event: 5 at 09-Apr-2025 14:16:13 BST
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 14:16:13 BST run: 1 subRun: 0 event: 5
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 6th record. run: 1 subRun: 0 event: 6 at 09-Apr-2025 14:16:15 BST
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 14:16:15 BST run: 1 subRun: 0 event: 6
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 7th record. run: 1 subRun: 0 event: 7 at 09-Apr-2025 14:16:16 BST
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 14:16:16 BST run: 1 subRun: 0 event: 7
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 8th record. run: 1 subRun: 0 event: 8 at 09-Apr-2025 14:16:17 BST
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 14:16:17 BST run: 1 subRun: 0 event: 8
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 9th record. run: 1 subRun: 0 event: 9 at 09-Apr-2025 14:16:18 BST
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 14:16:18 BST run: 1 subRun: 0 event: 9
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 10th record. run: 1 subRun: 0 event: 10 at 09-Apr-2025 14:16:20 BST
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 14:16:20 BST run: 1 subRun: 0 event: 10
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
09-Apr-2025 14:16:20 BST Closed input file "prod_207Bi_ion_nest_protodunehd_1_365943_27_1744203788_gen_g4_stage1_g4_stage2_detsim_reco.root"
====================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================
Full event 0.493406 1.11393 2.07371 0.995843 0.439665 10
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00016067 0.000289197 0.001032 0.000172822 0.000253308 10
end_path:r1:SingleHit 0.0866375 0.301354 0.737192 0.273783 0.169169 10
end_path:r2:SingleHit 0.102202 0.252404 0.443399 0.234564 0.0945463 10
end_path:r3:SingleHit 0.0988896 0.209237 0.400465 0.168792 0.09895 10
end_path:r4:SingleHit 0.103724 0.174025 0.249075 0.169869 0.0498446 10
end_path:r5:SingleHit 0.0964356 0.175986 0.308883 0.159623 0.0699436 10
====================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 1516.1 MB
Peak resident set size usage (VmHWM): 461.165 MB
Details saved in: 'mem.db'
====================================================================================================
TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0
TrigReport ---------- Modules in End-path ----------
TrigReport Run Success Error Name
TrigReport 10 10 0 r1
TrigReport 10 10 0 r2
TrigReport 10 10 0 r3
TrigReport 10 10 0 r4
TrigReport 10 10 0 r5
TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 11.156854 Real = 11.716363
MemReport ---------- Memory summary [base-10 MB] ------
MemReport VmPeak = 1516.1 VmHWM = 461.165
Art has completed and will exit with status 0.
Stderr:
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_04_07d00/gdml/protodunehd_v6_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
{'art_out': 'prod_207Bi_ion_nest_protodunehd_1_365943_27_1744203788_gen_g4_stage1_g4_stage2_detsim_reco_ana.root', 'tfile_out': 'prod_207Bi_ion_nest_protodunehd_1_365943_27_1744203788_gen_g4_stage1_g4_stage2_detsim_reco_ana_tfile.root', 'start_time': 1744204559.8814323, 'end_time': 1744204581.394096}