21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 365946.46@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 365946.46@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 6202 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-04-09 12:51:48 | |
| Site | UK_RAL-Tier1 | |
| Entry | LIGO_UK_RAL_arc_ce01 | |
| Last heartbeat | 2025-04-09 13:17:16 | |
| From worker node | Hostname | dune001-6008902.0-lcg2396.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 216000 (60 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | stalled | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-04-09 13:05:09 | |
| Input files | monte-carlo-006202-000903 | |
| Outputting started | 2025-04-09 13:17:16 | |
| Output files | ||
| Finished | 2025-04-09 14:18:31 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
sults:TriggerResultInserter 1.3224e-05 2.46533e-05 0.000104246 1.60705e-05 2.6631e-05 10
end_path:out1:RootOutput 3.437e-06 9.2846e-06 3.8623e-05 4.3985e-06 1.09875e-05 10
end_path:out1:RootOutput(write) 0.113586 0.137241 0.164453 0.140702 0.0203029 10
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3244.79 MB
Peak resident set size usage (VmHWM): 1445.64 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_207Bi_ion_nest_protodunehd_1_365946_46_1744203918_gen_g4_stage1_g4_stage2_detsim_reco.root'}
ana
Running ana
['lar', '-c', 'runSingleHit_PDHD_multi.fcl', 'prod_207Bi_ion_nest_protodunehd_1_365946_46_1744203918_gen_g4_stage1_g4_stage2_detsim_reco.root', '-n', '-1', '-T', 'prod_207Bi_ion_nest_protodunehd_1_365946_46_1744203918_gen_g4_stage1_g4_stage2_detsim_reco_ana_tfile.root']
Stdout:
%MSG-i MF_INIT_OK: Early 09-Apr-2025 13:16:59 UTC JobSetup
Messagelogger initialization complete.
%MSG
%MSG-i AuxDetGeometryCore: Early 09-Apr-2025 13:17:03 UTC JobSetup
New detector geometry loaded from
/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_04_07d00/gdml/protodunehd_v6_refactored.gdml
%MSG
%MSG-i GeometryCore: Early 09-Apr-2025 13:17:03 UTC JobSetup
Sorting volumes...
%MSG
%MSG-i GeometryCore: Early 09-Apr-2025 13:17:03 UTC JobSetup
New detector geometry loaded from
/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_04_07d00/gdml/protodunehd_v6_refactored.gdml
%MSG
%MSG-i DuneApaWireReadoutGeom: Early 09-Apr-2025 13:17:03 UTC JobSetup
Initializing wire readout...
%MSG
Cryostat 0:
10240 total channels
4 APAs
For all identical APA:
Number of channels per APA = 2560
U channels per APA = 800
V channels per APA = 800
Z channels per APA = 960
Pitch in U Plane = 0.4669
Pitch in V Plane = 0.4669
Pitch in Z Plane = 0.4792
%MSG-i SimpleChannelStatusService: Early 09-Apr-2025 13:17:03 UTC JobSetup
Loaded from configuration:
- 0 bad channels
- 0 noisy channels
- largest channel ID: 10239, largest present: 10239
%MSG
%MSG-i setupProvider<DetectorPropertiesStandard>: Early 09-Apr-2025 13:17:03 UTC JobSetup
Asked to ignore 1 keys: 'InheritNumberTimeSamples'
%MSG
IFDH constructor, got keys:
service_type,
IFDH: didn't find a base uri...
09-Apr-2025 13:17:03 UTC Initiating request to open input file "prod_207Bi_ion_nest_protodunehd_1_365946_46_1744203918_gen_g4_stage1_g4_stage2_detsim_reco.root"
%MSG-i Root_Information: SingleHit:r5@Construction TClass::Init() 09-Apr-2025 13:17:04 UTC ModuleConstruction
no dictionary for class sim::IDE is available
ROOT severity: 2000
%MSG
09-Apr-2025 13:17:04 UTC Opened input file "prod_207Bi_ion_nest_protodunehd_1_365946_46_1744203918_gen_g4_stage1_g4_stage2_detsim_reco.root"
Begin processing the 1st record. run: 1 subRun: 0 event: 1 at 09-Apr-2025 13:17:05 UTC
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 13:17:05 UTC run: 1 subRun: 0 event: 1
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 2nd record. run: 1 subRun: 0 event: 2 at 09-Apr-2025 13:17:06 UTC
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 13:17:06 UTC run: 1 subRun: 0 event: 2
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 3rd record. run: 1 subRun: 0 event: 3 at 09-Apr-2025 13:17:07 UTC
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 13:17:07 UTC run: 1 subRun: 0 event: 3
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 4th record. run: 1 subRun: 0 event: 4 at 09-Apr-2025 13:17:08 UTC
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 13:17:08 UTC run: 1 subRun: 0 event: 4
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 5th record. run: 1 subRun: 0 event: 5 at 09-Apr-2025 13:17:10 UTC
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 13:17:10 UTC run: 1 subRun: 0 event: 5
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 6th record. run: 1 subRun: 0 event: 6 at 09-Apr-2025 13:17:11 UTC
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 13:17:11 UTC run: 1 subRun: 0 event: 6
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 7th record. run: 1 subRun: 0 event: 7 at 09-Apr-2025 13:17:13 UTC
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 13:17:13 UTC run: 1 subRun: 0 event: 7
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 8th record. run: 1 subRun: 0 event: 8 at 09-Apr-2025 13:17:14 UTC
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 13:17:14 UTC run: 1 subRun: 0 event: 8
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 9th record. run: 1 subRun: 0 event: 9 at 09-Apr-2025 13:17:14 UTC
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 13:17:14 UTC run: 1 subRun: 0 event: 9
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 10th record. run: 1 subRun: 0 event: 10 at 09-Apr-2025 13:17:15 UTC
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 13:17:15 UTC run: 1 subRun: 0 event: 10
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
09-Apr-2025 13:17:15 UTC Closed input file "prod_207Bi_ion_nest_protodunehd_1_365946_46_1744203918_gen_g4_stage1_g4_stage2_detsim_reco.root"
====================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================
Full event 0.402242 1.05307 2.26939 1.02017 0.539226 10
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000183826 0.000286701 0.00109904 0.000196565 0.000270905 10
end_path:r1:SingleHit 0.0731068 0.285843 0.743781 0.273214 0.173283 10
end_path:r2:SingleHit 0.0766494 0.236314 0.479193 0.240176 0.116427 10
end_path:r3:SingleHit 0.0689577 0.192701 0.436141 0.177913 0.104163 10
end_path:r4:SingleHit 0.0717053 0.186247 0.423131 0.168797 0.109056 10
end_path:r5:SingleHit 0.076867 0.150774 0.284934 0.143681 0.0635185 10
====================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 1513.97 MB
Peak resident set size usage (VmHWM): 459.637 MB
Details saved in: 'mem.db'
====================================================================================================
TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0
TrigReport ---------- Modules in End-path ----------
TrigReport Run Success Error Name
TrigReport 10 10 0 r1
TrigReport 10 10 0 r2
TrigReport 10 10 0 r3
TrigReport 10 10 0 r4
TrigReport 10 10 0 r5
TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 10.506169 Real = 10.606399
MemReport ---------- Memory summary [base-10 MB] ------
MemReport VmPeak = 1513.97 VmHWM = 459.637
Art has completed and will exit with status 0.
Stderr:
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_04_07d00/gdml/protodunehd_v6_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
{'art_out': 'prod_207Bi_ion_nest_protodunehd_1_365946_46_1744203918_gen_g4_stage1_g4_stage2_detsim_reco_ana.root', 'tfile_out': 'prod_207Bi_ion_nest_protodunehd_1_365946_46_1744203918_gen_g4_stage1_g4_stage2_detsim_reco_ana_tfile.root', 'start_time': 1744204612.0904436, 'end_time': 1744204635.9504788}