21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 365943.16@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 365943.16@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 6202 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-04-09 12:50:36 | |
| Site | UK_RAL-Tier1 | |
| Entry | LIGO_UK_RAL_arc_ce03 | |
| Last heartbeat | 2025-04-09 13:19:23 | |
| From worker node | Hostname | dune001-5557847.0-lcg2564.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 216000 (60 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | stalled | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-04-09 13:03:49 | |
| Input files | monte-carlo-006202-000800 | |
| Outputting started | 2025-04-09 13:19:23 | |
| Output files | ||
| Finished | 2025-04-09 14:18:49 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
Results:TriggerResultInserter 1.646e-05 2.90263e-05 7.1591e-05 2.5425e-05 1.51431e-05 10
end_path:out1:RootOutput 4.829e-06 8.647e-06 2.915e-05 5.59e-06 7.09706e-06 10
end_path:out1:RootOutput(write) 0.138159 0.156864 0.191117 0.149072 0.0182279 10
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3262.35 MB
Peak resident set size usage (VmHWM): 1430.81 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_207Bi_ion_nest_protodunehd_1_365943_16_1744203840_gen_g4_stage1_g4_stage2_detsim_reco.root'}
ana
Running ana
['lar', '-c', 'runSingleHit_PDHD_multi.fcl', 'prod_207Bi_ion_nest_protodunehd_1_365943_16_1744203840_gen_g4_stage1_g4_stage2_detsim_reco.root', '-n', '-1', '-T', 'prod_207Bi_ion_nest_protodunehd_1_365943_16_1744203840_gen_g4_stage1_g4_stage2_detsim_reco_ana_tfile.root']
Stdout:
%MSG-i MF_INIT_OK: Early 09-Apr-2025 13:18:54 UTC JobSetup
Messagelogger initialization complete.
%MSG
%MSG-i AuxDetGeometryCore: Early 09-Apr-2025 13:19:07 UTC JobSetup
New detector geometry loaded from
/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_04_07d00/gdml/protodunehd_v6_refactored.gdml
%MSG
%MSG-i GeometryCore: Early 09-Apr-2025 13:19:07 UTC JobSetup
Sorting volumes...
%MSG
%MSG-i GeometryCore: Early 09-Apr-2025 13:19:07 UTC JobSetup
New detector geometry loaded from
/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_04_07d00/gdml/protodunehd_v6_refactored.gdml
%MSG
%MSG-i DuneApaWireReadoutGeom: Early 09-Apr-2025 13:19:07 UTC JobSetup
Initializing wire readout...
%MSG
Cryostat 0:
10240 total channels
4 APAs
For all identical APA:
Number of channels per APA = 2560
U channels per APA = 800
V channels per APA = 800
Z channels per APA = 960
Pitch in U Plane = 0.4669
Pitch in V Plane = 0.4669
Pitch in Z Plane = 0.4792
%MSG-i SimpleChannelStatusService: Early 09-Apr-2025 13:19:07 UTC JobSetup
Loaded from configuration:
- 0 bad channels
- 0 noisy channels
- largest channel ID: 10239, largest present: 10239
%MSG
%MSG-i setupProvider<DetectorPropertiesStandard>: Early 09-Apr-2025 13:19:07 UTC JobSetup
Asked to ignore 1 keys: 'InheritNumberTimeSamples'
%MSG
IFDH constructor, got keys:
service_type,
IFDH: didn't find a base uri...
09-Apr-2025 13:19:08 UTC Initiating request to open input file "prod_207Bi_ion_nest_protodunehd_1_365943_16_1744203840_gen_g4_stage1_g4_stage2_detsim_reco.root"
%MSG-i Root_Information: SingleHit:r5@Construction TClass::Init() 09-Apr-2025 13:19:08 UTC ModuleConstruction
no dictionary for class sim::IDE is available
ROOT severity: 2000
%MSG
09-Apr-2025 13:19:08 UTC Opened input file "prod_207Bi_ion_nest_protodunehd_1_365943_16_1744203840_gen_g4_stage1_g4_stage2_detsim_reco.root"
Begin processing the 1st record. run: 1 subRun: 0 event: 1 at 09-Apr-2025 13:19:09 UTC
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 13:19:09 UTC run: 1 subRun: 0 event: 1
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 2nd record. run: 1 subRun: 0 event: 2 at 09-Apr-2025 13:19:10 UTC
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 13:19:10 UTC run: 1 subRun: 0 event: 2
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 3rd record. run: 1 subRun: 0 event: 3 at 09-Apr-2025 13:19:11 UTC
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 13:19:11 UTC run: 1 subRun: 0 event: 3
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 4th record. run: 1 subRun: 0 event: 4 at 09-Apr-2025 13:19:15 UTC
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 13:19:15 UTC run: 1 subRun: 0 event: 4
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 5th record. run: 1 subRun: 0 event: 5 at 09-Apr-2025 13:19:16 UTC
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 13:19:16 UTC run: 1 subRun: 0 event: 5
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 6th record. run: 1 subRun: 0 event: 6 at 09-Apr-2025 13:19:16 UTC
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 13:19:16 UTC run: 1 subRun: 0 event: 6
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 7th record. run: 1 subRun: 0 event: 7 at 09-Apr-2025 13:19:18 UTC
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 13:19:18 UTC run: 1 subRun: 0 event: 7
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 8th record. run: 1 subRun: 0 event: 8 at 09-Apr-2025 13:19:20 UTC
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 13:19:20 UTC run: 1 subRun: 0 event: 8
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 9th record. run: 1 subRun: 0 event: 9 at 09-Apr-2025 13:19:21 UTC
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 13:19:21 UTC run: 1 subRun: 0 event: 9
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 10th record. run: 1 subRun: 0 event: 10 at 09-Apr-2025 13:19:22 UTC
%MSG-w PhotonBackTrackerService: ProcessEvent 09-Apr-2025 13:19:22 UTC run: 1 subRun: 0 event: 10
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
09-Apr-2025 13:19:22 UTC Closed input file "prod_207Bi_ion_nest_protodunehd_1_365943_16_1744203840_gen_g4_stage1_g4_stage2_detsim_reco.root"
====================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================
Full event 0.527751 1.36292 3.51724 1.00346 0.88891 10
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000193382 0.000287087 0.00085761 0.000226208 0.000190938 10
end_path:r1:SingleHit 0.127081 0.336428 0.655471 0.32121 0.189105 10
end_path:r2:SingleHit 0.116421 0.299969 0.716308 0.217259 0.190485 10
end_path:r3:SingleHit 0.102294 0.259861 0.77284 0.183194 0.197967 10
end_path:r4:SingleHit 0.0971237 0.257816 0.713696 0.193391 0.178786 10
end_path:r5:SingleHit 0.0756236 0.207573 0.65778 0.14522 0.167418 10
====================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 1513.97 MB
Peak resident set size usage (VmHWM): 451.985 MB
Details saved in: 'mem.db'
====================================================================================================
TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0
TrigReport ---------- Modules in End-path ----------
TrigReport Run Success Error Name
TrigReport 10 10 0 r1
TrigReport 10 10 0 r2
TrigReport 10 10 0 r3
TrigReport 10 10 0 r4
TrigReport 10 10 0 r5
TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 13.562809 Real = 13.716936
MemReport ---------- Memory summary [base-10 MB] ------
MemReport VmPeak = 1513.97 VmHWM = 451.985
Art has completed and will exit with status 0.
Stderr:
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_04_07d00/gdml/protodunehd_v6_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
{'art_out': 'prod_207Bi_ion_nest_protodunehd_1_365943_16_1744203840_gen_g4_stage1_g4_stage2_detsim_reco_ana.root', 'tfile_out': 'prod_207Bi_ion_nest_protodunehd_1_365943_16_1744203840_gen_g4_stage1_g4_stage2_detsim_reco_ana_tfile.root', 'start_time': 1744204726.9496086, 'end_time': 1744204762.97044}