21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 214521.0@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 214521.0@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 7321 | |
| Stage ID | 1 | |
| User name | sergeym@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 4 |
| GPU | No | |
| RSS bytes | 15728640000 (15000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-06-04 20:59:46 | |
| Site | UK_Lancaster | |
| Entry | UBoone_UK_Lancaster_HEC_grendel_ce02 | |
| Last heartbeat | 2025-06-05 05:19:21 | |
| From worker node | Hostname | comp15-03 |
| cpuinfo | AMD EPYC 9654 96-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 4 | |
| RSS bytes | 15728640000 (15000 MiB) | |
| Wall seconds limit | 257400 (71 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | jobscript_error | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-06-04 22:01:27 | |
| Input files | ||
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) | |
| CPU time | 0m (0s = 0%) | |
| Max RSS bytes | 0 (0 MiB) | |
| Outputting started | ||
| Output files | ||
| Finished | 2025-06-05 05:19:21 | |
| Saved logs | justin-logs:214521.0-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory: ProcessEvent 05-Jun-2025 05:56:34 BST run: 1 subRun: 0 event: 29
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory: ProcessEvent 05-Jun-2025 05:56:34 BST run: 1 subRun: 0 event: 29
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService: ProcessEvent 05-Jun-2025 05:56:34 BST run: 1 subRun: 0 event: 29
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService: larg4Main:largeant@BeginModule 05-Jun-2025 05:56:34 BST run: 1 subRun: 0 event: 29
Random seed for this event, engine 'largeant': 822842984
%MSG
%MSG-i generatePrimaries: larg4Main:largeant@BeginModule 05-Jun-2025 05:56:34 BST run: 1 subRun: 0 event: 29 MCTruthEventAction.cc:112
Generating 0 particles
%MSG
%MSG-i generatePrimaries: larg4Main:largeant@BeginModule 05-Jun-2025 05:56:34 BST run: 1 subRun: 0 event: 29 MCTruthEventAction.cc:112
Generating 512 particles
%MSG
%MSG-i generatePrimaries: larg4Main:largeant@BeginModule 05-Jun-2025 05:56:34 BST run: 1 subRun: 0 event: 29 MCTruthEventAction.cc:112
Generating 2 particles
%MSG
%MSG-i generatePrimaries: larg4Main:largeant@BeginModule 05-Jun-2025 05:56:34 BST run: 1 subRun: 0 event: 29 MCTruthEventAction.cc:112
Generating 4520 particles
%MSG
%MSG-i generatePrimaries: larg4Main:largeant@BeginModule 05-Jun-2025 05:56:34 BST run: 1 subRun: 0 event: 29 MCTruthEventAction.cc:112
Generating 737 particles
%MSG
%MSG-w beginOfEventAction::keepableGenerators: larg4Main:largeant@BeginModule 05-Jun-2025 05:56:34 BST run: 1 subRun: 0 event: 29
storeTrajectories set to true and a non-empty keepGenTrajectories list provided in configuration file, but none of the generators in this list are present in the event! Double check list or don't provide keepGenTrajectories in the configuration to keep all trajectories from all generator labels. This may be expected for generators that have a nonzero probability of producing no particles (e.g. some radiologicals)
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 05-Jun-2025 05:56:44 BST run: 1 subRun: 0 event: 29 ParticleListAction.cc:817
MCTruth Handles Size: 5
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 05-Jun-2025 05:56:44 BST run: 1 subRun: 0 event: 29 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 05-Jun-2025 05:56:44 BST run: 1 subRun: 0 event: 29 ParticleListAction.cc:830
Found 0 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 05-Jun-2025 05:56:44 BST run: 1 subRun: 0 event: 29 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 05-Jun-2025 05:56:44 BST run: 1 subRun: 0 event: 29 ParticleListAction.cc:830
Found 512 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 05-Jun-2025 05:56:44 BST run: 1 subRun: 0 event: 29 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 05-Jun-2025 05:56:44 BST run: 1 subRun: 0 event: 29 ParticleListAction.cc:830
Found 2 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 05-Jun-2025 05:56:45 BST run: 1 subRun: 0 event: 29 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 05-Jun-2025 05:56:45 BST run: 1 subRun: 0 event: 29 ParticleListAction.cc:830
Found 4520 particles
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 05-Jun-2025 05:56:45 BST run: 1 subRun: 0 event: 29 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 05-Jun-2025 05:56:45 BST run: 1 subRun: 0 event: 29 ParticleListAction.cc:830
Found 737 particles
%MSG
%MSG-i NuRandomService: IonAndScint:IonAndScint@BeginModule 05-Jun-2025 05:56:46 BST run: 1 subRun: 0 event: 29
Random seed for this event, engine 'IonAndScint.ISCalcAlg': 77084316
%MSG
IonAndScint Module Producer
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService: IonAndScint:IonAndScintExternal@BeginModule 05-Jun-2025 05:56:47 BST run: 1 subRun: 0 event: 29
Random seed for this event, engine 'IonAndScintExternal.ISCalcAlg': 224500787
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in:
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService: PDFastSimPAR:PDFastSim@BeginModule 05-Jun-2025 05:56:47 BST run: 1 subRun: 0 event: 29
Random seed for this event, engine 'PDFastSim.photon': 444864545
%MSG
%MSG-i NuRandomService: PDFastSimPAR:PDFastSim@BeginModule 05-Jun-2025 05:56:47 BST run: 1 subRun: 0 event: 29
Random seed for this event, engine 'PDFastSim.scinttime': 500947638
%MSG
%MSG-i NuRandomService: PDFastSimPVS:PDFastSimExternal@BeginModule 05-Jun-2025 06:18:17 BST run: 1 subRun: 0 event: 29
Random seed for this event, engine 'PDFastSimExternal.photon': 503481889
%MSG
%MSG-i NuRandomService: PDFastSimPVS:PDFastSimExternal@BeginModule 05-Jun-2025 06:18:17 BST run: 1 subRun: 0 event: 29
Random seed for this event, engine 'PDFastSimExternal.scinttime': 889952273
%MSG
IonAndScint endJob.
IonAndScint endJob.
05-Jun-2025 06:18:21 BST Closed input file "gen.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 475.447 878.015 1303.09 889.511 186.341 29
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000681167 0.0187628 0.044924 0.0169762 0.00745155 29
simulate:rns:RandomNumberSaver 4.873e-05 0.000821764 0.0146186 5.791e-05 0.00293628 29
simulate:largeant:larg4Main 9.59435 11.2567 12.6076 11.1698 0.703736 29
simulate:IonAndScint:IonAndScint 0.404099 0.551684 0.806714 0.544068 0.0833676 29
simulate:IonAndScintExternal:IonAndScint 0.0200118 0.0379611 0.0461222 0.0379602 0.00451345 29
simulate:PDFastSim:PDFastSimPAR 436.431 830.934 1289.71 834.2 185.397 29
simulate:PDFastSimExternal:PDFastSimPVS 0.078412 0.528453 5.84466 0.321117 1.03469 29
[art]:TriggerResults:TriggerResultInserter 1.363e-05 1.64247e-05 5.3341e-05 1.513e-05 7.02148e-06 29
end_path:out1:RootOutput 3.25e-06 4.30148e-06 1.4901e-05 3.92e-06 2.02569e-06 29
end_path:out1:RootOutput(write) 28.7768 35.9033 47.3999 36.3995 4.06555 28
================================================================================================================================
%MSG-i NuRandomService: RootOutput:out1@EndJob 05-Jun-2025 06:18:21 BST ModuleEndJob
Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
algorithm version: EventTimestamp_v1
Configured value Last value ModuleLabel.InstanceName
(per event) 77084316 IonAndScint.ISCalcAlg
(per event) 224500787 IonAndScintExternal.ISCalcAlg
(per event) 444864545 PDFastSim.photon
(per event) 500947638 PDFastSim.scinttime
(per event) 503481889 PDFastSimExternal.photon
(per event) 889952273 PDFastSimExternal.scinttime
(per event) 822842984 largeant
%MSG
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 11346.3 MB
Peak resident set size usage (VmHWM): 10216.4 MB
====================================================================================================
TrigReport ---------- Event summary -------------
TrigReport Events total = 29 passed = 29 failed = 0
TrigReport ---------- Modules in End-path ----------
TrigReport Run Success Error Name
TrigReport 29 29 0 out1
TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 25466.834453 Real = 25636.289550
MemReport ---------- Memory summary [base-10 MB] ------
MemReport VmPeak = 11346.3 VmHWM = 10216.4
%MSG-s ArtException: PostEndJob 05-Jun-2025 06:19:02 BST ModuleEndJob
---- EventProcessorFailure BEGIN
EventProcessor: an exception occurred during current event processing
---- FatalRootError BEGIN
Fatal Root Error: TBufferFile::WriteByteCount
bytecount too large (more than 1073741822)
ROOT severity: 3000
---- FatalRootError END
---- EventProcessorFailure END
---- FatalRootError BEGIN
Fatal Root Error: TTree::SetEntries
Tree branches have different numbers of entries, eg EventAuxiliary has 28 entries while simb::MCTruths_k42fromar42__SinglesGen. has 50 entries.
ROOT severity: 2000
---- FatalRootError END
%MSG
Art has completed and will exit with status 1.
Error running g4. Exiting with 1