21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 423097.5@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 423097.5@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 7956 | |
| Stage ID | 1 | |
| User name | gabrielb@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 16777216000 (16000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-06-26 23:56:29 | |
| Site | UK_Bristol | |
| Entry | CMSHTPC_T2_UK_SGrid_Bristol_lcgce02 | |
| Last heartbeat | 2025-06-27 00:52:17 | |
| From worker node | Hostname | hd79.dice.priv |
| cpuinfo | AMD EPYC 7551P 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 16777216000 (16000 MiB) | |
| Wall seconds limit | 259200 (72 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | jobscript_error | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-06-26 23:57:38 | |
| Input files | ||
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) | |
| CPU time | 0m (0s = 0%) | |
| Max RSS bytes | 0 (0 MiB) | |
| Outputting started | ||
| Output files | ||
| Finished | 2025-06-27 00:52:17 | |
| Saved logs | justin-logs:423097.5-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
bRun: 0 event: 4 ParticleListAction.cc:817
MCTruth Handles Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 27-Jun-2025 00:24:36 UTC run: 1 subRun: 0 event: 4 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 27-Jun-2025 00:24:36 UTC run: 1 subRun: 0 event: 4 ParticleListAction.cc:830
Found 788 particles
%MSG
%MSG-i NuRandomService: IonAndScint:IonAndScint@BeginModule 27-Jun-2025 00:24:37 UTC run: 1 subRun: 0 event: 4
Random seed for this event, engine 'IonAndScint.ISCalcAlg': 142879026
%MSG
IonAndScint Module Producer
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService: IonAndScint:IonAndScintExternal@BeginModule 27-Jun-2025 00:24:38 UTC run: 1 subRun: 0 event: 4
Random seed for this event, engine 'IonAndScintExternal.ISCalcAlg': 551606289
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in:
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService: PDFastSimPAR:PDFastSim@BeginModule 27-Jun-2025 00:24:38 UTC run: 1 subRun: 0 event: 4
Random seed for this event, engine 'PDFastSim.photon': 856071541
%MSG
%MSG-i NuRandomService: PDFastSimPAR:PDFastSim@BeginModule 27-Jun-2025 00:24:38 UTC run: 1 subRun: 0 event: 4
Random seed for this event, engine 'PDFastSim.scinttime': 127046065
%MSG
%MSG-i NuRandomService: PDFastSimPVS:PDFastSimExternal@BeginModule 27-Jun-2025 00:27:13 UTC run: 1 subRun: 0 event: 4
Random seed for this event, engine 'PDFastSimExternal.photon': 142430302
%MSG
%MSG-i NuRandomService: PDFastSimPVS:PDFastSimExternal@BeginModule 27-Jun-2025 00:27:13 UTC run: 1 subRun: 0 event: 4
Random seed for this event, engine 'PDFastSimExternal.scinttime': 425553171
%MSG
Begin processing the 5th record. run: 1 subRun: 0 event: 5 at 27-Jun-2025 00:28:06 UTC
%MSG-w ParticleInventory: ProcessEvent 27-Jun-2025 00:28:06 UTC run: 1 subRun: 0 event: 5
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory: ProcessEvent 27-Jun-2025 00:28:06 UTC run: 1 subRun: 0 event: 5
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory: ProcessEvent 27-Jun-2025 00:28:06 UTC run: 1 subRun: 0 event: 5
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService: ProcessEvent 27-Jun-2025 00:28:06 UTC run: 1 subRun: 0 event: 5
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService: larg4Main:largeant@BeginModule 27-Jun-2025 00:28:06 UTC run: 1 subRun: 0 event: 5
Random seed for this event, engine 'largeant': 167167533
%MSG
%MSG-i generatePrimaries: larg4Main:largeant@BeginModule 27-Jun-2025 00:28:06 UTC run: 1 subRun: 0 event: 5 MCTruthEventAction.cc:112
Generating 786 particles
%MSG
%MSG-w beginOfEventAction::keepableGenerators: larg4Main:largeant@BeginModule 27-Jun-2025 00:28:07 UTC run: 1 subRun: 0 event: 5
storeTrajectories set to true and a non-empty keepGenTrajectories list provided in configuration file, but none of the generators in this list are present in the event! Double check list or don't provide keepGenTrajectories in the configuration to keep all trajectories from all generator labels. This may be expected for generators that have a nonzero probability of producing no particles (e.g. some radiologicals)
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 27-Jun-2025 00:28:29 UTC run: 1 subRun: 0 event: 5 ParticleListAction.cc:817
MCTruth Handles Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 27-Jun-2025 00:28:29 UTC run: 1 subRun: 0 event: 5 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction: larg4Main:largeant@BeginModule 27-Jun-2025 00:28:29 UTC run: 1 subRun: 0 event: 5 ParticleListAction.cc:830
Found 786 particles
%MSG
%MSG-i NuRandomService: IonAndScint:IonAndScint@BeginModule 27-Jun-2025 00:28:31 UTC run: 1 subRun: 0 event: 5
Random seed for this event, engine 'IonAndScint.ISCalcAlg': 118213682
%MSG
IonAndScint Module Producer
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService: IonAndScint:IonAndScintExternal@BeginModule 27-Jun-2025 00:28:34 UTC run: 1 subRun: 0 event: 5
Random seed for this event, engine 'IonAndScintExternal.ISCalcAlg': 644124884
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in:
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService: PDFastSimPAR:PDFastSim@BeginModule 27-Jun-2025 00:28:34 UTC run: 1 subRun: 0 event: 5
Random seed for this event, engine 'PDFastSim.photon': 557141186
%MSG
%MSG-i NuRandomService: PDFastSimPAR:PDFastSim@BeginModule 27-Jun-2025 00:28:34 UTC run: 1 subRun: 0 event: 5
Random seed for this event, engine 'PDFastSim.scinttime': 280803881
%MSG
%MSG-i NuRandomService: PDFastSimPVS:PDFastSimExternal@BeginModule 27-Jun-2025 00:51:09 UTC run: 1 subRun: 0 event: 5
Random seed for this event, engine 'PDFastSimExternal.photon': 724704512
%MSG
%MSG-i NuRandomService: PDFastSimPVS:PDFastSimExternal@BeginModule 27-Jun-2025 00:51:09 UTC run: 1 subRun: 0 event: 5
Random seed for this event, engine 'PDFastSimExternal.scinttime': 762080496
%MSG
IonAndScint endJob.
IonAndScint endJob.
27-Jun-2025 00:51:24 UTC Closed input file "data_gen.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 207.963 461.664 1388.52 232.671 463.79 5
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00118906 0.00283018 0.00347231 0.00312659 0.000834827 5
simulate:rns:RandomNumberSaver 0.000406256 0.00714889 0.00920766 0.00856881 0.00338665 5
simulate:largeant:larg4Main 13.8554 16.9839 24.1911 15.8942 3.68137 5
simulate:IonAndScint:IonAndScint 0.791947 1.27946 3.06094 0.838785 0.891379 5
simulate:IonAndScintExternal:IonAndScint 0.0256042 0.0362335 0.0568524 0.0327932 0.0107036 5
simulate:PDFastSim:PDFastSimPAR 143.806 391.826 1354.76 155.064 481.515 5
simulate:PDFastSimExternal:PDFastSimPVS 3.19696 14.5658 56.409 3.46195 20.9557 5
[art]:TriggerResults:TriggerResultInserter 1.8435e-05 3.7128e-05 9.9658e-05 2.3514e-05 3.13668e-05 5
end_path:out1:RootOutput 5.43e-06 1.1632e-05 3.172e-05 5.922e-06 1.01464e-05 5
end_path:out1:RootOutput(write) 42.9402 46.1808 53.2052 44.2888 4.12718 4
================================================================================================================================
%MSG-i NuRandomService: RootOutput:out1@EndJob 27-Jun-2025 00:51:24 UTC ModuleEndJob
Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
algorithm version: EventTimestamp_v1
Configured value Last value ModuleLabel.InstanceName
(per event) 118213682 IonAndScint.ISCalcAlg
(per event) 644124884 IonAndScintExternal.ISCalcAlg
(per event) 557141186 PDFastSim.photon
(per event) 280803881 PDFastSim.scinttime
(per event) 724704512 PDFastSimExternal.photon
(per event) 762080496 PDFastSimExternal.scinttime
(per event) 167167533 largeant
%MSG
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 17036.6 MB
Peak resident set size usage (VmHWM): 14981 MB
====================================================================================================
TrigReport ---------- Event summary -------------
TrigReport Events total = 5 passed = 5 failed = 0
TrigReport ---------- Modules in End-path ----------
TrigReport Run Success Error Name
TrigReport 5 5 0 out1
TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 2267.284557 Real = 2365.838894
MemReport ---------- Memory summary [base-10 MB] ------
MemReport VmPeak = 17036.6 VmHWM = 14981
terminate called after throwing an instance of 'cet::coded_exception<art::errors::ErrorCodes, &art::ExceptionDetail::translate[abi:cxx11]>'
what(): ---- FatalRootError BEGIN
Fatal Root Error: TBufferFile::Expand
Requested size (2147483647) is too large (max is 2147483646).
ROOT severity: 6000
---- FatalRootError END
../justin-jobscript: line 82: 1196 Aborted (core dumped) lar -c standard_g4_protodunehd.fcl -s data_gen.root -o "$outFile"
lar exit code 134