justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 230515.9@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID	230515.9@justin-prod-sched02.dune.hep.ac.uk
Workflow ID	7956
Stage ID	1
User name	gabrielb@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	16777216000 (16000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-06-26 21:19:27
Site	FR_CCIN2P3
Entry	DUNE_FR_CCIN2P3_cccondorce03
Last heartbeat	2025-06-26 21:56:16
From worker node	Hostname	ccwcondor0007
	cpuinfo	AMD EPYC 9334 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	16777216000 (16000 MiB)
	Wall seconds limit	106200 (29 hours)
	GPU
	Inner Apptainer?	True
Job state	jobscript_error
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2025-06-26 21:20:49
Input files
Jobscript	Exit code	1
	Real time	0m (0s)
	CPU time	0m (0s = 0%)
	Max RSS bytes	0 (0 MiB)
Outputting started
Output files
Finished	2025-06-26 21:56:16
Saved logs	justin-logs:230515.9-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

nt@BeginModule  26-Jun-2025 23:46:17 CEST run: 1 subRun: 0 event: 9 ParticleListAction.cc:830
Found 778 particles
%MSG
%MSG-i NuRandomService:  IonAndScint:IonAndScint@BeginModule  26-Jun-2025 23:46:19 CEST run: 1 subRun: 0 event: 9
Random seed for this event, engine 'IonAndScint.ISCalcAlg': 874698559
%MSG
IonAndScint Module Producer
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService:  IonAndScint:IonAndScintExternal@BeginModule  26-Jun-2025 23:46:19 CEST run: 1 subRun: 0 event: 9
Random seed for this event, engine 'IonAndScintExternal.ISCalcAlg': 135368195
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService:  PDFastSimPAR:PDFastSim@BeginModule  26-Jun-2025 23:46:19 CEST run: 1 subRun: 0 event: 9
Random seed for this event, engine 'PDFastSim.photon': 843237281
%MSG
%MSG-i NuRandomService:  PDFastSimPAR:PDFastSim@BeginModule  26-Jun-2025 23:46:19 CEST run: 1 subRun: 0 event: 9
Random seed for this event, engine 'PDFastSim.scinttime': 389087001
%MSG
%MSG-i NuRandomService:  PDFastSimPVS:PDFastSimExternal@BeginModule  26-Jun-2025 23:48:02 CEST run: 1 subRun: 0 event: 9
Random seed for this event, engine 'PDFastSimExternal.photon': 201994056
%MSG
%MSG-i NuRandomService:  PDFastSimPVS:PDFastSimExternal@BeginModule  26-Jun-2025 23:48:02 CEST run: 1 subRun: 0 event: 9
Random seed for this event, engine 'PDFastSimExternal.scinttime': 640489968
%MSG
Begin processing the 10th record. run: 1 subRun: 0 event: 10 at 26-Jun-2025 23:48:42 CEST
%MSG-w ParticleInventory:  ProcessEvent 26-Jun-2025 23:48:42 CEST  run: 1 subRun: 0 event: 10
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 26-Jun-2025 23:48:42 CEST  run: 1 subRun: 0 event: 10
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 26-Jun-2025 23:48:42 CEST  run: 1 subRun: 0 event: 10
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 26-Jun-2025 23:48:42 CEST  run: 1 subRun: 0 event: 10
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  larg4Main:largeant@BeginModule  26-Jun-2025 23:48:42 CEST run: 1 subRun: 0 event: 10
Random seed for this event, engine 'largeant': 615322021
%MSG
%MSG-i generatePrimaries:  larg4Main:largeant@BeginModule  26-Jun-2025 23:48:42 CEST run: 1 subRun: 0 event: 10 MCTruthEventAction.cc:112
Generating 1107 particles
%MSG
%MSG-w beginOfEventAction::keepableGenerators:  larg4Main:largeant@BeginModule  26-Jun-2025 23:48:42 CEST run: 1 subRun: 0 event: 10
storeTrajectories set to true and a non-empty keepGenTrajectories list provided in configuration file, but none of the generators in this list are present in the event! Double check list or don't provide keepGenTrajectories in the configuration to keep all trajectories from all generator labels. This may be expected for generators that have a nonzero probability of producing no particles (e.g. some radiologicals)
%MSG
%MSG-i endOfEventAction:  larg4Main:largeant@BeginModule  26-Jun-2025 23:48:55 CEST run: 1 subRun: 0 event: 10 ParticleListAction.cc:817
MCTruth Handles Size: 1
%MSG
%MSG-i endOfEventAction:  larg4Main:largeant@BeginModule  26-Jun-2025 23:48:55 CEST run: 1 subRun: 0 event: 10 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction:  larg4Main:largeant@BeginModule  26-Jun-2025 23:48:55 CEST run: 1 subRun: 0 event: 10 ParticleListAction.cc:830
Found 1107 particles
%MSG
%MSG-i NuRandomService:  IonAndScint:IonAndScint@BeginModule  26-Jun-2025 23:48:57 CEST run: 1 subRun: 0 event: 10
Random seed for this event, engine 'IonAndScint.ISCalcAlg': 644374096
%MSG
IonAndScint Module Producer
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService:  IonAndScint:IonAndScintExternal@BeginModule  26-Jun-2025 23:48:58 CEST run: 1 subRun: 0 event: 10
Random seed for this event, engine 'IonAndScintExternal.ISCalcAlg': 831148937
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService:  PDFastSimPAR:PDFastSim@BeginModule  26-Jun-2025 23:48:58 CEST run: 1 subRun: 0 event: 10
Random seed for this event, engine 'PDFastSim.photon': 154320851
%MSG
%MSG-i NuRandomService:  PDFastSimPAR:PDFastSim@BeginModule  26-Jun-2025 23:48:58 CEST run: 1 subRun: 0 event: 10
Random seed for this event, engine 'PDFastSim.scinttime': 89504676
%MSG
%MSG-i NuRandomService:  PDFastSimPVS:PDFastSimExternal@BeginModule  26-Jun-2025 23:54:00 CEST run: 1 subRun: 0 event: 10
Random seed for this event, engine 'PDFastSimExternal.photon': 470750119
%MSG
%MSG-i NuRandomService:  PDFastSimPVS:PDFastSimExternal@BeginModule  26-Jun-2025 23:54:00 CEST run: 1 subRun: 0 event: 10
Random seed for this event, engine 'PDFastSimExternal.scinttime': 237953297
%MSG
IonAndScint endJob.
IonAndScint endJob.
26-Jun-2025 23:54:15 CEST  Closed input file "data_gen.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      102.244       166.436       325.521       148.298       60.2663        10     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000839138   0.00250856    0.00367269    0.00245223    0.000749946      10     
simulate:rns:RandomNumberSaver                0.00024461    0.00752067     0.0110636    0.00865229    0.00342895       10     
simulate:largeant:larg4Main                     6.67967       10.0139       15.7042       8.87041       2.86401        10     
simulate:IonAndScint:IonAndScint               0.302844      0.519915       1.02529      0.479875      0.194923        10     
simulate:IonAndScintExternal:IonAndScint       0.0272606     0.0352949     0.0475309     0.0361776     0.0059024       10     
simulate:PDFastSim:PDFastSimPAR                 69.7308       122.278       301.979       101.747       63.1589        10     
simulate:PDFastSimExternal:PDFastSimPVS         3.49114       5.37888       9.81777       4.82574       1.81614        10     
[art]:TriggerResults:TriggerResultInserter    1.5073e-05    2.43549e-05    6.656e-05    1.89335e-05   1.45256e-05      10     
end_path:out1:RootOutput                       5.718e-06    8.1072e-06    1.9259e-05    6.7755e-06    3.8649e-06       10     
end_path:out1:RootOutput(write)                 21.2665       31.316        42.1162       30.5623       6.48572         9     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 26-Jun-2025 23:54:15 CEST  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)           644374096   IonAndScint.ISCalcAlg
        (per event)           831148937   IonAndScintExternal.ISCalcAlg
        (per event)           154320851   PDFastSim.photon
        (per event)            89504676   PDFastSim.scinttime
        (per event)           470750119   PDFastSimExternal.photon
        (per event)           237953297   PDFastSimExternal.scinttime
        (per event)           615322021   largeant

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 16801.7 MB
  Peak resident set size usage (VmHWM): 15100 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1718.085278 Real = 1740.894213

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 16801.7 VmHWM = 15100

%MSG-s ArtException:  PostEndJob 26-Jun-2025 23:55:10 CEST ModuleEndJob
---- EventProcessorFailure BEGIN
  EventProcessor: an exception occurred during current event processing
  ---- FatalRootError BEGIN
    Fatal Root Error: TBufferFile::WriteByteCount
    bytecount too large (more than 1073741822)
    ROOT severity: 3000
  ---- FatalRootError END
---- EventProcessorFailure END
---- FatalRootError BEGIN
  Fatal Root Error: TTree::SetEntries
  Tree branches have different numbers of entries, eg EventAuxiliary has 9 entries while sim::SimEnergyDeposits_IonAndScintExternal__G4. has 10 entries.
  ROOT severity: 2000
---- FatalRootError END
%MSG
Art has completed and will exit with status 1.
lar exit code 1

justIN time: 2025-08-14 18:48:40 UTC       justIN version: 01.03.02