justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 423330.5@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID	423330.5@justin-prod-sched01.dune.hep.ac.uk
Workflow ID	7956
Stage ID	1
User name	gabrielb@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	16777216000 (16000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-06-27 04:37:30
Site	FR_CCIN2P3
Entry	DUNE_FR_CCIN2P3_cccondorce02
Last heartbeat	2025-06-27 05:21:13
From worker node	Hostname	ccwcondor0383
	cpuinfo	AMD EPYC 9334 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	16777216000 (16000 MiB)
	Wall seconds limit	106200 (29 hours)
	GPU
	Inner Apptainer?	True
Job state	jobscript_error
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2025-06-27 04:39:24
Input files
Jobscript	Exit code	1
	Real time	0m (0s)
	CPU time	0m (0s = 0%)
	Max RSS bytes	0 (0 MiB)
Outputting started
Output files
Finished	2025-06-27 05:21:13
Saved logs	justin-logs:423330.5-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

argeant@BeginModule  27-Jun-2025 07:14:27 CEST run: 1 subRun: 0 event: 9 ParticleListAction.cc:830
Found 750 particles
%MSG
%MSG-i NuRandomService:  IonAndScint:IonAndScint@BeginModule  27-Jun-2025 07:14:28 CEST run: 1 subRun: 0 event: 9
Random seed for this event, engine 'IonAndScint.ISCalcAlg': 389746341
%MSG
IonAndScint Module Producer
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService:  IonAndScint:IonAndScintExternal@BeginModule  27-Jun-2025 07:14:29 CEST run: 1 subRun: 0 event: 9
Random seed for this event, engine 'IonAndScintExternal.ISCalcAlg': 230503693
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService:  PDFastSimPAR:PDFastSim@BeginModule  27-Jun-2025 07:14:29 CEST run: 1 subRun: 0 event: 9
Random seed for this event, engine 'PDFastSim.photon': 575299076
%MSG
%MSG-i NuRandomService:  PDFastSimPAR:PDFastSim@BeginModule  27-Jun-2025 07:14:29 CEST run: 1 subRun: 0 event: 9
Random seed for this event, engine 'PDFastSim.scinttime': 440446197
%MSG
%MSG-i NuRandomService:  PDFastSimPVS:PDFastSimExternal@BeginModule  27-Jun-2025 07:16:26 CEST run: 1 subRun: 0 event: 9
Random seed for this event, engine 'PDFastSimExternal.photon': 15818502
%MSG
%MSG-i NuRandomService:  PDFastSimPVS:PDFastSimExternal@BeginModule  27-Jun-2025 07:16:26 CEST run: 1 subRun: 0 event: 9
Random seed for this event, engine 'PDFastSimExternal.scinttime': 676963563
%MSG
Begin processing the 10th record. run: 1 subRun: 0 event: 10 at 27-Jun-2025 07:17:13 CEST
%MSG-w ParticleInventory:  ProcessEvent 27-Jun-2025 07:17:13 CEST  run: 1 subRun: 0 event: 10
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 27-Jun-2025 07:17:13 CEST  run: 1 subRun: 0 event: 10
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 27-Jun-2025 07:17:13 CEST  run: 1 subRun: 0 event: 10
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 27-Jun-2025 07:17:13 CEST  run: 1 subRun: 0 event: 10
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  larg4Main:largeant@BeginModule  27-Jun-2025 07:17:13 CEST run: 1 subRun: 0 event: 10
Random seed for this event, engine 'largeant': 384458950
%MSG
%MSG-i generatePrimaries:  larg4Main:largeant@BeginModule  27-Jun-2025 07:17:13 CEST run: 1 subRun: 0 event: 10 MCTruthEventAction.cc:112
Generating 910 particles
%MSG
%MSG-w beginOfEventAction::keepableGenerators:  larg4Main:largeant@BeginModule  27-Jun-2025 07:17:14 CEST run: 1 subRun: 0 event: 10
storeTrajectories set to true and a non-empty keepGenTrajectories list provided in configuration file, but none of the generators in this list are present in the event! Double check list or don't provide keepGenTrajectories in the configuration to keep all trajectories from all generator labels. This may be expected for generators that have a nonzero probability of producing no particles (e.g. some radiologicals)
%MSG
%MSG-i endOfEventAction:  larg4Main:largeant@BeginModule  27-Jun-2025 07:17:23 CEST run: 1 subRun: 0 event: 10 ParticleListAction.cc:817
MCTruth Handles Size: 1
%MSG
%MSG-i endOfEventAction:  larg4Main:largeant@BeginModule  27-Jun-2025 07:17:23 CEST run: 1 subRun: 0 event: 10 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction:  larg4Main:largeant@BeginModule  27-Jun-2025 07:17:23 CEST run: 1 subRun: 0 event: 10 ParticleListAction.cc:830
Found 910 particles
%MSG
%MSG-i NuRandomService:  IonAndScint:IonAndScint@BeginModule  27-Jun-2025 07:17:25 CEST run: 1 subRun: 0 event: 10
Random seed for this event, engine 'IonAndScint.ISCalcAlg': 38534565
%MSG
IonAndScint Module Producer
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService:  IonAndScint:IonAndScintExternal@BeginModule  27-Jun-2025 07:17:25 CEST run: 1 subRun: 0 event: 10
Random seed for this event, engine 'IonAndScintExternal.ISCalcAlg': 526715547
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService:  PDFastSimPAR:PDFastSim@BeginModule  27-Jun-2025 07:17:25 CEST run: 1 subRun: 0 event: 10
Random seed for this event, engine 'PDFastSim.photon': 2906710
%MSG
%MSG-i NuRandomService:  PDFastSimPAR:PDFastSim@BeginModule  27-Jun-2025 07:17:25 CEST run: 1 subRun: 0 event: 10
Random seed for this event, engine 'PDFastSim.scinttime': 5938712
%MSG
%MSG-i NuRandomService:  PDFastSimPVS:PDFastSimExternal@BeginModule  27-Jun-2025 07:20:11 CEST run: 1 subRun: 0 event: 10
Random seed for this event, engine 'PDFastSimExternal.photon': 514130060
%MSG
%MSG-i NuRandomService:  PDFastSimPVS:PDFastSimExternal@BeginModule  27-Jun-2025 07:20:11 CEST run: 1 subRun: 0 event: 10
Random seed for this event, engine 'PDFastSimExternal.scinttime': 6984492
%MSG
IonAndScint endJob.
IonAndScint endJob.
27-Jun-2025 07:20:22 CEST  Closed input file "data_gen.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      163.713       195.86        287.659       184.327       33.4152        10     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.00126893    0.00315756    0.00471793    0.00280216    0.00110219       10     
simulate:rns:RandomNumberSaver                0.000329854   0.00949825     0.016966      0.0100873    0.00401013       10     
simulate:largeant:larg4Main                     8.79501       11.0785       14.9957       11.3711       1.82845        10     
simulate:IonAndScint:IonAndScint                0.4087       0.674475      0.945798      0.680081      0.151527        10     
simulate:IonAndScintExternal:IonAndScint       0.0350582     0.039699      0.0445583     0.0399823     0.0034263       10     
simulate:PDFastSim:PDFastSimPAR                 111.974       141.247       206.327       134.398       26.2105        10     
simulate:PDFastSimExternal:PDFastSimPVS         4.18064       6.15909       11.751        5.48787       2.03316        10     
[art]:TriggerResults:TriggerResultInserter    1.7957e-05    2.76484e-05   7.5944e-05    2.37105e-05   1.62352e-05      10     
end_path:out1:RootOutput                       5.769e-06    8.4617e-06    2.0902e-05    7.1805e-06    4.1937e-06       10     
end_path:out1:RootOutput(write)                 34.7296       40.7035       57.8037       37.7814       6.78036         9     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 27-Jun-2025 07:20:22 CEST  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)            38534565   IonAndScint.ISCalcAlg
        (per event)           526715547   IonAndScintExternal.ISCalcAlg
        (per event)             2906710   PDFastSim.photon
        (per event)             5938712   PDFastSim.scinttime
        (per event)           514130060   PDFastSimExternal.photon
        (per event)             6984492   PDFastSimExternal.scinttime
        (per event)           384458950   largeant

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 13707.5 MB
  Peak resident set size usage (VmHWM): 12563.6 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 2023.343708 Real = 2051.908485

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 13707.5 VmHWM = 12563.6

%MSG-s ArtException:  PostEndJob 27-Jun-2025 07:20:56 CEST ModuleEndJob
---- EventProcessorFailure BEGIN
  EventProcessor: an exception occurred during current event processing
  ---- FatalRootError BEGIN
    Fatal Root Error: TBufferFile::WriteByteCount
    bytecount too large (more than 1073741822)
    ROOT severity: 3000
  ---- FatalRootError END
---- EventProcessorFailure END
---- FatalRootError BEGIN
  Fatal Root Error: TTree::SetEntries
  Tree branches have different numbers of entries, eg EventAuxiliary has 9 entries while sim::SimEnergyDeposits_IonAndScintExternal__G4. has 10 entries.
  ROOT severity: 2000
---- FatalRootError END
%MSG
Art has completed and will exit with status 1.
lar exit code 1

justIN time: 2025-08-14 18:48:32 UTC       justIN version: 01.03.02