justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 231114.6@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID	231114.6@justin-prod-sched02.dune.hep.ac.uk
Workflow ID	7956
Stage ID	1
User name	gabrielb@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	16777216000 (16000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-06-27 07:58:06
Site	FR_CCIN2P3
Entry	DUNE_FR_CCIN2P3_cccondorce01
Last heartbeat	2025-06-27 08:38:58
From worker node	Hostname	ccwcondor0049
	cpuinfo	AMD EPYC 9334 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	16777216000 (16000 MiB)
	Wall seconds limit	106200 (29 hours)
	GPU
	Inner Apptainer?	True
Job state	jobscript_error
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2025-06-27 07:58:55
Input files
Jobscript	Exit code	1
	Real time	0m (0s)
	CPU time	0m (0s = 0%)
	Max RSS bytes	0 (0 MiB)
Outputting started
Output files
Finished	2025-06-27 08:38:58
Saved logs	justin-logs:231114.6-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

t@BeginModule  27-Jun-2025 10:31:35 CEST run: 1 subRun: 0 event: 9 ParticleListAction.cc:830
Found 753 particles
%MSG
%MSG-i NuRandomService:  IonAndScint:IonAndScint@BeginModule  27-Jun-2025 10:31:36 CEST run: 1 subRun: 0 event: 9
Random seed for this event, engine 'IonAndScint.ISCalcAlg': 305223186
%MSG
IonAndScint Module Producer
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService:  IonAndScint:IonAndScintExternal@BeginModule  27-Jun-2025 10:31:36 CEST run: 1 subRun: 0 event: 9
Random seed for this event, engine 'IonAndScintExternal.ISCalcAlg': 780186425
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService:  PDFastSimPAR:PDFastSim@BeginModule  27-Jun-2025 10:31:36 CEST run: 1 subRun: 0 event: 9
Random seed for this event, engine 'PDFastSim.photon': 71711364
%MSG
%MSG-i NuRandomService:  PDFastSimPAR:PDFastSim@BeginModule  27-Jun-2025 10:31:37 CEST run: 1 subRun: 0 event: 9
Random seed for this event, engine 'PDFastSim.scinttime': 870192079
%MSG
%MSG-i NuRandomService:  PDFastSimPVS:PDFastSimExternal@BeginModule  27-Jun-2025 10:33:33 CEST run: 1 subRun: 0 event: 9
Random seed for this event, engine 'PDFastSimExternal.photon': 35138345
%MSG
%MSG-i NuRandomService:  PDFastSimPVS:PDFastSimExternal@BeginModule  27-Jun-2025 10:33:33 CEST run: 1 subRun: 0 event: 9
Random seed for this event, engine 'PDFastSimExternal.scinttime': 399229571
%MSG
Begin processing the 10th record. run: 1 subRun: 0 event: 10 at 27-Jun-2025 10:34:16 CEST
%MSG-w ParticleInventory:  ProcessEvent 27-Jun-2025 10:34:16 CEST  run: 1 subRun: 0 event: 10
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 27-Jun-2025 10:34:16 CEST  run: 1 subRun: 0 event: 10
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 27-Jun-2025 10:34:16 CEST  run: 1 subRun: 0 event: 10
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 27-Jun-2025 10:34:16 CEST  run: 1 subRun: 0 event: 10
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  larg4Main:largeant@BeginModule  27-Jun-2025 10:34:16 CEST run: 1 subRun: 0 event: 10
Random seed for this event, engine 'largeant': 285939291
%MSG
%MSG-i generatePrimaries:  larg4Main:largeant@BeginModule  27-Jun-2025 10:34:16 CEST run: 1 subRun: 0 event: 10 MCTruthEventAction.cc:112
Generating 994 particles
%MSG
%MSG-w beginOfEventAction::keepableGenerators:  larg4Main:largeant@BeginModule  27-Jun-2025 10:34:16 CEST run: 1 subRun: 0 event: 10
storeTrajectories set to true and a non-empty keepGenTrajectories list provided in configuration file, but none of the generators in this list are present in the event! Double check list or don't provide keepGenTrajectories in the configuration to keep all trajectories from all generator labels. This may be expected for generators that have a nonzero probability of producing no particles (e.g. some radiologicals)
%MSG
%MSG-i endOfEventAction:  larg4Main:largeant@BeginModule  27-Jun-2025 10:34:29 CEST run: 1 subRun: 0 event: 10 ParticleListAction.cc:817
MCTruth Handles Size: 1
%MSG
%MSG-i endOfEventAction:  larg4Main:largeant@BeginModule  27-Jun-2025 10:34:30 CEST run: 1 subRun: 0 event: 10 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction:  larg4Main:largeant@BeginModule  27-Jun-2025 10:34:30 CEST run: 1 subRun: 0 event: 10 ParticleListAction.cc:830
Found 994 particles
%MSG
%MSG-i NuRandomService:  IonAndScint:IonAndScint@BeginModule  27-Jun-2025 10:34:32 CEST run: 1 subRun: 0 event: 10
Random seed for this event, engine 'IonAndScint.ISCalcAlg': 596417705
%MSG
IonAndScint Module Producer
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService:  IonAndScint:IonAndScintExternal@BeginModule  27-Jun-2025 10:34:33 CEST run: 1 subRun: 0 event: 10
Random seed for this event, engine 'IonAndScintExternal.ISCalcAlg': 362735162
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService:  PDFastSimPAR:PDFastSim@BeginModule  27-Jun-2025 10:34:33 CEST run: 1 subRun: 0 event: 10
Random seed for this event, engine 'PDFastSim.photon': 461265659
%MSG
%MSG-i NuRandomService:  PDFastSimPAR:PDFastSim@BeginModule  27-Jun-2025 10:34:33 CEST run: 1 subRun: 0 event: 10
Random seed for this event, engine 'PDFastSim.scinttime': 221178338
%MSG
%MSG-i NuRandomService:  PDFastSimPVS:PDFastSimExternal@BeginModule  27-Jun-2025 10:37:44 CEST run: 1 subRun: 0 event: 10
Random seed for this event, engine 'PDFastSimExternal.photon': 603233624
%MSG
%MSG-i NuRandomService:  PDFastSimPVS:PDFastSimExternal@BeginModule  27-Jun-2025 10:37:44 CEST run: 1 subRun: 0 event: 10
Random seed for this event, engine 'PDFastSimExternal.scinttime': 446465942
%MSG
IonAndScint endJob.
IonAndScint endJob.
27-Jun-2025 10:37:57 CEST  Closed input file "data_gen.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      134.618       193.574       272.242       193.197       41.3614        10     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0011981    0.00350629    0.00697317     0.0030556    0.00171062       10     
simulate:rns:RandomNumberSaver                0.000318853   0.00913141     0.0122966    0.00988918     0.0033991       10     
simulate:largeant:larg4Main                     8.41578       11.5719       16.5581       10.1912       3.21782        10     
simulate:IonAndScint:IonAndScint               0.376754       0.64201      0.993027      0.623144       0.19302        10     
simulate:IonAndScintExternal:IonAndScint       0.0122501     0.035203      0.0516904     0.0375195     0.0105844       10     
simulate:PDFastSim:PDFastSimPAR                 96.1486       140.992       191.446       139.345       32.6202        10     
simulate:PDFastSimExternal:PDFastSimPVS         3.69946       6.09503       9.57836       5.5637        1.91364        10     
[art]:TriggerResults:TriggerResultInserter    1.6695e-05    3.11631e-05   0.000111219   1.9264e-05    2.74781e-05      10     
end_path:out1:RootOutput                       5.709e-06    1.22365e-05   4.7752e-05    8.7585e-06    1.18936e-05      10     
end_path:out1:RootOutput(write)                 25.4786       38.0112       59.4171       37.0035       9.86079         9     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 27-Jun-2025 10:37:57 CEST  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)           596417705   IonAndScint.ISCalcAlg
        (per event)           362735162   IonAndScintExternal.ISCalcAlg
        (per event)           461265659   PDFastSim.photon
        (per event)           221178338   PDFastSim.scinttime
        (per event)           603233624   PDFastSimExternal.photon
        (per event)           446465942   PDFastSimExternal.scinttime
        (per event)           285939291   largeant

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 14889.2 MB
  Peak resident set size usage (VmHWM): 13807.3 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1993.889050 Real = 2024.002471

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 14889.2 VmHWM = 13807.3

%MSG-s ArtException:  PostEndJob 27-Jun-2025 10:38:33 CEST ModuleEndJob
---- EventProcessorFailure BEGIN
  EventProcessor: an exception occurred during current event processing
  ---- FatalRootError BEGIN
    Fatal Root Error: TBufferFile::WriteByteCount
    bytecount too large (more than 1073741822)
    ROOT severity: 3000
  ---- FatalRootError END
---- EventProcessorFailure END
---- FatalRootError BEGIN
  Fatal Root Error: TTree::SetEntries
  Tree branches have different numbers of entries, eg EventAuxiliary has 9 entries while sim::SimEnergyDeposits_IonAndScintExternal__G4. has 10 entries.
  ROOT severity: 2000
---- FatalRootError END
%MSG
Art has completed and will exit with status 1.
lar exit code 1

justIN time: 2025-08-15 01:24:07 UTC       justIN version: 01.03.02