justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 422967.4@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID422967.4@justin-prod-sched01.dune.hep.ac.uk
Workflow ID7956
Stage ID1
User namegabrielb@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes16777216000 (16000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-26 21:59:35
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce01
Last heartbeat2025-06-26 22:22:26
From worker nodeHostnameccwcondor0599
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes16777216000 (16000 MiB)
Wall seconds limit106200 (29 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-26 22:01:11
Input files
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-06-26 22:22:26
Saved logsjustin-logs:422967.4-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

nergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService:  PDFastSimPAR:PDFastSim@BeginModule  27-Jun-2025 00:09:46 CEST run: 1 subRun: 0 event: 1
Random seed for this event, engine 'PDFastSim.photon': 79382455
%MSG
%MSG-i NuRandomService:  PDFastSimPAR:PDFastSim@BeginModule  27-Jun-2025 00:09:46 CEST run: 1 subRun: 0 event: 1
Random seed for this event, engine 'PDFastSim.scinttime': 98160433
%MSG
%MSG-i NuRandomService:  PDFastSimPVS:PDFastSimExternal@BeginModule  27-Jun-2025 00:11:47 CEST run: 1 subRun: 0 event: 1
Random seed for this event, engine 'PDFastSimExternal.photon': 121955405
%MSG
%MSG-i NuRandomService:  PDFastSimPVS:PDFastSimExternal@BeginModule  27-Jun-2025 00:11:47 CEST run: 1 subRun: 0 event: 1
Random seed for this event, engine 'PDFastSimExternal.scinttime': 821656586
%MSG
%MSG-i PhotonVisibilityService:  PDFastSimPVS:PDFastSimExternal@BeginModule  27-Jun-2025 00:11:48 CEST run: 1 subRun: 0 event: 1
PhotonVisibilityService Loading photon library from file /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/PhotonPropagation/LibraryData/Photon_library_protoDUNEhd_library_protoDUNEhd_v2_refactored_nonActive.root for 760182 voxels and 160 optical detectors.
%MSG
%MSG-i PhotonLibrary:  PDFastSimPVS:PDFastSimExternal@BeginModule  27-Jun-2025 00:11:48 CEST run: 1 subRun: 0 event: 1
Reading photon library from input file: /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/PhotonPropagation/LibraryData/Photon_library_protoDUNEhd_library_protoDUNEhd_v2_refactored_nonActive.root
%MSG
%MSG-i PhotonLibrary:  PDFastSimPVS:PDFastSimExternal@BeginModule  27-Jun-2025 00:11:55 CEST run: 1 subRun: 0 event: 1
Photon lookup table size : 760182 voxels,  160 channels (no voxel geometry included)
%MSG
27-Jun-2025 00:11:56 CEST  Opened output file with pattern "cosmics_g4_.root"
%MSG-i Root_Information:  PostProcessEvent TClass::Init()  27-Jun-2025 00:11:56 CEST run: 1 subRun: 0 event: 1
no dictionary for class sim::IDE is available
ROOT severity: 2000
%MSG
%MSG-i FastCloning:  PostProcessEvent 27-Jun-2025 00:11:56 CEST  run: 1 subRun: 0 event: 1
Fast cloning event data products from input file.
%MSG
Begin processing the 2nd record. run: 1 subRun: 0 event: 2 at 27-Jun-2025 00:12:41 CEST
%MSG-w ParticleInventory:  ProcessEvent 27-Jun-2025 00:12:41 CEST  run: 1 subRun: 0 event: 2
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 27-Jun-2025 00:12:41 CEST  run: 1 subRun: 0 event: 2
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 27-Jun-2025 00:12:41 CEST  run: 1 subRun: 0 event: 2
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 27-Jun-2025 00:12:41 CEST  run: 1 subRun: 0 event: 2
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  larg4Main:largeant@BeginModule  27-Jun-2025 00:12:41 CEST run: 1 subRun: 0 event: 2
Random seed for this event, engine 'largeant': 385917159
%MSG
%MSG-i generatePrimaries:  larg4Main:largeant@BeginModule  27-Jun-2025 00:12:41 CEST run: 1 subRun: 0 event: 2 MCTruthEventAction.cc:112
Generating 763 particles
%MSG
%MSG-w beginOfEventAction::keepableGenerators:  larg4Main:largeant@BeginModule  27-Jun-2025 00:12:41 CEST run: 1 subRun: 0 event: 2
storeTrajectories set to true and a non-empty keepGenTrajectories list provided in configuration file, but none of the generators in this list are present in the event! Double check list or don't provide keepGenTrajectories in the configuration to keep all trajectories from all generator labels. This may be expected for generators that have a nonzero probability of producing no particles (e.g. some radiologicals)
%MSG
%MSG-i endOfEventAction:  larg4Main:largeant@BeginModule  27-Jun-2025 00:13:02 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:817
MCTruth Handles Size: 1
%MSG
%MSG-i endOfEventAction:  larg4Main:largeant@BeginModule  27-Jun-2025 00:13:02 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction:  larg4Main:largeant@BeginModule  27-Jun-2025 00:13:02 CEST run: 1 subRun: 0 event: 2 ParticleListAction.cc:830
Found 763 particles
%MSG
%MSG-i NuRandomService:  IonAndScint:IonAndScint@BeginModule  27-Jun-2025 00:13:04 CEST run: 1 subRun: 0 event: 2
Random seed for this event, engine 'IonAndScint.ISCalcAlg': 127850928
%MSG
IonAndScint Module Producer
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService:  IonAndScint:IonAndScintExternal@BeginModule  27-Jun-2025 00:13:05 CEST run: 1 subRun: 0 event: 2
Random seed for this event, engine 'IonAndScintExternal.ISCalcAlg': 284155020
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService:  PDFastSimPAR:PDFastSim@BeginModule  27-Jun-2025 00:13:06 CEST run: 1 subRun: 0 event: 2
Random seed for this event, engine 'PDFastSim.photon': 860177625
%MSG
%MSG-i NuRandomService:  PDFastSimPAR:PDFastSim@BeginModule  27-Jun-2025 00:13:06 CEST run: 1 subRun: 0 event: 2
Random seed for this event, engine 'PDFastSim.scinttime': 696190569
%MSG
%MSG-i NuRandomService:  PDFastSimPVS:PDFastSimExternal@BeginModule  27-Jun-2025 00:21:43 CEST run: 1 subRun: 0 event: 2
Random seed for this event, engine 'PDFastSimExternal.photon': 629037696
%MSG
%MSG-i NuRandomService:  PDFastSimPVS:PDFastSimExternal@BeginModule  27-Jun-2025 00:21:43 CEST run: 1 subRun: 0 event: 2
Random seed for this event, engine 'PDFastSimExternal.scinttime': 355054218
%MSG
IonAndScint endJob.
IonAndScint endJob.
27-Jun-2025 00:21:53 CEST  Closed input file "data_gen.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      182.927       364.819       546.71        364.819       181.892         2     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000963642   0.00255177     0.0041399    0.00255177    0.00158813        2     
simulate:rns:RandomNumberSaver                0.000282809   0.00582212     0.0113614    0.00582212    0.00553931        2     
simulate:largeant:larg4Main                     14.6888       18.7156       22.7424       18.7156       4.02679         2     
simulate:IonAndScint:IonAndScint               0.656123       1.22907       1.80201       1.22907      0.572943         2     
simulate:IonAndScintExternal:IonAndScint       0.0237065     0.0346072     0.0455078     0.0346072     0.0109007        2     
simulate:PDFastSim:PDFastSimPAR                 121.142       319.394       517.646       319.394       198.252         2     
simulate:PDFastSimExternal:PDFastSimPVS         4.42887       6.77697       9.12507       6.77697       2.3481          2     
[art]:TriggerResults:TriggerResultInserter     2.684e-05    6.02925e-05   9.3745e-05    6.02925e-05   3.34525e-05       2     
end_path:out1:RootOutput                       8.055e-06    1.74575e-05    2.686e-05    1.74575e-05   9.4025e-06        2     
end_path:out1:RootOutput(write)                 37.2707       37.2707       37.2707       37.2707          0            1     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 27-Jun-2025 00:21:53 CEST  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)           127850928   IonAndScint.ISCalcAlg
        (per event)           284155020   IonAndScintExternal.ISCalcAlg
        (per event)           860177625   PDFastSim.photon
        (per event)           696190569   PDFastSim.scinttime
        (per event)           629037696   PDFastSimExternal.photon
        (per event)           355054218   PDFastSimExternal.scinttime
        (per event)           385917159   largeant

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 14808.3 MB
  Peak resident set size usage (VmHWM): 13063.2 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 2 passed = 2 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport          2          2          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 738.057415 Real = 755.785393

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 14808.3 VmHWM = 13063.2

*** Error in `lar': corrupted double-linked list: 0x000000004df00e60 ***
../justin-jobscript: line 82:  1200 Bus error               (core dumped) lar -c standard_g4_protodunehd.fcl -s data_gen.root -o "$outFile"
lar exit code 135
justIN time: 2025-08-14 18:48:01 UTC       justIN version: 01.03.02