justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 422997.4@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID422997.4@justin-prod-sched01.dune.hep.ac.uk
Workflow ID7956
Stage ID1
User namegabrielb@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes16777216000 (16000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-26 22:25:10
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce01
Last heartbeat2025-06-26 22:46:28
From worker nodeHostnameccwcondor0778
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes16777216000 (16000 MiB)
Wall seconds limit106200 (29 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-26 22:26:59
Input files
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-06-26 22:46:28
Saved logsjustin-logs:422997.4-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Index : 13     used in the geometry : Yes
 Material : TITANIUM_Ti
 Range cuts        :  gamma  700 um     e-  700 um     e+  700 um  proton 700 um 
 Energy thresholds :  gamma  10.9762 keV    e-  618.791 keV    e+  590.357 keV proton 70 keV
 Region(s) which use this couple : 
    DefaultRegionForTheWorld

Index : 14     used in the geometry : Yes
 Material : FR4
 Range cuts        :  gamma  700 um     e-  700 um     e+  700 um  proton 700 um 
 Energy thresholds :  gamma  5.64317 keV    e-  389.196 keV    e+  376.336 keV proton 70 keV
 Region(s) which use this couple : 
    DefaultRegionForTheWorld

Index : 15     used in the geometry : Yes
 Material : ALUMINUM_Al
 Range cuts        :  gamma  700 um     e-  700 um     e+  700 um  proton 700 um 
 Energy thresholds :  gamma  5.85564 keV    e-  460.395 keV    e+  442.201 keV proton 70 keV
 Region(s) which use this couple : 
    DefaultRegionForTheWorld

====================================================================

Begin processing the 1st record. run: 1 subRun: 0 event: 1 at 27-Jun-2025 00:36:36 CEST
%MSG-w ParticleInventory:  ProcessEvent 27-Jun-2025 00:36:36 CEST  run: 1 subRun: 0 event: 1
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 27-Jun-2025 00:36:36 CEST  run: 1 subRun: 0 event: 1
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 27-Jun-2025 00:36:36 CEST  run: 1 subRun: 0 event: 1
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 27-Jun-2025 00:36:36 CEST  run: 1 subRun: 0 event: 1
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  larg4Main:largeant@BeginModule  27-Jun-2025 00:36:36 CEST run: 1 subRun: 0 event: 1
Random seed for this event, engine 'largeant': 324108067
%MSG
%MSG-i generatePrimaries:  larg4Main:largeant@BeginModule  27-Jun-2025 00:36:36 CEST run: 1 subRun: 0 event: 1 MCTruthEventAction.cc:112
Generating 1058 particles
%MSG
%MSG-w beginOfEventAction::keepableGenerators:  larg4Main:largeant@BeginModule  27-Jun-2025 00:36:36 CEST run: 1 subRun: 0 event: 1
storeTrajectories set to true and a non-empty keepGenTrajectories list provided in configuration file, but none of the generators in this list are present in the event! Double check list or don't provide keepGenTrajectories in the configuration to keep all trajectories from all generator labels. This may be expected for generators that have a nonzero probability of producing no particles (e.g. some radiologicals)
%MSG
%MSG-i endOfEventAction:  larg4Main:largeant@BeginModule  27-Jun-2025 00:36:58 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:817
MCTruth Handles Size: 1
%MSG
%MSG-i endOfEventAction:  larg4Main:largeant@BeginModule  27-Jun-2025 00:36:58 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction:  larg4Main:largeant@BeginModule  27-Jun-2025 00:36:58 CEST run: 1 subRun: 0 event: 1 ParticleListAction.cc:830
Found 1058 particles
%MSG
%MSG-i NuRandomService:  IonAndScint:IonAndScint@BeginModule  27-Jun-2025 00:37:02 CEST run: 1 subRun: 0 event: 1
Random seed for this event, engine 'IonAndScint.ISCalcAlg': 203470398
%MSG
IonAndScint Module Producer
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService:  IonAndScint:IonAndScintExternal@BeginModule  27-Jun-2025 00:37:05 CEST run: 1 subRun: 0 event: 1
Random seed for this event, engine 'IonAndScintExternal.ISCalcAlg': 38509250
%MSG
IonAndScint Module Producer
Skip SimEnergyDeposit in: 
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCActiveInner
Skip SimEnergyDeposit in: priorSCE
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService:  PDFastSimPAR:PDFastSim@BeginModule  27-Jun-2025 00:37:05 CEST run: 1 subRun: 0 event: 1
Random seed for this event, engine 'PDFastSim.photon': 365939999
%MSG
%MSG-i NuRandomService:  PDFastSimPAR:PDFastSim@BeginModule  27-Jun-2025 00:37:05 CEST run: 1 subRun: 0 event: 1
Random seed for this event, engine 'PDFastSim.scinttime': 745268715
%MSG
%MSG-i NuRandomService:  PDFastSimPVS:PDFastSimExternal@BeginModule  27-Jun-2025 00:44:32 CEST run: 1 subRun: 0 event: 1
Random seed for this event, engine 'PDFastSimExternal.photon': 455302258
%MSG
%MSG-i NuRandomService:  PDFastSimPVS:PDFastSimExternal@BeginModule  27-Jun-2025 00:44:32 CEST run: 1 subRun: 0 event: 1
Random seed for this event, engine 'PDFastSimExternal.scinttime': 705650906
%MSG
%MSG-i PhotonVisibilityService:  PDFastSimPVS:PDFastSimExternal@BeginModule  27-Jun-2025 00:44:36 CEST run: 1 subRun: 0 event: 1
PhotonVisibilityService Loading photon library from file /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/PhotonPropagation/LibraryData/Photon_library_protoDUNEhd_library_protoDUNEhd_v2_refactored_nonActive.root for 760182 voxels and 160 optical detectors.
%MSG
%MSG-i PhotonLibrary:  PDFastSimPVS:PDFastSimExternal@BeginModule  27-Jun-2025 00:44:36 CEST run: 1 subRun: 0 event: 1
Reading photon library from input file: /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/PhotonPropagation/LibraryData/Photon_library_protoDUNEhd_library_protoDUNEhd_v2_refactored_nonActive.root
%MSG
%MSG-i PhotonLibrary:  PDFastSimPVS:PDFastSimExternal@BeginModule  27-Jun-2025 00:44:47 CEST run: 1 subRun: 0 event: 1
Photon lookup table size : 760182 voxels,  160 channels (no voxel geometry included)
%MSG
27-Jun-2025 00:44:47 CEST  Opened output file with pattern "cosmics_g4_.root"
%MSG-i Root_Information:  PostProcessEvent TClass::Init()  27-Jun-2025 00:44:47 CEST run: 1 subRun: 0 event: 1
no dictionary for class sim::IDE is available
ROOT severity: 2000
%MSG
%MSG-i FastCloning:  PostProcessEvent 27-Jun-2025 00:44:47 CEST  run: 1 subRun: 0 event: 1
Fast cloning event data products from input file.
%MSG
IonAndScint endJob.
IonAndScint endJob.
27-Jun-2025 00:44:59 CEST  Closed input file "data_gen.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      490.669       490.669       490.669       490.669          0            1     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.00141824    0.00141824    0.00141824    0.00141824         0            1     
simulate:rns:RandomNumberSaver                0.000375896   0.000375896   0.000375896   0.000375896        0            1     
simulate:largeant:larg4Main                     25.2585       25.2585       25.2585       25.2585          0            1     
simulate:IonAndScint:IonAndScint                2.96469       2.96469       2.96469       2.96469          0            1     
simulate:IonAndScintExternal:IonAndScint       0.0324804     0.0324804     0.0324804     0.0324804         0            1     
simulate:PDFastSim:PDFastSimPAR                 447.838       447.838       447.838       447.838          0            1     
simulate:PDFastSimExternal:PDFastSimPVS         14.5218       14.5218       14.5218       14.5218          0            1     
[art]:TriggerResults:TriggerResultInserter    0.000113463   0.000113463   0.000113463   0.000113463        0            1     
end_path:out1:RootOutput                      3.3874e-05    3.3874e-05    3.3874e-05    3.3874e-05         0            1     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 27-Jun-2025 00:44:59 CEST  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)           203470398   IonAndScint.ISCalcAlg
        (per event)            38509250   IonAndScintExternal.ISCalcAlg
        (per event)           365939999   PDFastSim.photon
        (per event)           745268715   PDFastSim.scinttime
        (per event)           455302258   PDFastSimExternal.photon
        (per event)           705650906   PDFastSimExternal.scinttime
        (per event)           324108067   largeant

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 13929.3 MB
  Peak resident set size usage (VmHWM): 12082.2 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 1 passed = 1 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport          1          1          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 505.568940 Real = 517.253511

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 13929.3 VmHWM = 12082.2

*** Error in `lar': corrupted double-linked list: 0x00000000b248a5a0 ***
../justin-jobscript: line 82:  1194 Bus error               (core dumped) lar -c standard_g4_protodunehd.fcl -s data_gen.root -o "$outFile"
lar exit code 135
justIN time: 2025-08-14 18:48:42 UTC       justIN version: 01.03.02