justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 422858.119@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID422858.119@justin-prod-sched01.dune.hep.ac.uk
Workflow ID7961
Stage ID1
User nameimawby@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit43200 (12 hours)
Submitted time2025-06-26 20:46:40
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce02
Last heartbeat2025-06-26 21:25:09
From worker nodeHostnameccwcondor0584
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit106200 (29 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-26 20:49:07
Input filesfardet-hd:nu_dune10kt_1x2x6_1098_561_20230826T013155Z_gen_g4_detsim_hitreco__20240229T165725Z_reco2.root
JobscriptExit code0
Real time12m (751s)
CPU time9m (567s = 75%)
Max RSS bytes1216618496 (1160 MiB)
Outputting started2025-06-26 21:01:39
Output files
Finished2025-06-26 21:25:09
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

8_00_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/55/eb/nu_dune10kt_1x2x6_1098_561_20230826T013155Z_gen_g4_detsim_hitreco__20240229T165725Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
ElectronInitialRegionRefinementAlgorithm: unable to find shower pfo list ShowerParticles3D
Begin processing the 43rd record. run: 1098 subRun: 1 event: 56143 at 26-Jun-2025 22:58:52 CEST
Begin processing the 44th record. run: 1098 subRun: 1 event: 56144 at 26-Jun-2025 22:58:54 CEST
Begin processing the 45th record. run: 1098 subRun: 1 event: 56145 at 26-Jun-2025 22:58:56 CEST
Begin processing the 46th record. run: 1098 subRun: 1 event: 56146 at 26-Jun-2025 22:58:58 CEST
Begin processing the 47th record. run: 1098 subRun: 1 event: 56147 at 26-Jun-2025 22:59:00 CEST
Begin processing the 48th record. run: 1098 subRun: 1 event: 56148 at 26-Jun-2025 22:59:02 CEST
Begin processing the 49th record. run: 1098 subRun: 1 event: 56149 at 26-Jun-2025 22:59:04 CEST
Begin processing the 50th record. run: 1098 subRun: 1 event: 56150 at 26-Jun-2025 22:59:05 CEST
Begin processing the 51st record. run: 1098 subRun: 1 event: 56151 at 26-Jun-2025 22:59:07 CEST
Begin processing the 52nd record. run: 1098 subRun: 1 event: 56152 at 26-Jun-2025 22:59:10 CEST
Begin processing the 53rd record. run: 1098 subRun: 1 event: 56153 at 26-Jun-2025 22:59:13 CEST
Begin processing the 54th record. run: 1098 subRun: 1 event: 56154 at 26-Jun-2025 22:59:28 CEST
Begin processing the 55th record. run: 1098 subRun: 1 event: 56155 at 26-Jun-2025 22:59:31 CEST
ElectronInitialRegionRefinementAlgorithm: unable to find shower pfo list ShowerParticles3D
Begin processing the 56th record. run: 1098 subRun: 1 event: 56156 at 26-Jun-2025 22:59:32 CEST
Begin processing the 57th record. run: 1098 subRun: 1 event: 56157 at 26-Jun-2025 22:59:35 CEST
Begin processing the 58th record. run: 1098 subRun: 1 event: 56158 at 26-Jun-2025 22:59:42 CEST
Begin processing the 59th record. run: 1098 subRun: 1 event: 56159 at 26-Jun-2025 22:59:44 CEST
Begin processing the 60th record. run: 1098 subRun: 1 event: 56160 at 26-Jun-2025 22:59:46 CEST
Begin processing the 61st record. run: 1098 subRun: 1 event: 56161 at 26-Jun-2025 22:59:48 CEST
Begin processing the 62nd record. run: 1098 subRun: 1 event: 56162 at 26-Jun-2025 22:59:50 CEST
Begin processing the 63rd record. run: 1098 subRun: 1 event: 56163 at 26-Jun-2025 22:59:52 CEST
Begin processing the 64th record. run: 1098 subRun: 1 event: 56164 at 26-Jun-2025 22:59:54 CEST
ElectronInitialRegionRefinementAlgorithm: unable to find shower pfo list ShowerParticles3D
Begin processing the 65th record. run: 1098 subRun: 1 event: 56165 at 26-Jun-2025 22:59:56 CEST
Begin processing the 66th record. run: 1098 subRun: 1 event: 56166 at 26-Jun-2025 22:59:57 CEST
ElectronInitialRegionRefinementAlgorithm: unable to find shower pfo list ShowerParticles3D
Begin processing the 67th record. run: 1098 subRun: 1 event: 56167 at 26-Jun-2025 23:00:00 CEST
Begin processing the 68th record. run: 1098 subRun: 1 event: 56168 at 26-Jun-2025 23:00:02 CEST
Begin processing the 69th record. run: 1098 subRun: 1 event: 56169 at 26-Jun-2025 23:00:11 CEST
Begin processing the 70th record. run: 1098 subRun: 1 event: 56170 at 26-Jun-2025 23:00:13 CEST
Begin processing the 71st record. run: 1098 subRun: 1 event: 56171 at 26-Jun-2025 23:00:15 CEST
Begin processing the 72nd record. run: 1098 subRun: 1 event: 56172 at 26-Jun-2025 23:00:17 CEST
Begin processing the 73rd record. run: 1098 subRun: 1 event: 56173 at 26-Jun-2025 23:00:20 CEST
Begin processing the 74th record. run: 1098 subRun: 1 event: 56174 at 26-Jun-2025 23:00:22 CEST
Begin processing the 75th record. run: 1098 subRun: 1 event: 56175 at 26-Jun-2025 23:00:24 CEST
ElectronInitialRegionRefinementAlgorithm: unable to find shower pfo list ShowerParticles3D
Begin processing the 76th record. run: 1098 subRun: 1 event: 56176 at 26-Jun-2025 23:00:26 CEST
Begin processing the 77th record. run: 1098 subRun: 1 event: 56177 at 26-Jun-2025 23:00:52 CEST
Begin processing the 78th record. run: 1098 subRun: 1 event: 56178 at 26-Jun-2025 23:00:53 CEST
Begin processing the 79th record. run: 1098 subRun: 1 event: 56179 at 26-Jun-2025 23:00:55 CEST
ElectronInitialRegionRefinementAlgorithm: unable to find shower pfo list ShowerParticles3D
Begin processing the 80th record. run: 1098 subRun: 1 event: 56180 at 26-Jun-2025 23:00:57 CEST
ElectronInitialRegionRefinementAlgorithm: unable to find shower pfo list ShowerParticles3D
Begin processing the 81st record. run: 1098 subRun: 1 event: 56181 at 26-Jun-2025 23:00:59 CEST
ElectronInitialRegionRefinementAlgorithm: unable to find shower pfo list ShowerParticles3D
Begin processing the 82nd record. run: 1098 subRun: 1 event: 56182 at 26-Jun-2025 23:01:00 CEST
Begin processing the 83rd record. run: 1098 subRun: 1 event: 56183 at 26-Jun-2025 23:01:03 CEST
Begin processing the 84th record. run: 1098 subRun: 1 event: 56184 at 26-Jun-2025 23:01:06 CEST
Begin processing the 85th record. run: 1098 subRun: 1 event: 56185 at 26-Jun-2025 23:01:09 CEST
Begin processing the 86th record. run: 1098 subRun: 1 event: 56186 at 26-Jun-2025 23:01:10 CEST
Begin processing the 87th record. run: 1098 subRun: 1 event: 56187 at 26-Jun-2025 23:01:13 CEST
Begin processing the 88th record. run: 1098 subRun: 1 event: 56188 at 26-Jun-2025 23:01:15 CEST
Begin processing the 89th record. run: 1098 subRun: 1 event: 56189 at 26-Jun-2025 23:01:18 CEST
ElectronInitialRegionRefinementAlgorithm: unable to find shower pfo list ShowerParticles3D
Begin processing the 90th record. run: 1098 subRun: 1 event: 56190 at 26-Jun-2025 23:01:19 CEST
PandoraContentApi::GetList(*this, m_inputHitListName, pCaloHitList) return STATUS_CODE_NOT_INITIALIZED
    in function: GetVolumeIdToHitListMap
    in file:     /exp/dune/app/users/imawby/dunesw_sara/srcs/larpandoracontent/larpandoracontent/LArControlFlow/MasterAlgorithm.cc line#: 271
this->GetVolumeIdToHitListMap(volumeIdToHitListMap) return STATUS_CODE_NOT_INITIALIZED
    in function: Run
    in file:     /exp/dune/app/users/imawby/dunesw_sara/srcs/larpandoracontent/larpandoracontent/LArControlFlow/MasterAlgorithm.cc line#: 165
iter->second->Run() throw STATUS_CODE_NOT_INITIALIZED
    in function: RunAlgorithm
    in file:     /scratch/workspace/build-larbase/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/SLF7/build/pandora/v03_16_00l/src/pandora-v03-16-00/PandoraSDK-v03-04-01/src/Api/PandoraContentApiImpl.cc line#: 235
Failure in algorithm Alg0002, LArDLMaster, STATUS_CODE_NOT_INITIALIZED
Begin processing the 91st record. run: 1098 subRun: 1 event: 56191 at 26-Jun-2025 23:01:20 CEST
Begin processing the 92nd record. run: 1098 subRun: 1 event: 56192 at 26-Jun-2025 23:01:21 CEST
Begin processing the 93rd record. run: 1098 subRun: 1 event: 56193 at 26-Jun-2025 23:01:23 CEST
Begin processing the 94th record. run: 1098 subRun: 1 event: 56194 at 26-Jun-2025 23:01:25 CEST
ElectronInitialRegionRefinementAlgorithm: unable to find shower pfo list ShowerParticles3D
Begin processing the 95th record. run: 1098 subRun: 1 event: 56195 at 26-Jun-2025 23:01:26 CEST
Begin processing the 96th record. run: 1098 subRun: 1 event: 56196 at 26-Jun-2025 23:01:28 CEST
Begin processing the 97th record. run: 1098 subRun: 1 event: 56197 at 26-Jun-2025 23:01:29 CEST
Begin processing the 98th record. run: 1098 subRun: 1 event: 56198 at 26-Jun-2025 23:01:31 CEST
Begin processing the 99th record. run: 1098 subRun: 1 event: 56199 at 26-Jun-2025 23:01:34 CEST
Begin processing the 100th record. run: 1098 subRun: 1 event: 56200 at 26-Jun-2025 23:01:36 CEST
26-Jun-2025 23:01:38 CEST  Closed output file "nu_dune10kt_1x2x6_1098_561_20230826T013155Z_gen_g4_detsim_hitreco__20240229T165725Z_reco2_reco2.root"
26-Jun-2025 23:01:38 CEST  Closed input file "root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/55/eb/nu_dune10kt_1x2x6_1098_561_20230826T013155Z_gen_g4_detsim_hitreco__20240229T165725Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      0.16275       5.41582       229.004       1.56613       23.8823        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0294474     0.0516474     0.0742553     0.0517972    0.00890727       100    
reco:pandora:StandardPandora                   0.123957       5.35356       228.876       1.50733       23.8746        100    
[art]:TriggerResults:TriggerResultInserter     1.047e-05    2.40314e-05   0.000131356   2.0598e-05    1.48188e-05      100    
end_path:out1:RootOutput                       2.956e-06    4.99574e-06   5.5744e-05     4.433e-06    5.13887e-06      100    
end_path:out1:RootOutput(write)               0.00124211     0.0103692     0.0616153    0.00759778     0.0103581       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2234.4 MB
  Peak resident set size usage (VmHWM): 1216.62 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2025-08-14 18:22:26 UTC       justIN version: 01.03.02