justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 426531.39@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID426531.39@justin-prod-sched01.dune.hep.ac.uk
Workflow ID8058
Stage ID1
User nameepennacc@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-07-03 00:51:26
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce15-multicore
Last heartbeat2025-07-03 05:48:56
From worker nodeHostnamegpu06.pic.es
cpuinfoAMD EPYC 9124 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-07-03 05:27:07
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250126T014129Z_gen_000734_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code139
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-07-03 05:48:56
Saved logsjustin-logs:426531.39-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

aring two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 07:39:06 CEST run: 4909 subRun: 0 event: 7331
Comparing two wires in the same plane: return failure
%MSG
03-Jul-2025 07:40:25 CEST  Opened output file with pattern "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250126T014129Z_gen_000734_supernova_g4stage1_g4stage2_detsim_reco_20250703T052757Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              691.455       691.455       691.455       691.455          0            1     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.157506      0.157506      0.157506      0.157506          0            1     
reco:pandora:StandardPandora                            606.554       606.554       606.554       606.554          0            1     
reco:pandoraTrack:LArPandoraTrackCreation              0.045694      0.045694      0.045694      0.045694          0            1     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00769003    0.00769003    0.00769003    0.00769003         0            1     
reco:pandoracalo:Calorimetry                          0.00255353    0.00255353    0.00255353    0.00255353         0            1     
reco:pandorapid:Chi2ParticleID                        0.000945975   0.000945975   0.000945975   0.000945975        0            1     
reco:linecluster:LineCluster                            1.92922       1.92922       1.92922       1.92922          0            1     
reco:trajcluster:TrajCluster                           0.310447      0.310447      0.310447      0.310447          0            1     
reco:pmtracktc:PMAlgTrackMaker                          3.72822       3.72822       3.72822       3.72822          0            1     
reco:emtrkmichelid:EmTrackMichelId                      77.1054       77.1054       77.1054       77.1054          0            1     
reco:solarflash:SolarOpFlash                            1.61268       1.61268       1.61268       1.61268          0            1     
[art]:TriggerResults:TriggerResultInserter            6.1881e-05    6.1881e-05    6.1881e-05    6.1881e-05         0            1     
end_path:out1:RootOutput                               2.341e-05     2.341e-05     2.341e-05     2.341e-05         0            1     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3979.02 MB
  Peak resident set size usage (VmHWM): 2508.32 MB
====================================================================================================
../justin-jobscript: line 74:  1138 Segmentation fault      (core dumped) lar -c reco2_supernova_dunevd10kt_1x8x14_3view_30deg_prod2024.fcl $FILE -o ${reco2_name}.root -n -1
justIN time: 2025-08-14 18:40:35 UTC       justIN version: 01.03.02