justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 426712.58@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID426712.58@justin-prod-sched01.dune.hep.ac.uk
Workflow ID8053
Stage ID1
User namehiguera@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-07-03 07:42:20
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc02
Last heartbeat2025-07-03 13:01:59
From worker nodeHostnamewn-lb-03.gina.surf.nl
cpuinfoAMD EPYC 9754 128-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-07-03 07:55:15
Input filesfardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T161045Z_gen_000702_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (17821s)
CPU time4h (17614s = 98%)
Max RSS bytes2573074432 (2453 MiB)
Outputting started2025-07-03 12:52:17
Output filesfardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T161045Z_gen_000702_supernova_g4stage1_g4stage2_detsim_reco_20250703T075527Z_reco2.root
Finished2025-07-03 13:01:59
Saved logsjustin-logs:426712.58-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:42 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:42 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:42 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:42 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:42 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:42 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:42 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:42 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:42 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:42 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:43 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:43 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:43 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:43 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:43 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:43 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:43 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:43 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:43 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:43 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:43 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:43 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:43 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:43 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:43 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:43 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:43 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 14:48:43 CEST run: 5177 subRun: 0 event: 7020
Comparing two wires in the same plane: return failure
%MSG
03-Jul-2025 14:52:06 CEST  Closed output file "prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T161045Z_gen_000702_supernova_g4stage1_g4stage2_detsim_reco_20250703T075527Z_reco2.root"
03-Jul-2025 14:52:06 CEST  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/fardet-vd/9e/fc/prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T161045Z_gen_000702_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1503.15       1762.88       2149.91       1741.96       207.808        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00800172     0.0329912     0.0963681     0.0261139     0.0248079       10     
reco:pandora:StandardPandora                            1296.39       1543.42       1890.98       1515.26       201.747        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000330656    0.0223422      0.17901     0.000863767    0.0526716       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000294262   0.00328942     0.0093121    0.000885459   0.00352676       10     
reco:pandoracalo:Calorimetry                          0.000288174   0.00337558     0.0153182    0.000426605   0.00506384       10     
reco:pandorapid:Chi2ParticleID                        5.6666e-05    0.000226295   0.000896887   7.97145e-05   0.000303572      10     
reco:linecluster:LineCluster                           0.329676      0.404177      0.538075      0.402229      0.0564592       10     
reco:trajcluster:TrajCluster                           0.359155      0.417041      0.487223      0.417565      0.0348845       10     
reco:pmtracktc:PMAlgTrackMaker                          6.79246       7.19054       7.74413       7.19266       0.30659        10     
reco:emtrkmichelid:EmTrackMichelId                      179.44        210.419       268.479       201.016       29.0441        10     
reco:solarflash:SolarOpFlash                            0.65182      0.682893      0.724521      0.685073      0.0256381       10     
[art]:TriggerResults:TriggerResultInserter            3.2629e-05    4.3419e-05    7.5774e-05    3.99345e-05   1.25757e-05      10     
end_path:out1:RootOutput                               7.211e-06    1.31609e-05   2.9634e-05     9.89e-06     8.09038e-06      10     
end_path:out1:RootOutput(write)                        0.266366      0.277437      0.288824      0.276278     0.00754033       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4038.83 MB
  Peak resident set size usage (VmHWM): 2573.07 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T161045Z_gen_000702_supernova_g4stage1_g4stage2_detsim_reco_20250703T075527Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T161045Z_gen_000702_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
old_md.json
prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T161045Z_gen_000702_supernova_g4stage1_g4stage2_detsim_reco_20250703T075527Z_reco2.root
prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T161045Z_gen_000702_supernova_g4stage1_g4stage2_detsim_reco_20250703T075527Z_reco2.root.ext.json
prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T161045Z_gen_000702_supernova_g4stage1_g4stage2_detsim_reco_20250703T075527Z_reco2.root.json
reco2_hist.root
justIN time: 2025-08-15 00:39:59 UTC       justIN version: 01.03.02