justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 426840.40@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID426840.40@justin-prod-sched01.dune.hep.ac.uk
Workflow ID8053
Stage ID1
User namehiguera@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-07-03 12:41:58
SiteUK_Lancaster
EntryUBoone_UK_Lancaster_HEC_grendel_ce02
Last heartbeat2025-07-03 15:35:28
From worker nodeHostnamecomp15-02
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-07-03 12:49:20
Input filesfardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T083405Z_gen_001678_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time2h (9700s)
CPU time2h (9532s = 98%)
Max RSS bytes2588610560 (2468 MiB)
Outputting started2025-07-03 15:31:00
Output filesfardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T083405Z_gen_001678_supernova_g4stage1_g4stage2_detsim_reco_20250703T124926Z_reco2.root
Finished2025-07-03 15:35:28
Saved logsjustin-logs:426840.40-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 16:29:15 BST run: 5167 subRun: 0 event: 16780
Comparing two wires in the same plane: return failure
%MSG
03-Jul-2025 16:30:55 BST  Closed output file "prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T083405Z_gen_001678_supernova_g4stage1_g4stage2_detsim_reco_20250703T124926Z_reco2.root"
03-Jul-2025 16:30:55 BST  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/fardet-vd/a9/8c/prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T083405Z_gen_001678_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              932.26        954.292       979.46        949.591       14.3966        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0037797     0.0267589     0.111167      0.0100322      0.0373         10     
reco:pandora:StandardPandora                            827.443       846.692       864.793       844.377       12.3307        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000213963   0.00560187     0.0514998    0.000278619    0.0153135       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000231383   0.00135006    0.00739858    0.000276424   0.00219864       10     
reco:pandoracalo:Calorimetry                          0.000195642   0.000991354   0.00210079    0.000966198   0.000777555      10     
reco:pandorapid:Chi2ParticleID                        5.3681e-05    0.00013603    0.000807391   5.7586e-05    0.00022414       10     
reco:linecluster:LineCluster                           0.228054      0.356466      0.534268      0.319426      0.0921554       10     
reco:trajcluster:TrajCluster                           0.262402      0.282444      0.311924      0.281154      0.0137419       10     
reco:pmtracktc:PMAlgTrackMaker                          4.80782       5.59938       6.07964       5.7164       0.400046        10     
reco:emtrkmichelid:EmTrackMichelId                      97.302        100.626       107.95        99.353        3.30898        10     
reco:solarflash:SolarOpFlash                           0.426134      0.495952      0.643861      0.462113      0.0677269       10     
[art]:TriggerResults:TriggerResultInserter             2.374e-05    3.11524e-05    5.194e-05    2.86955e-05   7.37018e-06      10     
end_path:out1:RootOutput                               9.24e-06     1.16111e-05    2.603e-05     1.02e-05     4.82715e-06      10     
end_path:out1:RootOutput(write)                        0.197209       0.20458      0.217708      0.203971     0.00548965       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4052.75 MB
  Peak resident set size usage (VmHWM): 2588.61 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T083405Z_gen_001678_supernova_g4stage1_g4stage2_detsim_reco_20250703T124926Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T083405Z_gen_001678_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
old_md.json
prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T083405Z_gen_001678_supernova_g4stage1_g4stage2_detsim_reco_20250703T124926Z_reco2.root
prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T083405Z_gen_001678_supernova_g4stage1_g4stage2_detsim_reco_20250703T124926Z_reco2.root.ext.json
prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T083405Z_gen_001678_supernova_g4stage1_g4stage2_detsim_reco_20250703T124926Z_reco2.root.json
reco2_hist.root
justIN time: 2025-08-14 17:19:56 UTC       justIN version: 01.03.02