justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 233730.165@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID233730.165@justin-prod-sched02.dune.hep.ac.uk
Workflow ID8058
Stage ID1
User nameepennacc@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-07-02 09:39:55
SiteUK_Lancaster
EntryUBoone_UK_Lancaster_HEC_grendel_ce02
Last heartbeat2025-07-02 19:46:53
From worker nodeHostnamecomp23-21
cpuinfoIntel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-07-02 13:09:13
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T171652Z_gen_001088_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time6h (22607s)
CPU time3h (14226s = 62%)
Max RSS bytes2564067328 (2445 MiB)
Outputting started2025-07-02 19:26:00
Output filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T171652Z_gen_001088_supernova_g4stage1_g4stage2_detsim_reco_20250702T131234Z_reco2.root
Finished2025-07-02 19:46:53
Saved logsjustin-logs:233730.165-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 20:23:07 BST run: 4969 subRun: 0 event: 10880
Comparing two wires in the same plane: return failure
%MSG
02-Jul-2025 20:25:57 BST  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T171652Z_gen_001088_supernova_g4stage1_g4stage2_detsim_reco_20250702T131234Z_reco2.root"
02-Jul-2025 20:25:57 BST  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/03/2a/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T171652Z_gen_001088_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1393.4        1500.8        1761.48       1437.81       131.762        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00248939     0.0291529     0.126957     0.00755579     0.0458805       10     
reco:pandora:StandardPandora                            1226.6        1307.78       1510.22       1261.91       100.189        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000188878   0.00575458     0.0422085    0.000686582    0.0122824       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000199982   0.00123997    0.00646444    0.000744562   0.00177465       10     
reco:pandoracalo:Calorimetry                          0.000176848   0.00155495    0.00375773    0.00069397    0.00149097       10     
reco:pandorapid:Chi2ParticleID                        4.4747e-05    0.000131332   0.000697571   7.31985e-05   0.00018924       10     
reco:linecluster:LineCluster                           0.990411       9.97037       44.401        1.65605       16.2409        10     
reco:trajcluster:TrajCluster                           0.255629      0.268306      0.286522      0.267783      0.0110737       10     
reco:pmtracktc:PMAlgTrackMaker                          3.99462       4.38741       5.24137       4.29378      0.379835        10     
reco:emtrkmichelid:EmTrackMichelId                      159.105       168.784       178.006       170.318       5.72308        10     
reco:solarflash:SolarOpFlash                            1.09378       9.36812       37.0655       1.64587       12.826         10     
[art]:TriggerResults:TriggerResultInserter            1.9573e-05    2.38762e-05   3.7388e-05     2.303e-05    4.7728e-06       10     
end_path:out1:RootOutput                               6.247e-06    8.0355e-06    1.4383e-05    7.5845e-06    2.18067e-06      10     
end_path:out1:RootOutput(write)                        0.189653      0.200521      0.210818      0.200649     0.00649843       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4039.45 MB
  Peak resident set size usage (VmHWM): 2564.07 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T171652Z_gen_001088_supernova_g4stage1_g4stage2_detsim_reco_20250702T131234Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T171652Z_gen_001088_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
old_md.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T171652Z_gen_001088_supernova_g4stage1_g4stage2_detsim_reco_20250702T131234Z_reco2.root
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T171652Z_gen_001088_supernova_g4stage1_g4stage2_detsim_reco_20250702T131234Z_reco2.root.ext.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T171652Z_gen_001088_supernova_g4stage1_g4stage2_detsim_reco_20250702T131234Z_reco2.root.json
reco2_hist.root
justIN time: 2025-08-14 17:16:10 UTC       justIN version: 01.03.02