justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 425849.123@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID425849.123@justin-prod-sched01.dune.hep.ac.uk
Workflow ID8047
Stage ID1
User nameepennacc@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-07-01 22:51:45
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce3
Last heartbeat2025-07-02 06:03:38
From worker nodeHostnamen197.dur.scotgrid.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 5220 CPU @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-07-01 22:54:27
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T213327Z_gen_004201_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time7h (25262s)
CPU time6h (23115s = 91%)
Max RSS bytes2581127168 (2461 MiB)
Outputting started2025-07-02 05:55:29
Output filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T213327Z_gen_004201_supernova_g4stage1_g4stage2_detsim_reco_20250701T225431Z_reco2.root
Finished2025-07-02 06:03:38
Saved logsjustin-logs:425849.123-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

e same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:34 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:34 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:34 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:34 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:34 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:34 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:34 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:34 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:34 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:34 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:34 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:34 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:34 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:34 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:34 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:34 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:34 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:34 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:35 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:35 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:35 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:35 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:35 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:35 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:35 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:35 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:35 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 06:50:35 BST run: 5026 subRun: 0 event: 42010
Comparing two wires in the same plane: return failure
%MSG
02-Jul-2025 06:55:25 BST  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T213327Z_gen_004201_supernova_g4stage1_g4stage2_detsim_reco_20250701T225431Z_reco2.root"
02-Jul-2025 06:55:25 BST  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/16/07/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T213327Z_gen_004201_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2190.84       2323.56       2400.84       2334.71       63.3584        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00439322     0.0314551     0.118446     0.00710587     0.044146        10     
reco:pandora:StandardPandora                            1889.9        2047.67       2108.97       2054.14       57.0456        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000259173   0.00683341     0.0440305    0.00368456     0.0125068       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000306464    0.0022569    0.00882279    0.00163967     0.0024006       10     
reco:pandoracalo:Calorimetry                          0.000184614   0.000935837   0.00348214    0.000489276   0.00101757       10     
reco:pandorapid:Chi2ParticleID                         5.422e-05    0.000187994   0.000605093   0.000106983   0.000205654      10     
reco:linecluster:LineCluster                            1.77323       2.40613       3.16663       2.36673      0.349492        10     
reco:trajcluster:TrajCluster                            0.30527       0.43782      0.475653      0.451655      0.0474816       10     
reco:pmtracktc:PMAlgTrackMaker                          5.0896        10.0864       11.3214       10.3884       1.70824        10     
reco:emtrkmichelid:EmTrackMichelId                      167.851       260.208       284.315       268.464       31.405         10     
reco:solarflash:SolarOpFlash                            1.97934       2.33417       2.72253       2.36483      0.217642        10     
[art]:TriggerResults:TriggerResultInserter            2.3931e-05    3.26915e-05   6.2811e-05    2.8973e-05    1.10415e-05      10     
end_path:out1:RootOutput                               5.895e-06    8.7634e-06    2.1646e-05     6.686e-06    4.62823e-06      10     
end_path:out1:RootOutput(write)                        0.243293      0.372106      0.399755      0.385912      0.0440002       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4047.1 MB
  Peak resident set size usage (VmHWM): 2581.13 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T213327Z_gen_004201_supernova_g4stage1_g4stage2_detsim_reco_20250701T225431Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T213327Z_gen_004201_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
old_md.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T213327Z_gen_004201_supernova_g4stage1_g4stage2_detsim_reco_20250701T225431Z_reco2.root
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T213327Z_gen_004201_supernova_g4stage1_g4stage2_detsim_reco_20250701T225431Z_reco2.root.ext.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T213327Z_gen_004201_supernova_g4stage1_g4stage2_detsim_reco_20250701T225431Z_reco2.root.json
reco2_hist.root
justIN time: 2025-08-14 20:37:13 UTC       justIN version: 01.03.02