justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 233491.4@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID233491.4@justin-prod-sched02.dune.hep.ac.uk
Workflow ID8047
Stage ID1
User nameepennacc@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-07-01 23:20:12
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce3
Last heartbeat2025-07-02 06:18:08
From worker nodeHostnamen263.dur.scotgrid.ac.uk
cpuinfoAMD EPYC 9534 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-07-02 03:39:30
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T054526Z_gen_001501_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time2h (8812s)
CPU time1h (6997s = 79%)
Max RSS bytes2568056832 (2449 MiB)
Outputting started2025-07-02 06:06:23
Output filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T054526Z_gen_001501_supernova_g4stage1_g4stage2_detsim_reco_20250702T034040Z_reco2.root
Finished2025-07-02 06:18:08
Saved logsjustin-logs:233491.4-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 07:05:09 BST run: 5031 subRun: 0 event: 15010
Comparing two wires in the same plane: return failure
%MSG
02-Jul-2025 07:06:19 BST  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T054526Z_gen_001501_supernova_g4stage1_g4stage2_detsim_reco_20250702T034040Z_reco2.root"
02-Jul-2025 07:06:19 BST  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/4a/6f/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T054526Z_gen_001501_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              660.798       704.242       944.44        679.068       80.3637        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00291878     0.0303744     0.130757     0.00686485     0.0485548       10     
reco:pandora:StandardPandora                            587.602       628.541       867.084       604.011       79.7607        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00020156    0.00382026     0.0321636    0.000228125   0.00947037       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00017016    0.000786254   0.00401412    0.00018473    0.00114179       10     
reco:pandoracalo:Calorimetry                          0.00015111    0.000659105   0.00147678    0.00045238    0.000508628      10     
reco:pandorapid:Chi2ParticleID                        3.0609e-05    9.15771e-05   0.00031645    3.3081e-05    0.000105612      10     
reco:linecluster:LineCluster                            1.06515       1.30872       1.58891       1.33118      0.168159        10     
reco:trajcluster:TrajCluster                           0.162849      0.178386      0.189443      0.180334     0.00800934       10     
reco:pmtracktc:PMAlgTrackMaker                          3.10264       3.51142       3.6593        3.55661      0.160452        10     
reco:emtrkmichelid:EmTrackMichelId                      66.4171       69.2415       72.8392       68.9555       1.9241         10     
reco:solarflash:SolarOpFlash                            1.10007       1.28556       1.66289       1.21976      0.158044        10     
[art]:TriggerResults:TriggerResultInserter             1.56e-05     2.37899e-05   3.6739e-05     2.313e-05    5.45259e-06      10     
end_path:out1:RootOutput                               5.43e-06     7.0921e-06    1.6171e-05     5.96e-06     3.08725e-06      10     
end_path:out1:RootOutput(write)                        0.133385      0.138447      0.144513      0.138826     0.00322044       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4042.35 MB
  Peak resident set size usage (VmHWM): 2568.06 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T054526Z_gen_001501_supernova_g4stage1_g4stage2_detsim_reco_20250702T034040Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T054526Z_gen_001501_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
old_md.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T054526Z_gen_001501_supernova_g4stage1_g4stage2_detsim_reco_20250702T034040Z_reco2.root
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T054526Z_gen_001501_supernova_g4stage1_g4stage2_detsim_reco_20250702T034040Z_reco2.root.ext.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T054526Z_gen_001501_supernova_g4stage1_g4stage2_detsim_reco_20250702T034040Z_reco2.root.json
reco2_hist.root
justIN time: 2025-08-14 20:35:11 UTC       justIN version: 01.03.02