justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 426804.168@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID426804.168@justin-prod-sched01.dune.hep.ac.uk
Workflow ID8061
Stage ID1
User nameepennacc@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-07-03 11:10:10
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2025-07-03 15:41:15
From worker nodeHostnamedune001-7054345.0-lcg2724.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-07-03 12:10:22
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T042402Z_gen_000079_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time3h (12484s)
CPU time3h (12026s = 96%)
Max RSS bytes2494701568 (2379 MiB)
Outputting started2025-07-03 15:38:28
Output filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T042402Z_gen_000079_supernova_g4stage1_g4stage2_detsim_reco_20250703T121051Z_reco2.root
Finished2025-07-03 15:41:15
Saved logsjustin-logs:426804.168-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:27 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:27 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:27 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:27 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:27 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:27 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:27 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:27 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:27 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:27 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:27 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:27 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:27 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:27 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:27 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:27 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:27 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:27 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:28 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:28 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:28 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:28 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:28 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:28 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:28 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:28 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:28 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 15:36:28 UTC run: 5041 subRun: 0 event: 790
Comparing two wires in the same plane: return failure
%MSG
03-Jul-2025 15:38:18 UTC  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T042402Z_gen_000079_supernova_g4stage1_g4stage2_detsim_reco_20250703T121051Z_reco2.root"
03-Jul-2025 15:38:18 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/75/ef/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T042402Z_gen_000079_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1013.95       1211.61       1386.92       1187.31       119.845        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.005748      0.0416671     0.161174      0.0161511     0.0537429       10     
reco:pandora:StandardPandora                            890.125       1067.38       1260.54       1037.92       115.379        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000328947    0.0192744     0.139989     0.00712031     0.0403681       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000313544   0.00314618     0.0213544    0.00119865    0.00608035       10     
reco:pandoracalo:Calorimetry                          0.000345582   0.00162633    0.00763623    0.000463314   0.00235251       10     
reco:pandorapid:Chi2ParticleID                        5.8098e-05    0.00032984    0.00234455    9.80535e-05   0.000672512      10     
reco:linecluster:LineCluster                            1.11561       1.20699       1.7346        1.1385       0.178071        10     
reco:trajcluster:TrajCluster                           0.247919      0.319037      0.459339      0.318229      0.0546813       10     
reco:pmtracktc:PMAlgTrackMaker                          4.58712       6.33609       8.33598       6.23588       1.3435         10     
reco:emtrkmichelid:EmTrackMichelId                      107.142       134.677       189.585       131.295       23.3103        10     
reco:solarflash:SolarOpFlash                            1.21533       1.39102       1.6281        1.39295      0.0968259       10     
[art]:TriggerResults:TriggerResultInserter            3.7096e-05    5.50693e-05   8.8875e-05    4.98755e-05   1.53623e-05      10     
end_path:out1:RootOutput                              1.0536e-05    1.82045e-05   4.2865e-05    1.44315e-05   8.87924e-06      10     
end_path:out1:RootOutput(write)                        0.174409      0.234479      0.254078      0.242848      0.0243861       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4093.76 MB
  Peak resident set size usage (VmHWM): 2494.7 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T042402Z_gen_000079_supernova_g4stage1_g4stage2_detsim_reco_20250703T121051Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T042402Z_gen_000079_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
old_md.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T042402Z_gen_000079_supernova_g4stage1_g4stage2_detsim_reco_20250703T121051Z_reco2.root
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T042402Z_gen_000079_supernova_g4stage1_g4stage2_detsim_reco_20250703T121051Z_reco2.root.ext.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T042402Z_gen_000079_supernova_g4stage1_g4stage2_detsim_reco_20250703T121051Z_reco2.root.json
reco2_hist.root
justIN time: 2025-08-14 20:39:49 UTC       justIN version: 01.03.02